Sep 11 19:29:25.653582 ip-10-0-139-38 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 19:29:26.044991 ip-10-0-139-38 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:29:26.044991 ip-10-0-139-38 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 19:29:26.044991 ip-10-0-139-38 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:29:26.044991 ip-10-0-139-38 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 19:29:26.044991 ip-10-0-139-38 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:29:26.045665 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.045070    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 19:29:26.048713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048698    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:29:26.048713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048712    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048718    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048723    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048734    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048737    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048740    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048743    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048745    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048748    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048751    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048753    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048756    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048758    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048761    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048764    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048766    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048769    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048771    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048774    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:29:26.048784 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048776    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048779    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048787    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048790    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048793    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048796    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048798    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048801    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048804    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048806    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048809    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048813    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048816    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048819    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048822    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048826    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048829    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048832    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048835    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:29:26.049231 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048837    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048840    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048842    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048844    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048847    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048850    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048852    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048854    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048857    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048859    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048862    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048864    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048867    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048869    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048872    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048875    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048877    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048880    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048882    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048885    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:29:26.049735 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048888    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048890    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048892    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048895    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048897    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048900    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048902    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048904    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048907    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048909    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048912    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048914    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048917    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048920    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048923    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048925    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048928    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048930    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048933    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048936    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:29:26.050211 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048938    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048941    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048943    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048945    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048949    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048951    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048954    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048957    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048960    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048963    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048965    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048967    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048970    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048972    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048975    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048977    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048980    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048982    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048985    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:29:26.050815 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.048987    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049710    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049717    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049720    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049724    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049727    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049729    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049732    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049737    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049741    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049744    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049747    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049751    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049754    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049757    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049759    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049764    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049767    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049770    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:29:26.051325 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049773    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049776    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049779    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049781    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049784    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049787    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049789    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049792    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049795    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049797    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049800    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049802    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049805    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049807    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049810    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049812    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049814    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049816    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049821    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049824    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:29:26.051827 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049827    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049830    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049832    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049835    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049837    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049840    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049843    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049845    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049848    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049850    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049853    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049856    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049858    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049861    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049863    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049866    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049868    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049871    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049873    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049876    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:29:26.052334 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049878    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049881    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049883    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049885    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049890    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049893    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049895    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049898    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049900    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049903    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049907    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049909    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049912    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049914    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049917    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049919    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049922    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049925    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049927    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:29:26.052830 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049930    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049932    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049935    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049938    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049941    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049943    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049946    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049948    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049951    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049953    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049956    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049958    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049961    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049963    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049965    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049968    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049970    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049973    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049975    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:29:26.053302 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049978    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049980    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.049983    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050396    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050405    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050408    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050411    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050414    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050417    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050420    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050422    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050425    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050427    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050430    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050434    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050437    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050441    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050444    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:29:26.053757 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050448    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050451    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050454    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050457    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050461    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050464    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050466    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050469    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050471    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050473    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050476    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050478    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050480    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050483    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050485    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050488    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050490    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050493    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050496    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050499    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:29:26.054195 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050501    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050503    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050506    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050508    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050511    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050513    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050516    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050518    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050522    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050525    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050527    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050530    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050532    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050534    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050537    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050539    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050542    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050544    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050547    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050549    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:29:26.054713 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050551    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050554    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050556    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050559    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050561    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050563    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050566    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050568    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050571    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050573    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050577    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050579    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050581    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050584    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050586    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050589    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050591    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050593    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050596    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050598    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:29:26.055197 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050602    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050605    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050607    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050610    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050612    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050614    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050617    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050619    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050622    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050624    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050626    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050629    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050631    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050633    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050636    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050638    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050640    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050643    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050645    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050648    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:29:26.055684 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050650    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050653    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050657    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.050660    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050721    2578 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050754    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050761    2578 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050765    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050769    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050772    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050777    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050781    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050784    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050787    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050791    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050795    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050798    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050800    2578 flags.go:64] FLAG: --cgroup-root=""
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050803    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050806    2578 flags.go:64] FLAG: --client-ca-file=""
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050809    2578 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050811    2578 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050815    2578 flags.go:64] FLAG: --cluster-domain=""
Sep 11 19:29:26.056166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050818    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050821    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050824    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050827    2578 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050831    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050834    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050837    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050840    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050843    2578 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050846    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050849    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050854    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050857    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050861    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050864    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050867    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050870    2578 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050873    2578 flags.go:64] FLAG: --enable-server="true"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050875    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050880    2578 flags.go:64] FLAG: --event-burst="100"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050884    2578 flags.go:64] FLAG: --event-qps="50"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050887    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050890    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050892    2578 flags.go:64] FLAG: --eviction-hard=""
Sep 11 19:29:26.056718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050896    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050899    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050902    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050905    2578 flags.go:64] FLAG: --eviction-soft=""
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050907    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050910    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050913    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050916    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050918    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050921    2578 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050924    2578 flags.go:64] FLAG: --feature-gates=""
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050927    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050930    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050933    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050936    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050939    2578 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050942    2578 flags.go:64] FLAG: --help="false"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050944    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050948    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050951    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050954    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050957    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050961    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050964    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 19:29:26.057346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050966    2578 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050969    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050972    2578 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050974    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050980    2578 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050983    2578 flags.go:64] FLAG: --kube-reserved=""
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050986    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050989    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050992    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050995    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.050998    2578 flags.go:64] FLAG: --lock-file=""
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051000    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051003    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051006    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051011    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051014    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051017    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051019    2578 flags.go:64] FLAG: --logging-format="text"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051022    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051025    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051028    2578 flags.go:64] FLAG: --manifest-url=""
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051031    2578 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051035    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051038    2578 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051041    2578 flags.go:64] FLAG: --max-pods="110"
Sep 11 19:29:26.058468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051044    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051047    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051051    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051054    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051056    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051059    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051062    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051071    2578 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051074    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051077    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051080    2578 flags.go:64] FLAG: --pod-cidr=""
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051084    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051089    2578 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051092    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051095    2578 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051098    2578 flags.go:64] FLAG: --port="10250"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051100    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051104    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0827871a8c45729d1"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051107    2578 flags.go:64] FLAG: --qos-reserved=""
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051110    2578 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051113    2578 flags.go:64] FLAG: --register-node="true"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051116    2578 flags.go:64] FLAG: --register-with-taints=""
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051119    2578 flags.go:64] FLAG: --registry-burst="10"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051122    2578 flags.go:64] FLAG: --registry-qps="5"
Sep 11 19:29:26.059560 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051125    2578 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051128    2578 flags.go:64] FLAG: --reserved-memory=""
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051131    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051134    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051137    2578 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051139    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051142    2578 flags.go:64] FLAG: --runonce="false"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051145    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051148    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051151    2578 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051155    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051157    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051160    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051163    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051166    2578 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051169    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051171    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051174    2578 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051176    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051179    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051183    2578 flags.go:64] FLAG: --system-cgroups=""
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051186    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051191    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051194    2578 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051196    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 19:29:26.060176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051200    2578 flags.go:64] FLAG: --tls-min-version=""
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051203    2578 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051206    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051208    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051211    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051214    2578 flags.go:64] FLAG: --v="2"
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051217    2578 flags.go:64] FLAG: --version="false"
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051221    2578 flags.go:64] FLAG: --vmodule=""
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051224    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.051228    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051350    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051355    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051359    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051362    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051365    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051369    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051371    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051375    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051378    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051381    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051383    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051386    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:29:26.061294 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051389    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051391    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051395    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051399    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051402    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051406    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051409    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051412    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051415    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051417    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051419    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051422    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051425    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051428    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051430    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051433    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051435    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051439    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051443    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051447    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:29:26.062059 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051451    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051454    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051457    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051459    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051462    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051464    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051467    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051470    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051472    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051475    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051478    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051480    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051483    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051485    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051488    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051490    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051493    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051497    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051499    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051502    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:29:26.062992 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051504    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051507    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051509    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051512    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051514    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051517    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051520    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051522    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051525    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051527    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051530    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051532    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051535    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051538    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051542    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051545    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051547    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051550    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051552    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:29:26.063774 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051555    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051557    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051560    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051562    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051565    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051567    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051569    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051572    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051574    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051577    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051580    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051583    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051585    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051588    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051590    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051592    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051595    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051597    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051600    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051603    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:29:26.064411 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051606    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051608    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051611    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051613    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051616    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051618    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051621    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.051623    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.052169    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.059585    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.059606    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.060252    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.060295    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060381    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060389    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:29:26.064930 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060395    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060399    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060404    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060409    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060413    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060417    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060421    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060426    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060431    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060435    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060439    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060446    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060452    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060457    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060462    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060467    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060471    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060476    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060480    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:29:26.065410 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060485    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060489    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060494    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060498    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060503    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060508    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060512    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060517    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060523    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060529    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060533    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060538    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060542    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060546    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060550    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060554    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060558    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060563    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060567    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060571    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:29:26.065906 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060575    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060579    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060584    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060588    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060592    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060596    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060600    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060604    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060608    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060613    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060617    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060621    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060625    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060630    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060635    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060639    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060643    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060647    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060651    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060655    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:29:26.066461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060659    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060664    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060668    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060672    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060676    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060680    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060687    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060693    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060697    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060702    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060706    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060710    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060714    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060718    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060722    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060733    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060738    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060742    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060746    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:29:26.066983 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060751    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060755    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060760    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060764    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060769    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060773    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060777    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060781    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060787    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060793    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060797    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060802    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060806    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060811    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060815    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060820    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060825    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060829    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:29:26.067831 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.060833    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.060841    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061032    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061040    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061045    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061049    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061053    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061056    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061060    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061064    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061068    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061073    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061077    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061081    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061086    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:29:26.068604 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061090    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061094    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061098    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061103    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061107    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061111    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061115    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061120    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061124    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061128    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061132    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061136    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061140    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061144    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061148    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061153    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061158    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061162    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061166    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061170    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:29:26.069280 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061174    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061178    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061182    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061186    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061190    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061194    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061199    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061203    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061207    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061211    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061215    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061220    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061224    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061227    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061232    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061235    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061240    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061243    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061247    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061251    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:29:26.070015 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061273    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061278    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061282    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061286    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061290    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061294    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061299    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061303    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061307    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061311    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061315    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061319    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061323    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061326    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061330    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061334    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061338    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061342    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061349    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:29:26.070538 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061355    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061360    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061365    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061369    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061374    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061378    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061382    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061387    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061391    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061396    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061402    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061407    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061412    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061417    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061421    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061425    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061429    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061434    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061438    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061443    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:29:26.071148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061447    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061453    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061458    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061463    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061467    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061471    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:26.061475    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.061482    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.061627    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.064172    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.065094    2578 server.go:1019] "Starting client certificate rotation"
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.065198    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.065236    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 19:29:26.071947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.067818    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 19:29:26.072554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.069769    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 19:29:26.079915 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.079892    2578 log.go:25] "Validated CRI v1 runtime API"
Sep 11 19:29:26.082753 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.082738    2578 log.go:25] "Validated CRI v1 image API"
Sep 11 19:29:26.083656 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.083641    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 19:29:26.088152 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.088134    2578 fs.go:135] Filesystem UUIDs: map[595b888e-78e6-42ad-89f3-c9812301188a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c38b8629-b036-4502-92d5-c771be747f7a:/dev/nvme0n1p3]
Sep 11 19:29:26.088203 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.088153    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 19:29:26.093203 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.093091    2578 manager.go:216] Machine: {Timestamp:2026-09-11 19:29:26.091879634 +0000 UTC m=+0.325953046 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3140528 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28c5cb2a337982167638c29d50249c SystemUUID:ec28c5cb-2a33-7982-1676-38c29d50249c BootID:11086c15-5856-4f50-aeb7-ade19e7988e6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:0f:56:1b:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:0f:56:1b:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:75:80:78:58:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 19:29:26.093203 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.093202    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 19:29:26.093325 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.093297    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 19:29:26.096589 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.096562    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 19:29:26.096790 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.096592    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 19:29:26.096886 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.096871    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 19:29:26.097520 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.097508    2578 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 19:29:26.097551 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.097523    2578 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 19:29:26.097551 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.097531    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 19:29:26.098099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.098089    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 19:29:26.098811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.098801    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 19:29:26.101943 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.101931    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 19:29:26.102066 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.102057    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 19:29:26.102100 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.102087    2578 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 19:29:26.102100 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.102097    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 19:29:26.102150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.102110    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 19:29:26.102150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.102120    2578 kubelet.go:398] "Adding apiserver pod source"
Sep 11 19:29:26.102150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.102134    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 19:29:26.102584 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.102572    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 19:29:26.102627 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.102602    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 19:29:26.105025 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.104999    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 19:29:26.106968 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.106954    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 19:29:26.107016 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.106986    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 19:29:26.108426 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108409    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 19:29:26.108474 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108440    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 19:29:26.108474 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108452    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 19:29:26.108474 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108472    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 19:29:26.108554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108485    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 19:29:26.108554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108494    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 19:29:26.108554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108514    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 19:29:26.108554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108522    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 19:29:26.108554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108531    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 19:29:26.108554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108539    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 19:29:26.108706 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108561    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 19:29:26.108706 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.108573    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 19:29:26.109225 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.109214    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 19:29:26.109253 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.109228    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 19:29:26.110526 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.110501    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 19:29:26.110586 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.110517    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 19:29:26.112902 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.112888    2578 server.go:1268] "Started kubelet"
Sep 11 19:29:26.113001 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.112974    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 19:29:26.113076 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.112983    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 19:29:26.113199 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.113187    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 19:29:26.113774 ip-10-0-139-38 systemd[1]: Started Kubernetes Kubelet.
Sep 11 19:29:26.117042 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.116903    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 19:29:26.117246 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.117216    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 19:29:26.118922 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.118905    2578 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 19:29:26.119726 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.119698    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 19:29:26.121307 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.121291    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 19:29:26.121307 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.121299    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 19:29:26.121523 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.121374    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:26.121777 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.121758    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 19:29:26.121777 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.121775    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 19:29:26.121905 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.121761    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 19:29:26.121905 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.121885    2578 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 19:29:26.121905 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.121890    2578 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 19:29:26.123769 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.123615    2578 factory.go:55] Registering systemd factory
Sep 11 19:29:26.123861 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.123773    2578 factory.go:223] Registration of the systemd container factory successfully
Sep 11 19:29:26.123861 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.123734    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 19:29:26.123861 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.123839    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 19:29:26.124161 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.124145    2578 factory.go:153] Registering CRI-O factory
Sep 11 19:29:26.124161 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.124162    2578 factory.go:223] Registration of the crio container factory successfully
Sep 11 19:29:26.124336 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.124208    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 19:29:26.124336 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.124223    2578 factory.go:103] Registering Raw factory
Sep 11 19:29:26.124336 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.124237    2578 manager.go:1196] Started watching for new ooms in manager
Sep 11 19:29:26.124738 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.124643    2578 manager.go:349] Starting recovery of all containers
Sep 11 19:29:26.124738 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.123560    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-38.ec2.internal.18d45af65b484fcd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-38.ec2.internal,UID:ip-10-0-139-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-38.ec2.internal,},FirstTimestamp:2026-09-11 19:29:26.112849869 +0000 UTC m=+0.346923282,LastTimestamp:2026-09-11 19:29:26.112849869 +0000 UTC m=+0.346923282,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-38.ec2.internal,}"
Sep 11 19:29:26.133245 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.133220    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7g55c"
Sep 11 19:29:26.135302 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.135288    2578 manager.go:354] Recovery completed
Sep 11 19:29:26.139435 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.139420    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:29:26.141436 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.141421    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7g55c"
Sep 11 19:29:26.141801 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.141788    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:29:26.141858 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.141817    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:29:26.141858 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.141831    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:29:26.142404 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.142386    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 19:29:26.142404 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.142402    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:29:26.142493 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.142404    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 19:29:26.142493 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.142472    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 19:29:26.143071 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.143057    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:29:26.143132 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.143084    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:29:26.143132 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.143093    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:29:26.143522 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.143497    2578 policy_none.go:49] "None policy: Start"
Sep 11 19:29:26.143522 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.143520    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 19:29:26.143620 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.143543    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 19:29:26.143717 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.143651    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-38.ec2.internal.18d45af65d021680  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-38.ec2.internal,UID:ip-10-0-139-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-38.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-38.ec2.internal,},FirstTimestamp:2026-09-11 19:29:26.141802112 +0000 UTC m=+0.375875528,LastTimestamp:2026-09-11 19:29:26.141802112 +0000 UTC m=+0.375875528,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-38.ec2.internal,}"
Sep 11 19:29:26.144493 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.144481    2578 policy_none.go:47] "Start"
Sep 11 19:29:26.190829 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.190812    2578 manager.go:337] "Starting Device Plugin manager"
Sep 11 19:29:26.190971 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.190856    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 19:29:26.190971 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.190869    2578 server.go:87] "Starting device plugin registration server"
Sep 11 19:29:26.191214 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.191200    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 19:29:26.191298 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.191215    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 19:29:26.191355 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.191331    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 19:29:26.191505 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.191483    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 19:29:26.191505 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.191496    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 19:29:26.191861 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.191844    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 19:29:26.191933 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.191894    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:26.249167 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.249133    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 19:29:26.250510 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.250490    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 19:29:26.250595 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.250553    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 19:29:26.250595 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.250581    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 19:29:26.250676 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.250625    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 19:29:26.253002 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.252984    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:29:26.291358 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.291316    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:29:26.292305 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.292288    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:29:26.292400 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.292318    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:29:26.292400 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.292329    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:29:26.292400 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.292351    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.298252 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.298191    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.298252 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.298214    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-38.ec2.internal\": node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:26.313739 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.313719    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:26.351212 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.351188    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-38.ec2.internal"]
Sep 11 19:29:26.351311 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.351292    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:29:26.352773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.352756    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:29:26.352841 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.352788    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:29:26.352841 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.352799    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:29:26.353903 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.353890    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:29:26.354035 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.354019    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.354089 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.354055    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:29:26.354653 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.354635    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:29:26.354653 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.354644    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:29:26.354814 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.354664    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:29:26.354814 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.354675    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:29:26.354814 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.354664    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:29:26.354814 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.354772    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:29:26.355835 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.355819    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.355933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.355850    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:29:26.356530 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.356507    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:29:26.356601 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.356538    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:29:26.356601 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.356549    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:29:26.378874 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.378851    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-38.ec2.internal\" not found" node="ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.383386 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.383372    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-38.ec2.internal\" not found" node="ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.414727 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.414699    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:26.423091 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.423066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e1a1e012679bf6f37bb576f37cb5f1b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal\" (UID: \"0e1a1e012679bf6f37bb576f37cb5f1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.423161 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.423095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e1a1e012679bf6f37bb576f37cb5f1b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal\" (UID: \"0e1a1e012679bf6f37bb576f37cb5f1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.423161 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.423113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a4e57d2e889ae916c1f1beebb193bc0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-38.ec2.internal\" (UID: \"9a4e57d2e889ae916c1f1beebb193bc0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.515794 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.515765    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:26.524093 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.524074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e1a1e012679bf6f37bb576f37cb5f1b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal\" (UID: \"0e1a1e012679bf6f37bb576f37cb5f1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.524180 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.524096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e1a1e012679bf6f37bb576f37cb5f1b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal\" (UID: \"0e1a1e012679bf6f37bb576f37cb5f1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.524180 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.524116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a4e57d2e889ae916c1f1beebb193bc0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-38.ec2.internal\" (UID: \"9a4e57d2e889ae916c1f1beebb193bc0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.524289 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.524180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a4e57d2e889ae916c1f1beebb193bc0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-38.ec2.internal\" (UID: \"9a4e57d2e889ae916c1f1beebb193bc0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.524289 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.524185    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e1a1e012679bf6f37bb576f37cb5f1b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal\" (UID: \"0e1a1e012679bf6f37bb576f37cb5f1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.524289 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.524207    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e1a1e012679bf6f37bb576f37cb5f1b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal\" (UID: \"0e1a1e012679bf6f37bb576f37cb5f1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.616606 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.616531    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:26.681108 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.681078    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.685893 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:26.685878    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:26.717326 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.717296    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:26.817820 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.817770    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:26.918397 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:26.918312    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:27.018886 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:27.018854    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:27.065328 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.065296    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 19:29:27.065747 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.065436    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 19:29:27.119455 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:27.119432    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-38.ec2.internal\" not found"
Sep 11 19:29:27.144624 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.144592    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 19:24:26 +0000 UTC" deadline="2028-03-14 07:24:33.611064478 +0000 UTC"
Sep 11 19:29:27.144624 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.144622    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13187h55m6.466446783s"
Sep 11 19:29:27.182982 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:27.182947    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e1a1e012679bf6f37bb576f37cb5f1b.slice/crio-78f6580517fbc46e1d9301ccd70c414cb50b15639d2969a432de2b64e84fa338 WatchSource:0}: Error finding container 78f6580517fbc46e1d9301ccd70c414cb50b15639d2969a432de2b64e84fa338: Status 404 returned error can't find the container with id 78f6580517fbc46e1d9301ccd70c414cb50b15639d2969a432de2b64e84fa338
Sep 11 19:29:27.183223 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:27.183203    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a4e57d2e889ae916c1f1beebb193bc0.slice/crio-72c41655ea103b9100182bb29590cec2f2fc5fa2b891ffe7b27f2fb53454a3e3 WatchSource:0}: Error finding container 72c41655ea103b9100182bb29590cec2f2fc5fa2b891ffe7b27f2fb53454a3e3: Status 404 returned error can't find the container with id 72c41655ea103b9100182bb29590cec2f2fc5fa2b891ffe7b27f2fb53454a3e3
Sep 11 19:29:27.187991 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.187936    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:29:27.198230 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.198213    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:29:27.222440 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.222423    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:27.234001 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.233984    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 19:29:27.235951 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.235940    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-38.ec2.internal"
Sep 11 19:29:27.246009 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.245991    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 19:29:27.254199 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.254158    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal" event={"ID":"0e1a1e012679bf6f37bb576f37cb5f1b","Type":"ContainerStarted","Data":"78f6580517fbc46e1d9301ccd70c414cb50b15639d2969a432de2b64e84fa338"}
Sep 11 19:29:27.255091 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.255071    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-38.ec2.internal" event={"ID":"9a4e57d2e889ae916c1f1beebb193bc0","Type":"ContainerStarted","Data":"72c41655ea103b9100182bb29590cec2f2fc5fa2b891ffe7b27f2fb53454a3e3"}
Sep 11 19:29:27.543994 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.543925    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:29:27.588348 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:27.588319    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:29:28.071963 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.071928    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:29:28.103522 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.103491    2578 apiserver.go:52] "Watching apiserver"
Sep 11 19:29:28.116126 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.116090    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 19:29:28.117906 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.117873    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-qnhl6","kube-system/kube-apiserver-proxy-ip-10-0-139-38.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt","openshift-cluster-node-tuning-operator/tuned-tvnkk","openshift-dns/node-resolver-csxbt","openshift-image-registry/node-ca-rq2xf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal","openshift-multus/multus-98w86","openshift-multus/multus-additional-cni-plugins-x2zbz","kube-system/global-pull-secret-syncer-8fjjd","kube-system/konnectivity-agent-nclnv","openshift-multus/network-metrics-daemon-bw2r8","openshift-network-diagnostics/network-check-target-k7gfv","openshift-network-operator/iptables-alerter-c9csd"]
Sep 11 19:29:28.119631 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.119608    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.121094 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.121074    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.121437 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.121413    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 19:29:28.122472 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.122452    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.122928 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.122904    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 19:29:28.123052 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.122913    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 19:29:28.123767 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.123744    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-csxbt"
Sep 11 19:29:28.124819 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.124779    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 19:29:28.125004 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.124989    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 19:29:28.125223 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.125206    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c6fd7\""
Sep 11 19:29:28.125480 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.125465    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 19:29:28.125659 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.125646    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 19:29:28.125862 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.125844    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 19:29:28.126072 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.126058    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 19:29:28.127635 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.127614    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:29:28.127717 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.127668    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 19:29:28.127717 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.127678    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rq2xf"
Sep 11 19:29:28.127787 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.127715    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 19:29:28.127787 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.127625    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jz2v5\""
Sep 11 19:29:28.127928 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.127619    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xcv6q\""
Sep 11 19:29:28.128048 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.128030    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.128111 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.128084    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 19:29:28.128166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.128130    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2k7mj\""
Sep 11 19:29:28.128238 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.128214    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 19:29:28.128602 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.128582    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.130769 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.130394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:28.130769 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.130483    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:28.130769 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.130615    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tqhgm\""
Sep 11 19:29:28.130769 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.130621    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 19:29:28.130999 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.130795    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 19:29:28.131874 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.131857    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:28.132025 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.132005    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 19:29:28.132133 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.132110    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 19:29:28.132293 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.132273    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 19:29:28.132381 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.132362    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 19:29:28.132877 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.132857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-sys-fs\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.132945 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.132891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-systemd\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.132945 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.132910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-run\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.132945 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.132929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-lib-modules\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.133069 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.132954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-tuned\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.133069 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.132986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-kubelet\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133069 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-systemd-units\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133069 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133056    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 19:29:28.133185 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133068    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 19:29:28.133185 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-run-openvswitch\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133185 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-log-socket\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133185 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133145    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-socket-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.133185 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133170    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.133412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnxb7\" (UniqueName: \"kubernetes.io/projected/f838d212-77ab-4428-b27e-2d72ddbd63c4-kube-api-access-hnxb7\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.133412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-sysctl-conf\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.133412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/516c2152-fe97-4f48-8912-050cf47d6b47-ovnkube-config\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/516c2152-fe97-4f48-8912-050cf47d6b47-ovnkube-script-lib\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133309    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-sysconfig\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.133412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/516c2152-fe97-4f48-8912-050cf47d6b47-env-overrides\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2lrn\" (UniqueName: \"kubernetes.io/projected/516c2152-fe97-4f48-8912-050cf47d6b47-kube-api-access-d2lrn\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.133773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133431    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-sys\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.133773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133433    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 19:29:28.133773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-run-netns\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133514    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vnpcr\""
Sep 11 19:29:28.133773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133617    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dvpst\""
Sep 11 19:29:28.133773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-run-ovn\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-node-log\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-run-ovn-kubernetes\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133724    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/516c2152-fe97-4f48-8912-050cf47d6b47-ovn-node-metrics-cert\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.133773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-registration-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-var-lib-openvswitch\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133840    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-modprobe-d\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-kubernetes\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-host\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljlhn\" (UniqueName: \"kubernetes.io/projected/42c5059c-e6d3-460a-817e-fc3c139c3f94-kube-api-access-ljlhn\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-cni-netd\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-sysctl-d\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.133989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-var-lib-kubelet\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.134013    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-slash\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.134038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-cni-bin\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.134057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.134072    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42c5059c-e6d3-460a-817e-fc3c139c3f94-tmp\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.134088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-device-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.134103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-run-systemd\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.134310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.134118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-etc-openvswitch\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.134923 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.134383    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:28.134923 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.134464    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:28.135062 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.135043    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 19:29:28.135135 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.135100    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rk6ll\""
Sep 11 19:29:28.135395 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.135368    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 19:29:28.135484 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.135433    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 19:29:28.135835 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.135789    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:28.135932 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.135879    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:28.137486 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.137462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c9csd"
Sep 11 19:29:28.140567 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.140350    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:29:28.140660 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.140634    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rjgk5\""
Sep 11 19:29:28.140897 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.140874    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 19:29:28.141019 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.140880    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 19:29:28.159009 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.158983    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5w2v5"
Sep 11 19:29:28.167696 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.167673    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5w2v5"
Sep 11 19:29:28.223419 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.223389    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 19:29:28.234877 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.234841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2lrn\" (UniqueName: \"kubernetes.io/projected/516c2152-fe97-4f48-8912-050cf47d6b47-kube-api-access-d2lrn\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.235022 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.234883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-sys\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.235022 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.234917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc-host\") pod \"node-ca-rq2xf\" (UID: \"2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc\") " pod="openshift-image-registry/node-ca-rq2xf"
Sep 11 19:29:28.235022 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.234945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-var-lib-cni-bin\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.235022 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.234971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-var-lib-kubelet\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.235022 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.234996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnwx8\" (UniqueName: \"kubernetes.io/projected/ebf7726b-4997-49d9-8caf-0f2996bef34b-kube-api-access-qnwx8\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.235248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-run-netns\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.235248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-run-ovn\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.235248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-node-log\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.235248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235101    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-run-ovn-kubernetes\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.235248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-registration-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.235248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljlhn\" (UniqueName: \"kubernetes.io/projected/42c5059c-e6d3-460a-817e-fc3c139c3f94-kube-api-access-ljlhn\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.235248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:28.235248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-sys\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-run-ovn\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-kubernetes\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-node-log\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235383    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-run-netns\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235420    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-run-ovn-kubernetes\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-kubernetes\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-host\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-cnibin\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-var-lib-kubelet\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-hostroot\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-run-netns\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce38776a-dcda-4329-a228-ea8834cdb008-agent-certs\") pod \"konnectivity-agent-nclnv\" (UID: \"ce38776a-dcda-4329-a228-ea8834cdb008\") " pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:28.235582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/456845ab-9551-431f-8431-d833f553beef-kubelet-config\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-systemd\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-run\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-lib-modules\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-tuned\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-registration-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-etc-kubernetes\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-var-lib-kubelet\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebf7726b-4997-49d9-8caf-0f2996bef34b-cnibin\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235785    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-run\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x58w\" (UniqueName: \"kubernetes.io/projected/93756891-d848-4ebb-86d8-6d34bf25abae-kube-api-access-4x58w\") pod \"iptables-alerter-c9csd\" (UID: \"93756891-d848-4ebb-86d8-6d34bf25abae\") " pod="openshift-network-operator/iptables-alerter-c9csd"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-run-openvswitch\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-lib-modules\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-sysctl-conf\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebf7726b-4997-49d9-8caf-0f2996bef34b-cni-binary-copy\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.235983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebf7726b-4997-49d9-8caf-0f2996bef34b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebf7726b-4997-49d9-8caf-0f2996bef34b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.236119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebf7726b-4997-49d9-8caf-0f2996bef34b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/516c2152-fe97-4f48-8912-050cf47d6b47-ovnkube-config\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5872393d-579f-412d-8edc-bfb8b84c2492-tmp-dir\") pod \"node-resolver-csxbt\" (UID: \"5872393d-579f-412d-8edc-bfb8b84c2492\") " pod="openshift-dns/node-resolver-csxbt"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-run-multus-certs\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/516c2152-fe97-4f48-8912-050cf47d6b47-env-overrides\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-var-lib-cni-multus\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236303    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-conf-dir\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-systemd\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nlfr\" (UniqueName: \"kubernetes.io/projected/b0c17656-4b24-4f0a-b0a9-10276727ab3b-kube-api-access-5nlfr\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236357    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-host\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-run-openvswitch\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.236773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236589    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 19:29:28.237272 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.236939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/516c2152-fe97-4f48-8912-050cf47d6b47-env-overrides\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.237272 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/516c2152-fe97-4f48-8912-050cf47d6b47-ovnkube-config\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.237272 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/516c2152-fe97-4f48-8912-050cf47d6b47-ovn-node-metrics-cert\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.237272 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-sysctl-conf\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.237272 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.237272 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-cni-dir\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.237272 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvd2h\" (UniqueName: \"kubernetes.io/projected/d3883618-051d-4804-aa8d-222af6c1e9f7-kube-api-access-lvd2h\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:28.237608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebf7726b-4997-49d9-8caf-0f2996bef34b-system-cni-dir\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.237608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/456845ab-9551-431f-8431-d833f553beef-dbus\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:28.237608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mn48\" (UniqueName: \"kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48\") pod \"network-check-target-k7gfv\" (UID: \"0caa7ad4-06df-4431-80e7-b714ba485085\") " pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:28.237608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-var-lib-openvswitch\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.237608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237435    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-var-lib-openvswitch\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.237608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-modprobe-d\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.237608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snkvl\" (UniqueName: \"kubernetes.io/projected/5872393d-579f-412d-8edc-bfb8b84c2492-kube-api-access-snkvl\") pod \"node-resolver-csxbt\" (UID: \"5872393d-579f-412d-8edc-bfb8b84c2492\") " pod="openshift-dns/node-resolver-csxbt"
Sep 11 19:29:28.237608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237570    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-system-cni-dir\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93756891-d848-4ebb-86d8-6d34bf25abae-host-slash\") pod \"iptables-alerter-c9csd\" (UID: \"93756891-d848-4ebb-86d8-6d34bf25abae\") " pod="openshift-network-operator/iptables-alerter-c9csd"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-cni-netd\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-sysctl-d\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0c17656-4b24-4f0a-b0a9-10276727ab3b-cni-binary-copy\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce38776a-dcda-4329-a228-ea8834cdb008-konnectivity-ca\") pod \"konnectivity-agent-nclnv\" (UID: \"ce38776a-dcda-4329-a228-ea8834cdb008\") " pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93756891-d848-4ebb-86d8-6d34bf25abae-iptables-alerter-script\") pod \"iptables-alerter-c9csd\" (UID: \"93756891-d848-4ebb-86d8-6d34bf25abae\") " pod="openshift-network-operator/iptables-alerter-c9csd"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-slash\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-cni-bin\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42c5059c-e6d3-460a-817e-fc3c139c3f94-tmp\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.237964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-device-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.238010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-run-systemd\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-etc-openvswitch\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-sys-fs\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238137    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-sysctl-d\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-modprobe-d\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238406    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-run-systemd\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238412    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-device-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-etc-openvswitch\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-sys-fs\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-slash\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-cni-netd\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.238628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238582    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-cni-bin\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-kubelet\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-systemd-units\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-host-kubelet\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-log-socket\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-systemd-units\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-socket-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238852    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/516c2152-fe97-4f48-8912-050cf47d6b47-log-socket\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnxb7\" (UniqueName: \"kubernetes.io/projected/f838d212-77ab-4428-b27e-2d72ddbd63c4-kube-api-access-hnxb7\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238956    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc-serviceca\") pod \"node-ca-rq2xf\" (UID: \"2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc\") " pod="openshift-image-registry/node-ca-rq2xf"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.238976    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f838d212-77ab-4428-b27e-2d72ddbd63c4-socket-dir\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.239010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjgkx\" (UniqueName: \"kubernetes.io/projected/2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc-kube-api-access-jjgkx\") pod \"node-ca-rq2xf\" (UID: \"2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc\") " pod="openshift-image-registry/node-ca-rq2xf"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.239049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-run-k8s-cni-cncf-io\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.239094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/516c2152-fe97-4f48-8912-050cf47d6b47-ovnkube-script-lib\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.239171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-sysconfig\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.239259 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.239197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5872393d-579f-412d-8edc-bfb8b84c2492-hosts-file\") pod \"node-resolver-csxbt\" (UID: \"5872393d-579f-412d-8edc-bfb8b84c2492\") " pod="openshift-dns/node-resolver-csxbt"
Sep 11 19:29:28.240059 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.239304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-socket-dir-parent\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.240059 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.239331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-sysconfig\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.240059 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.239384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-daemon-config\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.240059 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.239743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/516c2152-fe97-4f48-8912-050cf47d6b47-ovnkube-script-lib\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.240986 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.240954    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42c5059c-e6d3-460a-817e-fc3c139c3f94-etc-tuned\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.241171 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.241076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/516c2152-fe97-4f48-8912-050cf47d6b47-ovn-node-metrics-cert\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.241276 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.241146    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42c5059c-e6d3-460a-817e-fc3c139c3f94-tmp\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.244305 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.244283    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2lrn\" (UniqueName: \"kubernetes.io/projected/516c2152-fe97-4f48-8912-050cf47d6b47-kube-api-access-d2lrn\") pod \"ovnkube-node-qnhl6\" (UID: \"516c2152-fe97-4f48-8912-050cf47d6b47\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.248490 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.248467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljlhn\" (UniqueName: \"kubernetes.io/projected/42c5059c-e6d3-460a-817e-fc3c139c3f94-kube-api-access-ljlhn\") pod \"tuned-tvnkk\" (UID: \"42c5059c-e6d3-460a-817e-fc3c139c3f94\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.255099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.255074    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnxb7\" (UniqueName: \"kubernetes.io/projected/f838d212-77ab-4428-b27e-2d72ddbd63c4-kube-api-access-hnxb7\") pod \"aws-ebs-csi-driver-node-q9jpt\" (UID: \"f838d212-77ab-4428-b27e-2d72ddbd63c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.340054 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.339965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-var-lib-cni-multus\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.340054 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-conf-dir\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.340054 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nlfr\" (UniqueName: \"kubernetes.io/projected/b0c17656-4b24-4f0a-b0a9-10276727ab3b-kube-api-access-5nlfr\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-cni-dir\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvd2h\" (UniqueName: \"kubernetes.io/projected/d3883618-051d-4804-aa8d-222af6c1e9f7-kube-api-access-lvd2h\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340092    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-conf-dir\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebf7726b-4997-49d9-8caf-0f2996bef34b-system-cni-dir\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/456845ab-9551-431f-8431-d833f553beef-dbus\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340092    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-var-lib-cni-multus\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mn48\" (UniqueName: \"kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48\") pod \"network-check-target-k7gfv\" (UID: \"0caa7ad4-06df-4431-80e7-b714ba485085\") " pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snkvl\" (UniqueName: \"kubernetes.io/projected/5872393d-579f-412d-8edc-bfb8b84c2492-kube-api-access-snkvl\") pod \"node-resolver-csxbt\" (UID: \"5872393d-579f-412d-8edc-bfb8b84c2492\") " pod="openshift-dns/node-resolver-csxbt"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340207    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebf7726b-4997-49d9-8caf-0f2996bef34b-system-cni-dir\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-system-cni-dir\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93756891-d848-4ebb-86d8-6d34bf25abae-host-slash\") pod \"iptables-alerter-c9csd\" (UID: \"93756891-d848-4ebb-86d8-6d34bf25abae\") " pod="openshift-network-operator/iptables-alerter-c9csd"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/456845ab-9551-431f-8431-d833f553beef-dbus\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-cni-dir\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0c17656-4b24-4f0a-b0a9-10276727ab3b-cni-binary-copy\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce38776a-dcda-4329-a228-ea8834cdb008-konnectivity-ca\") pod \"konnectivity-agent-nclnv\" (UID: \"ce38776a-dcda-4329-a228-ea8834cdb008\") " pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:28.340385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93756891-d848-4ebb-86d8-6d34bf25abae-iptables-alerter-script\") pod \"iptables-alerter-c9csd\" (UID: \"93756891-d848-4ebb-86d8-6d34bf25abae\") " pod="openshift-network-operator/iptables-alerter-c9csd"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc-serviceca\") pod \"node-ca-rq2xf\" (UID: \"2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc\") " pod="openshift-image-registry/node-ca-rq2xf"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjgkx\" (UniqueName: \"kubernetes.io/projected/2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc-kube-api-access-jjgkx\") pod \"node-ca-rq2xf\" (UID: \"2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc\") " pod="openshift-image-registry/node-ca-rq2xf"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-run-k8s-cni-cncf-io\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5872393d-579f-412d-8edc-bfb8b84c2492-hosts-file\") pod \"node-resolver-csxbt\" (UID: \"5872393d-579f-412d-8edc-bfb8b84c2492\") " pod="openshift-dns/node-resolver-csxbt"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-socket-dir-parent\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-daemon-config\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc-host\") pod \"node-ca-rq2xf\" (UID: \"2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc\") " pod="openshift-image-registry/node-ca-rq2xf"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-var-lib-cni-bin\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-var-lib-kubelet\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnwx8\" (UniqueName: \"kubernetes.io/projected/ebf7726b-4997-49d9-8caf-0f2996bef34b-kube-api-access-qnwx8\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-cnibin\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340763    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-hostroot\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340767    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-run-k8s-cni-cncf-io\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-run-netns\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce38776a-dcda-4329-a228-ea8834cdb008-agent-certs\") pod \"konnectivity-agent-nclnv\" (UID: \"ce38776a-dcda-4329-a228-ea8834cdb008\") " pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:28.341166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/456845ab-9551-431f-8431-d833f553beef-kubelet-config\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-etc-kubernetes\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebf7726b-4997-49d9-8caf-0f2996bef34b-cnibin\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x58w\" (UniqueName: \"kubernetes.io/projected/93756891-d848-4ebb-86d8-6d34bf25abae-kube-api-access-4x58w\") pod \"iptables-alerter-c9csd\" (UID: \"93756891-d848-4ebb-86d8-6d34bf25abae\") " pod="openshift-network-operator/iptables-alerter-c9csd"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebf7726b-4997-49d9-8caf-0f2996bef34b-cni-binary-copy\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebf7726b-4997-49d9-8caf-0f2996bef34b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebf7726b-4997-49d9-8caf-0f2996bef34b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebf7726b-4997-49d9-8caf-0f2996bef34b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0c17656-4b24-4f0a-b0a9-10276727ab3b-cni-binary-copy\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5872393d-579f-412d-8edc-bfb8b84c2492-tmp-dir\") pod \"node-resolver-csxbt\" (UID: \"5872393d-579f-412d-8edc-bfb8b84c2492\") " pod="openshift-dns/node-resolver-csxbt"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-run-multus-certs\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce38776a-dcda-4329-a228-ea8834cdb008-konnectivity-ca\") pod \"konnectivity-agent-nclnv\" (UID: \"ce38776a-dcda-4329-a228-ea8834cdb008\") " pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.340988    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-hostroot\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-system-cni-dir\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93756891-d848-4ebb-86d8-6d34bf25abae-host-slash\") pod \"iptables-alerter-c9csd\" (UID: \"93756891-d848-4ebb-86d8-6d34bf25abae\") " pod="openshift-network-operator/iptables-alerter-c9csd"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-run-netns\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-cnibin\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.341095    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:28.342084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-run-multus-certs\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341146    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-etc-kubernetes\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.341197    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret podName:456845ab-9551-431f-8431-d833f553beef nodeName:}" failed. No retries permitted until 2026-09-11 19:29:28.841148306 +0000 UTC m=+3.075221738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret") pod "global-pull-secret-syncer-8fjjd" (UID: "456845ab-9551-431f-8431-d833f553beef") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341214    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/456845ab-9551-431f-8431-d833f553beef-kubelet-config\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5872393d-579f-412d-8edc-bfb8b84c2492-hosts-file\") pod \"node-resolver-csxbt\" (UID: \"5872393d-579f-412d-8edc-bfb8b84c2492\") " pod="openshift-dns/node-resolver-csxbt"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93756891-d848-4ebb-86d8-6d34bf25abae-iptables-alerter-script\") pod \"iptables-alerter-c9csd\" (UID: \"93756891-d848-4ebb-86d8-6d34bf25abae\") " pod="openshift-network-operator/iptables-alerter-c9csd"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-socket-dir-parent\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5872393d-579f-412d-8edc-bfb8b84c2492-tmp-dir\") pod \"node-resolver-csxbt\" (UID: \"5872393d-579f-412d-8edc-bfb8b84c2492\") " pod="openshift-dns/node-resolver-csxbt"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc-host\") pod \"node-ca-rq2xf\" (UID: \"2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc\") " pod="openshift-image-registry/node-ca-rq2xf"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341731    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-var-lib-cni-bin\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ebf7726b-4997-49d9-8caf-0f2996bef34b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebf7726b-4997-49d9-8caf-0f2996bef34b-cnibin\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c17656-4b24-4f0a-b0a9-10276727ab3b-host-var-lib-kubelet\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc-serviceca\") pod \"node-ca-rq2xf\" (UID: \"2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc\") " pod="openshift-image-registry/node-ca-rq2xf"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.341930    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.341954    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebf7726b-4997-49d9-8caf-0f2996bef34b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.342933 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.342001    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs podName:d3883618-051d-4804-aa8d-222af6c1e9f7 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:28.84198316 +0000 UTC m=+3.076056562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs") pod "network-metrics-daemon-bw2r8" (UID: "d3883618-051d-4804-aa8d-222af6c1e9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:28.343635 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.342086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0c17656-4b24-4f0a-b0a9-10276727ab3b-multus-daemon-config\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.343635 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.342251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ebf7726b-4997-49d9-8caf-0f2996bef34b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.343635 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.342386    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebf7726b-4997-49d9-8caf-0f2996bef34b-cni-binary-copy\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.344299 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.344251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce38776a-dcda-4329-a228-ea8834cdb008-agent-certs\") pod \"konnectivity-agent-nclnv\" (UID: \"ce38776a-dcda-4329-a228-ea8834cdb008\") " pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:28.348871 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.348851    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:29:28.348963 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.348874    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:29:28.348963 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.348890    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7mn48 for pod openshift-network-diagnostics/network-check-target-k7gfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:28.349051 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.348969    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48 podName:0caa7ad4-06df-4431-80e7-b714ba485085 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:28.84895189 +0000 UTC m=+3.083025305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7mn48" (UniqueName: "kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48") pod "network-check-target-k7gfv" (UID: "0caa7ad4-06df-4431-80e7-b714ba485085") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:28.352422 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.352398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvd2h\" (UniqueName: \"kubernetes.io/projected/d3883618-051d-4804-aa8d-222af6c1e9f7-kube-api-access-lvd2h\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:28.352520 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.352429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nlfr\" (UniqueName: \"kubernetes.io/projected/b0c17656-4b24-4f0a-b0a9-10276727ab3b-kube-api-access-5nlfr\") pod \"multus-98w86\" (UID: \"b0c17656-4b24-4f0a-b0a9-10276727ab3b\") " pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.352904 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.352879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnwx8\" (UniqueName: \"kubernetes.io/projected/ebf7726b-4997-49d9-8caf-0f2996bef34b-kube-api-access-qnwx8\") pod \"multus-additional-cni-plugins-x2zbz\" (UID: \"ebf7726b-4997-49d9-8caf-0f2996bef34b\") " pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.352971 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.352908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjgkx\" (UniqueName: \"kubernetes.io/projected/2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc-kube-api-access-jjgkx\") pod \"node-ca-rq2xf\" (UID: \"2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc\") " pod="openshift-image-registry/node-ca-rq2xf"
Sep 11 19:29:28.353053 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.353032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snkvl\" (UniqueName: \"kubernetes.io/projected/5872393d-579f-412d-8edc-bfb8b84c2492-kube-api-access-snkvl\") pod \"node-resolver-csxbt\" (UID: \"5872393d-579f-412d-8edc-bfb8b84c2492\") " pod="openshift-dns/node-resolver-csxbt"
Sep 11 19:29:28.354200 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.354175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x58w\" (UniqueName: \"kubernetes.io/projected/93756891-d848-4ebb-86d8-6d34bf25abae-kube-api-access-4x58w\") pod \"iptables-alerter-c9csd\" (UID: \"93756891-d848-4ebb-86d8-6d34bf25abae\") " pod="openshift-network-operator/iptables-alerter-c9csd"
Sep 11 19:29:28.434266 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.434227    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:28.441420 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.441397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt"
Sep 11 19:29:28.452768 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.452746    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tvnkk"
Sep 11 19:29:28.456176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.456155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-csxbt"
Sep 11 19:29:28.463011 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.462995    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rq2xf"
Sep 11 19:29:28.471125 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.471105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x2zbz"
Sep 11 19:29:28.477303 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.477283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-98w86"
Sep 11 19:29:28.484947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.484915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:28.490664 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.490648    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c9csd"
Sep 11 19:29:28.845667 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.845626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:28.845844 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.845693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:28.845844 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.845806    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:28.845844 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.845808    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:28.846019 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.845881    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs podName:d3883618-051d-4804-aa8d-222af6c1e9f7 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:29.845863335 +0000 UTC m=+4.079936736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs") pod "network-metrics-daemon-bw2r8" (UID: "d3883618-051d-4804-aa8d-222af6c1e9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:28.846019 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.845900    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret podName:456845ab-9551-431f-8431-d833f553beef nodeName:}" failed. No retries permitted until 2026-09-11 19:29:29.845892254 +0000 UTC m=+4.079965657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret") pod "global-pull-secret-syncer-8fjjd" (UID: "456845ab-9551-431f-8431-d833f553beef") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:28.946710 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:28.946669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mn48\" (UniqueName: \"kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48\") pod \"network-check-target-k7gfv\" (UID: \"0caa7ad4-06df-4431-80e7-b714ba485085\") " pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:28.946891 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.946875    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:29:28.946956 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.946898    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:29:28.946956 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.946909    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7mn48 for pod openshift-network-diagnostics/network-check-target-k7gfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:28.947034 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:28.946981    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48 podName:0caa7ad4-06df-4431-80e7-b714ba485085 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:29.946963664 +0000 UTC m=+4.181037089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mn48" (UniqueName: "kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48") pod "network-check-target-k7gfv" (UID: "0caa7ad4-06df-4431-80e7-b714ba485085") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:29.087860 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:29.087832    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93756891_d848_4ebb_86d8_6d34bf25abae.slice/crio-3bdc208c56f58dba7c3a2d7459ff3e08cbdcdf85131a498af4ae36c1c41f3adf WatchSource:0}: Error finding container 3bdc208c56f58dba7c3a2d7459ff3e08cbdcdf85131a498af4ae36c1c41f3adf: Status 404 returned error can't find the container with id 3bdc208c56f58dba7c3a2d7459ff3e08cbdcdf85131a498af4ae36c1c41f3adf
Sep 11 19:29:29.089461 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:29.089423    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c17656_4b24_4f0a_b0a9_10276727ab3b.slice/crio-b5b6ff3ac8b6e9568cee633d834956033d022bd87017419c680aef97f7f17ff7 WatchSource:0}: Error finding container b5b6ff3ac8b6e9568cee633d834956033d022bd87017419c680aef97f7f17ff7: Status 404 returned error can't find the container with id b5b6ff3ac8b6e9568cee633d834956033d022bd87017419c680aef97f7f17ff7
Sep 11 19:29:29.090215 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:29.090192    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce38776a_dcda_4329_a228_ea8834cdb008.slice/crio-bd18c23e19bcee4ea06b518ed2b28c15b77facecebb35242e26c66c2c9a36f7c WatchSource:0}: Error finding container bd18c23e19bcee4ea06b518ed2b28c15b77facecebb35242e26c66c2c9a36f7c: Status 404 returned error can't find the container with id bd18c23e19bcee4ea06b518ed2b28c15b77facecebb35242e26c66c2c9a36f7c
Sep 11 19:29:29.093104 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:29.092472    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd6a92e_3d43_4c3b_bbc6_fb145c5adfcc.slice/crio-380f4e90790a5703345b27ef898a242f8438a15d99885118dee6980b99746c60 WatchSource:0}: Error finding container 380f4e90790a5703345b27ef898a242f8438a15d99885118dee6980b99746c60: Status 404 returned error can't find the container with id 380f4e90790a5703345b27ef898a242f8438a15d99885118dee6980b99746c60
Sep 11 19:29:29.097929 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:29.097901    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5872393d_579f_412d_8edc_bfb8b84c2492.slice/crio-95e01fdc3ddf3d02f96dfb05b649c7e741783276472f1c425aeb9c2f805e895a WatchSource:0}: Error finding container 95e01fdc3ddf3d02f96dfb05b649c7e741783276472f1c425aeb9c2f805e895a: Status 404 returned error can't find the container with id 95e01fdc3ddf3d02f96dfb05b649c7e741783276472f1c425aeb9c2f805e895a
Sep 11 19:29:29.098532 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:29.098387    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516c2152_fe97_4f48_8912_050cf47d6b47.slice/crio-ce7c36125ffc4b222b9cf54f7cc5239f98e175d83e88d793103d69ec3aae0580 WatchSource:0}: Error finding container ce7c36125ffc4b222b9cf54f7cc5239f98e175d83e88d793103d69ec3aae0580: Status 404 returned error can't find the container with id ce7c36125ffc4b222b9cf54f7cc5239f98e175d83e88d793103d69ec3aae0580
Sep 11 19:29:29.100366 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:29.100207    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf838d212_77ab_4428_b27e_2d72ddbd63c4.slice/crio-702ed814ed258d53ec0c36830b3a7d72c9ad164194c0c03afc0154ea64ff49e5 WatchSource:0}: Error finding container 702ed814ed258d53ec0c36830b3a7d72c9ad164194c0c03afc0154ea64ff49e5: Status 404 returned error can't find the container with id 702ed814ed258d53ec0c36830b3a7d72c9ad164194c0c03afc0154ea64ff49e5
Sep 11 19:29:29.105250 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:29:29.102379    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf7726b_4997_49d9_8caf_0f2996bef34b.slice/crio-8efe33860dca32f78dde3a1a8e744e3f44a3349e080860e45d9b0811bdca6a28 WatchSource:0}: Error finding container 8efe33860dca32f78dde3a1a8e744e3f44a3349e080860e45d9b0811bdca6a28: Status 404 returned error can't find the container with id 8efe33860dca32f78dde3a1a8e744e3f44a3349e080860e45d9b0811bdca6a28
Sep 11 19:29:29.171435 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.171405    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 19:24:28 +0000 UTC" deadline="2028-05-19 04:22:39.557034282 +0000 UTC"
Sep 11 19:29:29.171435 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.171436    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14768h53m10.385602882s"
Sep 11 19:29:29.261000 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.260948    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6" event={"ID":"516c2152-fe97-4f48-8912-050cf47d6b47","Type":"ContainerStarted","Data":"ce7c36125ffc4b222b9cf54f7cc5239f98e175d83e88d793103d69ec3aae0580"}
Sep 11 19:29:29.263448 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.263420    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tvnkk" event={"ID":"42c5059c-e6d3-460a-817e-fc3c139c3f94","Type":"ContainerStarted","Data":"ae00067d0d6bf0030b7fcf04eb1d2aed8a95ae6906b3d0b8fad50995bd19ec24"}
Sep 11 19:29:29.264930 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.264906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c9csd" event={"ID":"93756891-d848-4ebb-86d8-6d34bf25abae","Type":"ContainerStarted","Data":"3bdc208c56f58dba7c3a2d7459ff3e08cbdcdf85131a498af4ae36c1c41f3adf"}
Sep 11 19:29:29.271123 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.270542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-38.ec2.internal" event={"ID":"9a4e57d2e889ae916c1f1beebb193bc0","Type":"ContainerStarted","Data":"ecb028b5826ecffc5df5f5a963063f3348cf678870af507b3c1fbfe352da9f19"}
Sep 11 19:29:29.273225 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.273200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zbz" event={"ID":"ebf7726b-4997-49d9-8caf-0f2996bef34b","Type":"ContainerStarted","Data":"8efe33860dca32f78dde3a1a8e744e3f44a3349e080860e45d9b0811bdca6a28"}
Sep 11 19:29:29.275403 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.275379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt" event={"ID":"f838d212-77ab-4428-b27e-2d72ddbd63c4","Type":"ContainerStarted","Data":"702ed814ed258d53ec0c36830b3a7d72c9ad164194c0c03afc0154ea64ff49e5"}
Sep 11 19:29:29.276732 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.276692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rq2xf" event={"ID":"2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc","Type":"ContainerStarted","Data":"380f4e90790a5703345b27ef898a242f8438a15d99885118dee6980b99746c60"}
Sep 11 19:29:29.278887 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.278867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nclnv" event={"ID":"ce38776a-dcda-4329-a228-ea8834cdb008","Type":"ContainerStarted","Data":"bd18c23e19bcee4ea06b518ed2b28c15b77facecebb35242e26c66c2c9a36f7c"}
Sep 11 19:29:29.280024 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.279988    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-98w86" event={"ID":"b0c17656-4b24-4f0a-b0a9-10276727ab3b","Type":"ContainerStarted","Data":"b5b6ff3ac8b6e9568cee633d834956033d022bd87017419c680aef97f7f17ff7"}
Sep 11 19:29:29.281611 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.281585    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-csxbt" event={"ID":"5872393d-579f-412d-8edc-bfb8b84c2492","Type":"ContainerStarted","Data":"95e01fdc3ddf3d02f96dfb05b649c7e741783276472f1c425aeb9c2f805e895a"}
Sep 11 19:29:29.288847 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.288806    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-38.ec2.internal" podStartSLOduration=2.288793928 podStartE2EDuration="2.288793928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:29.288675129 +0000 UTC m=+3.522748555" watchObservedRunningTime="2026-09-11 19:29:29.288793928 +0000 UTC m=+3.522867353"
Sep 11 19:29:29.853468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.853426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:29.853665 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.853531    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:29.853812 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:29.853661    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:29.853812 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:29.853728    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs podName:d3883618-051d-4804-aa8d-222af6c1e9f7 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:31.853708176 +0000 UTC m=+6.087781594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs") pod "network-metrics-daemon-bw2r8" (UID: "d3883618-051d-4804-aa8d-222af6c1e9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:29.854285 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:29.854265    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:29.854405 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:29.854314    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret podName:456845ab-9551-431f-8431-d833f553beef nodeName:}" failed. No retries permitted until 2026-09-11 19:29:31.854303087 +0000 UTC m=+6.088376488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret") pod "global-pull-secret-syncer-8fjjd" (UID: "456845ab-9551-431f-8431-d833f553beef") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:29.954175 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:29.954134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mn48\" (UniqueName: \"kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48\") pod \"network-check-target-k7gfv\" (UID: \"0caa7ad4-06df-4431-80e7-b714ba485085\") " pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:29.954385 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:29.954368    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:29:29.954452 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:29.954395    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:29:29.954452 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:29.954409    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7mn48 for pod openshift-network-diagnostics/network-check-target-k7gfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:29.954571 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:29.954475    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48 podName:0caa7ad4-06df-4431-80e7-b714ba485085 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:31.954454995 +0000 UTC m=+6.188528397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mn48" (UniqueName: "kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48") pod "network-check-target-k7gfv" (UID: "0caa7ad4-06df-4431-80e7-b714ba485085") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:30.172082 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:30.171962    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 19:24:28 +0000 UTC" deadline="2028-06-01 15:30:52.989303012 +0000 UTC"
Sep 11 19:29:30.172082 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:30.172030    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15092h1m22.817276838s"
Sep 11 19:29:30.252510 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:30.252476    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:30.252510 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:30.252504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:30.252753 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:30.252617    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:30.253183 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:30.253153    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:30.253312 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:30.253232    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:30.253378 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:30.253317    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:30.306043 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:30.306003    2578 generic.go:356] "Generic (PLEG): container finished" podID="0e1a1e012679bf6f37bb576f37cb5f1b" containerID="152672ff3f12f5bc31a911457b8da2330ae3ac5ba00f24032976bd06969e27c6" exitCode=0
Sep 11 19:29:30.306237 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:30.306138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal" event={"ID":"0e1a1e012679bf6f37bb576f37cb5f1b","Type":"ContainerDied","Data":"152672ff3f12f5bc31a911457b8da2330ae3ac5ba00f24032976bd06969e27c6"}
Sep 11 19:29:31.325286 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:31.325083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal" event={"ID":"0e1a1e012679bf6f37bb576f37cb5f1b","Type":"ContainerStarted","Data":"ea2763952691ddf7a50808ae8886f30cc3fde65a5a4463a38fbbac5caed517f1"}
Sep 11 19:29:31.870730 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:31.870688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:31.870915 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:31.870761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:31.870997 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:31.870936    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:31.871109 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:31.871006    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret podName:456845ab-9551-431f-8431-d833f553beef nodeName:}" failed. No retries permitted until 2026-09-11 19:29:35.870985557 +0000 UTC m=+10.105058963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret") pod "global-pull-secret-syncer-8fjjd" (UID: "456845ab-9551-431f-8431-d833f553beef") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:31.871109 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:31.871087    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:31.871303 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:31.871115    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs podName:d3883618-051d-4804-aa8d-222af6c1e9f7 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:35.871107549 +0000 UTC m=+10.105180952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs") pod "network-metrics-daemon-bw2r8" (UID: "d3883618-051d-4804-aa8d-222af6c1e9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:31.971449 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:31.971412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mn48\" (UniqueName: \"kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48\") pod \"network-check-target-k7gfv\" (UID: \"0caa7ad4-06df-4431-80e7-b714ba485085\") " pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:31.971733 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:31.971649    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:29:31.971733 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:31.971671    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:29:31.971733 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:31.971684    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7mn48 for pod openshift-network-diagnostics/network-check-target-k7gfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:31.971923 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:31.971758    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48 podName:0caa7ad4-06df-4431-80e7-b714ba485085 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:35.971728146 +0000 UTC m=+10.205801560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mn48" (UniqueName: "kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48") pod "network-check-target-k7gfv" (UID: "0caa7ad4-06df-4431-80e7-b714ba485085") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:32.251537 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:32.251414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:32.251720 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:32.251564    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:32.252039 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:32.252020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:32.252162 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:32.252140    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:32.252221 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:32.252199    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:32.252277 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:32.252266    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:34.252216 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:34.251448    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:34.252216 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:34.251603    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:34.252216 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:34.252071    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:34.252216 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:34.252170    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:34.252862 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:34.252331    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:34.252862 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:34.252454    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:35.908227 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:35.908183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:35.908693 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:35.908255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:35.908693 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:35.908404    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:35.908693 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:35.908462    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret podName:456845ab-9551-431f-8431-d833f553beef nodeName:}" failed. No retries permitted until 2026-09-11 19:29:43.908443259 +0000 UTC m=+18.142516659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret") pod "global-pull-secret-syncer-8fjjd" (UID: "456845ab-9551-431f-8431-d833f553beef") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:35.908830 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:35.908796    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:35.908863 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:35.908839    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs podName:d3883618-051d-4804-aa8d-222af6c1e9f7 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:43.908827992 +0000 UTC m=+18.142901395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs") pod "network-metrics-daemon-bw2r8" (UID: "d3883618-051d-4804-aa8d-222af6c1e9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:36.009216 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:36.008652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mn48\" (UniqueName: \"kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48\") pod \"network-check-target-k7gfv\" (UID: \"0caa7ad4-06df-4431-80e7-b714ba485085\") " pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:36.009216 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:36.008794    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:29:36.009216 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:36.008814    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:29:36.009216 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:36.008823    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7mn48 for pod openshift-network-diagnostics/network-check-target-k7gfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:36.009216 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:36.008874    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48 podName:0caa7ad4-06df-4431-80e7-b714ba485085 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:44.008860211 +0000 UTC m=+18.242933611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mn48" (UniqueName: "kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48") pod "network-check-target-k7gfv" (UID: "0caa7ad4-06df-4431-80e7-b714ba485085") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:36.251056 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:36.250970    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:36.251226 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:36.251119    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:36.251608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:36.251585    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:36.251726 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:36.251696    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:36.251794 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:36.251750    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:36.251846 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:36.251810    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:38.252432 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:38.251931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:38.252432 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:38.252067    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:38.252432 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:38.252103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:38.252432 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:38.252207    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:38.252432 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:38.251938    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:38.252432 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:38.252315    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:40.251144 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:40.250980    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:40.251526 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:40.250995    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:40.251526 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:40.251220    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:40.251526 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:40.251328    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:40.251526 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:40.250995    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:40.251526 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:40.251407    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:42.251189 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:42.251146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:42.251633 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:42.251146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:42.251633 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:42.251317    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:42.251633 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:42.251373    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:42.251633 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:42.251474    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:42.251633 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:42.251556    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:43.970505 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:43.970472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:43.970505 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:43.970515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:43.971069 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:43.970616    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:43.971069 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:43.970635    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:43.971069 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:43.970666    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret podName:456845ab-9551-431f-8431-d833f553beef nodeName:}" failed. No retries permitted until 2026-09-11 19:29:59.97065326 +0000 UTC m=+34.204726658 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret") pod "global-pull-secret-syncer-8fjjd" (UID: "456845ab-9551-431f-8431-d833f553beef") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:43.971069 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:43.970701    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs podName:d3883618-051d-4804-aa8d-222af6c1e9f7 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:59.970681846 +0000 UTC m=+34.204755248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs") pod "network-metrics-daemon-bw2r8" (UID: "d3883618-051d-4804-aa8d-222af6c1e9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:44.071307 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:44.071284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mn48\" (UniqueName: \"kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48\") pod \"network-check-target-k7gfv\" (UID: \"0caa7ad4-06df-4431-80e7-b714ba485085\") " pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:44.071450 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:44.071433    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:29:44.071488 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:44.071457    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:29:44.071488 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:44.071467    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7mn48 for pod openshift-network-diagnostics/network-check-target-k7gfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:44.071547 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:44.071511    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48 podName:0caa7ad4-06df-4431-80e7-b714ba485085 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:00.071497983 +0000 UTC m=+34.305571386 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mn48" (UniqueName: "kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48") pod "network-check-target-k7gfv" (UID: "0caa7ad4-06df-4431-80e7-b714ba485085") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:29:44.251751 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:44.251674    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:44.251912 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:44.251674    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:44.251912 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:44.251818    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:44.251912 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:44.251675    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:44.251912 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:44.251885    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:44.252101 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:44.251931    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:46.252559 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:46.252521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:46.253040 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:46.252643    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:46.253040 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:46.252991    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:46.253133 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:46.253065    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:46.253177 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:46.253155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:46.253314 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:46.253280    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:48.251280 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.251115    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:48.251798 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.251114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:48.251798 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:48.251374    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:48.251798 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.251115    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:48.251798 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:48.251429    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:48.251798 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:48.251511    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:48.375815 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.375787    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-csxbt" event={"ID":"5872393d-579f-412d-8edc-bfb8b84c2492","Type":"ContainerStarted","Data":"56579fb791e9900e81e68b9d6025afdc099ac41d1650ac8d154e7024fb08a5a5"}
Sep 11 19:29:48.378763 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.378734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6" event={"ID":"516c2152-fe97-4f48-8912-050cf47d6b47","Type":"ContainerStarted","Data":"75bc5413ee96a40d91f82579f3b90c6f2b62f3b96ba8fd37eff72279a34a2c4a"}
Sep 11 19:29:48.378854 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.378803    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6" event={"ID":"516c2152-fe97-4f48-8912-050cf47d6b47","Type":"ContainerStarted","Data":"7026c4cff4a3a54e7dea61a7bee7c9f17247d32cf8b02ac04c75925b3196ff73"}
Sep 11 19:29:48.378854 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.378840    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6" event={"ID":"516c2152-fe97-4f48-8912-050cf47d6b47","Type":"ContainerStarted","Data":"6cef97e36c4e40caf39246d6de8e3958815f87c63f6caef7a137979d6c7720c2"}
Sep 11 19:29:48.378970 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.378879    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6" event={"ID":"516c2152-fe97-4f48-8912-050cf47d6b47","Type":"ContainerStarted","Data":"f07c230741a78a7e3c309faa95b67ff1f7b1bede66d33a4af32a442fb460b4a5"}
Sep 11 19:29:48.378970 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.378918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6" event={"ID":"516c2152-fe97-4f48-8912-050cf47d6b47","Type":"ContainerStarted","Data":"536b2572b8408633afc14ad4d05939c91926fa1ed22ca608003e67e49d1f2847"}
Sep 11 19:29:48.380199 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.380176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tvnkk" event={"ID":"42c5059c-e6d3-460a-817e-fc3c139c3f94","Type":"ContainerStarted","Data":"64cb020a82bfe21f698f7085968584c50879d5338d9697724802be88778a08ad"}
Sep 11 19:29:48.381543 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.381525    2578 generic.go:356] "Generic (PLEG): container finished" podID="ebf7726b-4997-49d9-8caf-0f2996bef34b" containerID="48b5f5fdef028c0bf4ecd413f3ec8e75378ec1730a58aa9d8e996c3fb405de30" exitCode=0
Sep 11 19:29:48.381614 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.381583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zbz" event={"ID":"ebf7726b-4997-49d9-8caf-0f2996bef34b","Type":"ContainerDied","Data":"48b5f5fdef028c0bf4ecd413f3ec8e75378ec1730a58aa9d8e996c3fb405de30"}
Sep 11 19:29:48.383158 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.383142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt" event={"ID":"f838d212-77ab-4428-b27e-2d72ddbd63c4","Type":"ContainerStarted","Data":"9bf92329ec34c4caa6e5a14f6cb4a9dcfd2ee0df369278a31bad38dc5545b3e5"}
Sep 11 19:29:48.384713 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.384684    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rq2xf" event={"ID":"2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc","Type":"ContainerStarted","Data":"470b2e5ee0866e7895038e9bcfcdf285f7c2d5f6553a94ff89b19d6d72791522"}
Sep 11 19:29:48.386103 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.386073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nclnv" event={"ID":"ce38776a-dcda-4329-a228-ea8834cdb008","Type":"ContainerStarted","Data":"d0f7e36a082fd856dd666e7a4c6b71127edca24ed959fea69a3c584b1e4ad65c"}
Sep 11 19:29:48.387473 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.387455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-98w86" event={"ID":"b0c17656-4b24-4f0a-b0a9-10276727ab3b","Type":"ContainerStarted","Data":"e4af851be548ee16de3e540803877b9fac75bc22a1422ade762e9927291d7682"}
Sep 11 19:29:48.392869 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.392835    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-csxbt" podStartSLOduration=2.70761239 podStartE2EDuration="21.392822437s" totalImagesPullingTime="18.685210047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:48.392432907 +0000 UTC m=+22.626506353" watchObservedRunningTime="2026-09-11 19:29:48.392822437 +0000 UTC m=+22.626895857"
Sep 11 19:29:48.393001 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.392977    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-38.ec2.internal" podStartSLOduration=21.392969909 podStartE2EDuration="21.392969909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:31.347527055 +0000 UTC m=+5.581600500" watchObservedRunningTime="2026-09-11 19:29:48.392969909 +0000 UTC m=+22.627043355"
Sep 11 19:29:48.408988 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.408939    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tvnkk" podStartSLOduration=2.705384007 podStartE2EDuration="21.408922266s" totalImagesPullingTime="18.703538259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:48.408170251 +0000 UTC m=+22.642243683" watchObservedRunningTime="2026-09-11 19:29:48.408922266 +0000 UTC m=+22.642995687"
Sep 11 19:29:48.426802 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.426736    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-98w86" podStartSLOduration=2.658266904 podStartE2EDuration="21.426715623s" totalImagesPullingTime="18.768448719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:48.426433499 +0000 UTC m=+22.660506922" watchObservedRunningTime="2026-09-11 19:29:48.426715623 +0000 UTC m=+22.660789059"
Sep 11 19:29:48.443596 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.443540    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rq2xf" podStartSLOduration=2.7613751840000003 podStartE2EDuration="21.443519232s" totalImagesPullingTime="18.682144048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:48.443302955 +0000 UTC m=+22.677376377" watchObservedRunningTime="2026-09-11 19:29:48.443519232 +0000 UTC m=+22.677592654"
Sep 11 19:29:48.483008 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:48.482950    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nclnv" podStartSLOduration=6.510501183 podStartE2EDuration="21.482934865s" totalImagesPullingTime="14.972433682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:48.482589048 +0000 UTC m=+22.716662470" watchObservedRunningTime="2026-09-11 19:29:48.482934865 +0000 UTC m=+22.717008285"
Sep 11 19:29:49.229787 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:49.229762    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 19:29:49.391527 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:49.391442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt" event={"ID":"f838d212-77ab-4428-b27e-2d72ddbd63c4","Type":"ContainerStarted","Data":"a8a518540a66d36d976271cdac50a8a01c284c93da6eddd14acc880a18b4901c"}
Sep 11 19:29:49.394807 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:49.394775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6" event={"ID":"516c2152-fe97-4f48-8912-050cf47d6b47","Type":"ContainerStarted","Data":"867bcfe310577a07118ed3111018c96073b0a5f010bb37c3bb99950ed201123f"}
Sep 11 19:29:49.396475 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:49.396442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c9csd" event={"ID":"93756891-d848-4ebb-86d8-6d34bf25abae","Type":"ContainerStarted","Data":"411aa63ab0b817e515edd0af0ac79aaeedcfd97f3e586c9de4168607ce7dc8e0"}
Sep 11 19:29:49.411808 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:49.411757    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c9csd" podStartSLOduration=3.7211973560000002 podStartE2EDuration="22.41173892s" totalImagesPullingTime="18.690541564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:49.410983685 +0000 UTC m=+23.645057106" watchObservedRunningTime="2026-09-11 19:29:49.41173892 +0000 UTC m=+23.645812344"
Sep 11 19:29:50.208189 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:50.208021    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T19:29:49.229783882Z","UUID":"222a8bdb-5f4f-4342-883e-21dae5c796ec","Handler":null,"Name":"","Endpoint":""}
Sep 11 19:29:50.210180 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:50.210157    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 19:29:50.210318 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:50.210196    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 19:29:50.251901 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:50.251871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:50.252058 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:50.251991    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:50.252058 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:50.251872    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:50.252170 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:50.252014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:50.252170 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:50.252083    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:50.252293 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:50.252206    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:50.401782 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:50.401556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt" event={"ID":"f838d212-77ab-4428-b27e-2d72ddbd63c4","Type":"ContainerStarted","Data":"af144b92bd17790c15c9cdd1a17875f2553f4ebc38e28b04fac7452a326c9efd"}
Sep 11 19:29:50.425199 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:50.425145    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9jpt" podStartSLOduration=2.70888648 podStartE2EDuration="23.425123011s" totalImagesPullingTime="20.716236531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:50.424843117 +0000 UTC m=+24.658916542" watchObservedRunningTime="2026-09-11 19:29:50.425123011 +0000 UTC m=+24.659196433"
Sep 11 19:29:51.408448 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:51.408401    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6" event={"ID":"516c2152-fe97-4f48-8912-050cf47d6b47","Type":"ContainerStarted","Data":"572278aa2723e99bd1f1845918a1ba5e6728486a088f1cc78aedf1422dd808ee"}
Sep 11 19:29:51.549419 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:51.549382    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:51.690508 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:51.690423    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:51.691061 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:51.691040    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:52.251126 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:52.251091    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:52.251324 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:52.251088    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:52.251324 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:52.251231    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:52.251324 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:52.251101    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:52.251324 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:52.251287    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:52.251557 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:52.251367    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:52.411828 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:52.411798    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nclnv"
Sep 11 19:29:53.415709 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:53.415503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zbz" event={"ID":"ebf7726b-4997-49d9-8caf-0f2996bef34b","Type":"ContainerStarted","Data":"eccbf786322a9145762937200a0ad83bdec57c2b340db38057cbc7f1e3a01156"}
Sep 11 19:29:53.420519 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:53.420494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6" event={"ID":"516c2152-fe97-4f48-8912-050cf47d6b47","Type":"ContainerStarted","Data":"8a38bc5884cdd255bd7d474499e3eda79da784452b0ce0967e30458876813a8e"}
Sep 11 19:29:53.464871 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:53.464826    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6" podStartSLOduration=7.729297477 podStartE2EDuration="26.464811462s" totalImagesPullingTime="18.735513985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:53.464665176 +0000 UTC m=+27.698738599" watchObservedRunningTime="2026-09-11 19:29:53.464811462 +0000 UTC m=+27.698884883"
Sep 11 19:29:54.251627 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:54.251594    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:54.251811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:54.251593    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:54.251811 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:54.251720    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:54.251811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:54.251593    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:54.251970 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:54.251769    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:54.251970 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:54.251850    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:54.425496 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:54.425458    2578 generic.go:356] "Generic (PLEG): container finished" podID="ebf7726b-4997-49d9-8caf-0f2996bef34b" containerID="eccbf786322a9145762937200a0ad83bdec57c2b340db38057cbc7f1e3a01156" exitCode=0
Sep 11 19:29:54.427031 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:54.427002    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zbz" event={"ID":"ebf7726b-4997-49d9-8caf-0f2996bef34b","Type":"ContainerDied","Data":"eccbf786322a9145762937200a0ad83bdec57c2b340db38057cbc7f1e3a01156"}
Sep 11 19:29:54.427176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:54.427060    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:54.427565 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:54.427542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:54.427647 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:54.427621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:54.451466 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:54.451439    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:54.455623 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:54.454905    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:29:55.034838 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:55.034606    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k7gfv"]
Sep 11 19:29:55.034838 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:55.034749    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:55.035111 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:55.034847    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:55.036088 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:55.036062    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8fjjd"]
Sep 11 19:29:55.036194 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:55.036119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bw2r8"]
Sep 11 19:29:55.036242 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:55.036205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:55.036370 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:55.036340    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:55.036463 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:55.036416    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:55.036513 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:55.036490    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:56.434433 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:56.434393    2578 generic.go:356] "Generic (PLEG): container finished" podID="ebf7726b-4997-49d9-8caf-0f2996bef34b" containerID="0d4b511d759c08e63d8e5fef8e081b3e5598bc9aeaf68fc926612844591a66d8" exitCode=0
Sep 11 19:29:56.435114 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:56.434471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zbz" event={"ID":"ebf7726b-4997-49d9-8caf-0f2996bef34b","Type":"ContainerDied","Data":"0d4b511d759c08e63d8e5fef8e081b3e5598bc9aeaf68fc926612844591a66d8"}
Sep 11 19:29:57.251029 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:57.250810    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:57.251156 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:57.250814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:57.251156 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:57.251134    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:57.251283 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:57.250875    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:57.251283 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:57.251174    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:57.251387 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:57.251278    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:57.439987 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:57.439907    2578 generic.go:356] "Generic (PLEG): container finished" podID="ebf7726b-4997-49d9-8caf-0f2996bef34b" containerID="42c89aca531c4955381041a1b360ce9bec7607f6d9a1b3ac178aa8fe5b4773db" exitCode=0
Sep 11 19:29:57.439987 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:57.439952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zbz" event={"ID":"ebf7726b-4997-49d9-8caf-0f2996bef34b","Type":"ContainerDied","Data":"42c89aca531c4955381041a1b360ce9bec7607f6d9a1b3ac178aa8fe5b4773db"}
Sep 11 19:29:59.251719 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:59.251634    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:29:59.252145 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:59.251641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:59.252145 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:59.251746    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7gfv" podUID="0caa7ad4-06df-4431-80e7-b714ba485085"
Sep 11 19:29:59.252145 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:59.251846    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fjjd" podUID="456845ab-9551-431f-8431-d833f553beef"
Sep 11 19:29:59.252145 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:59.251641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:59.252145 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:59.251957    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:29:59.992485 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:59.992453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:29:59.992675 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:29:59.992511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:29:59.992675 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:59.992623    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:29:59.992675 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:59.992625    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:59.992813 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:59.992683    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret podName:456845ab-9551-431f-8431-d833f553beef nodeName:}" failed. No retries permitted until 2026-09-11 19:30:31.992663933 +0000 UTC m=+66.226737333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret") pod "global-pull-secret-syncer-8fjjd" (UID: "456845ab-9551-431f-8431-d833f553beef") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:29:59.992813 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:29:59.992703    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs podName:d3883618-051d-4804-aa8d-222af6c1e9f7 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:31.992694425 +0000 UTC m=+66.226767823 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs") pod "network-metrics-daemon-bw2r8" (UID: "d3883618-051d-4804-aa8d-222af6c1e9f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:30:00.093522 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.093488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mn48\" (UniqueName: \"kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48\") pod \"network-check-target-k7gfv\" (UID: \"0caa7ad4-06df-4431-80e7-b714ba485085\") " pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:30:00.093697 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:00.093648    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:30:00.093697 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:00.093669    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:30:00.093697 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:00.093681    2578 projected.go:196] Error preparing data for projected volume kube-api-access-7mn48 for pod openshift-network-diagnostics/network-check-target-k7gfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:30:00.093842 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:00.093743    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48 podName:0caa7ad4-06df-4431-80e7-b714ba485085 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:32.093724313 +0000 UTC m=+66.327797713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mn48" (UniqueName: "kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48") pod "network-check-target-k7gfv" (UID: "0caa7ad4-06df-4431-80e7-b714ba485085") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:30:00.591789 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.591758    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-38.ec2.internal" event="NodeReady"
Sep 11 19:30:00.592182 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.591905    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 19:30:00.635509 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.635472    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6gvkd"]
Sep 11 19:30:00.638653 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.638624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.641600 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.641579    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 19:30:00.641721 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.641651    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6smxv\""
Sep 11 19:30:00.641904 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.641883    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rqj7n"]
Sep 11 19:30:00.641979 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.641964    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 19:30:00.644963 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.644944    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqj7n"
Sep 11 19:30:00.647448 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.647428    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dplr6\""
Sep 11 19:30:00.647448 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.647445    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 19:30:00.647578 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.647476    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 19:30:00.647767 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.647745    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 19:30:00.650800 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.650781    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6gvkd"]
Sep 11 19:30:00.653126 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.653109    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqj7n"]
Sep 11 19:30:00.800785 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.800743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33a886a5-12de-4d3a-a526-be3331fdc058-config-volume\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.800973 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.800815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4427j\" (UniqueName: \"kubernetes.io/projected/05887d0c-30a1-4f39-a721-349343bcd827-kube-api-access-4427j\") pod \"ingress-canary-rqj7n\" (UID: \"05887d0c-30a1-4f39-a721-349343bcd827\") " pod="openshift-ingress-canary/ingress-canary-rqj7n"
Sep 11 19:30:00.800973 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.800843    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a886a5-12de-4d3a-a526-be3331fdc058-tmp-dir\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.800973 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.800878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.800973 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.800963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tptbp\" (UniqueName: \"kubernetes.io/projected/33a886a5-12de-4d3a-a526-be3331fdc058-kube-api-access-tptbp\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.801134 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.801041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05887d0c-30a1-4f39-a721-349343bcd827-cert\") pod \"ingress-canary-rqj7n\" (UID: \"05887d0c-30a1-4f39-a721-349343bcd827\") " pod="openshift-ingress-canary/ingress-canary-rqj7n"
Sep 11 19:30:00.902062 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.901964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33a886a5-12de-4d3a-a526-be3331fdc058-config-volume\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.902062 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.902041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4427j\" (UniqueName: \"kubernetes.io/projected/05887d0c-30a1-4f39-a721-349343bcd827-kube-api-access-4427j\") pod \"ingress-canary-rqj7n\" (UID: \"05887d0c-30a1-4f39-a721-349343bcd827\") " pod="openshift-ingress-canary/ingress-canary-rqj7n"
Sep 11 19:30:00.902062 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.902060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a886a5-12de-4d3a-a526-be3331fdc058-tmp-dir\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.902355 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.902088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.902355 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.902138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tptbp\" (UniqueName: \"kubernetes.io/projected/33a886a5-12de-4d3a-a526-be3331fdc058-kube-api-access-tptbp\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.902355 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.902180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05887d0c-30a1-4f39-a721-349343bcd827-cert\") pod \"ingress-canary-rqj7n\" (UID: \"05887d0c-30a1-4f39-a721-349343bcd827\") " pod="openshift-ingress-canary/ingress-canary-rqj7n"
Sep 11 19:30:00.902355 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:00.902287    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:30:00.902355 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:00.902353    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls podName:33a886a5-12de-4d3a-a526-be3331fdc058 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:01.402335004 +0000 UTC m=+35.636408407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls") pod "dns-default-6gvkd" (UID: "33a886a5-12de-4d3a-a526-be3331fdc058") : secret "dns-default-metrics-tls" not found
Sep 11 19:30:00.902617 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.902602    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a886a5-12de-4d3a-a526-be3331fdc058-tmp-dir\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.902699 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.902679    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33a886a5-12de-4d3a-a526-be3331fdc058-config-volume\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.907019 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.906999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05887d0c-30a1-4f39-a721-349343bcd827-cert\") pod \"ingress-canary-rqj7n\" (UID: \"05887d0c-30a1-4f39-a721-349343bcd827\") " pod="openshift-ingress-canary/ingress-canary-rqj7n"
Sep 11 19:30:00.911518 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.911494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4427j\" (UniqueName: \"kubernetes.io/projected/05887d0c-30a1-4f39-a721-349343bcd827-kube-api-access-4427j\") pod \"ingress-canary-rqj7n\" (UID: \"05887d0c-30a1-4f39-a721-349343bcd827\") " pod="openshift-ingress-canary/ingress-canary-rqj7n"
Sep 11 19:30:00.911652 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.911625    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tptbp\" (UniqueName: \"kubernetes.io/projected/33a886a5-12de-4d3a-a526-be3331fdc058-kube-api-access-tptbp\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:00.960384 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:00.960350    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqj7n"
Sep 11 19:30:01.251655 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:01.251580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:30:01.251828 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:01.251578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:30:01.251828 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:01.251578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:30:01.254583 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:01.254561    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 19:30:01.254717 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:01.254585    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 19:30:01.255842 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:01.255816    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7w7kq\""
Sep 11 19:30:01.255842 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:01.255833    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2xtcq\""
Sep 11 19:30:01.256012 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:01.255818    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 19:30:01.256012 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:01.255818    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 19:30:01.405491 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:01.405451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:01.405677 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:01.405653    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:30:01.405764 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:01.405750    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls podName:33a886a5-12de-4d3a-a526-be3331fdc058 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:02.405712568 +0000 UTC m=+36.639785982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls") pod "dns-default-6gvkd" (UID: "33a886a5-12de-4d3a-a526-be3331fdc058") : secret "dns-default-metrics-tls" not found
Sep 11 19:30:02.250569 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:02.250361    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqj7n"]
Sep 11 19:30:02.275343 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:30:02.275314    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05887d0c_30a1_4f39_a721_349343bcd827.slice/crio-40a0e1b4d3e8724f9996bdc941d7c63f9c12d8f3c647ddbf27c0d246cf14f566 WatchSource:0}: Error finding container 40a0e1b4d3e8724f9996bdc941d7c63f9c12d8f3c647ddbf27c0d246cf14f566: Status 404 returned error can't find the container with id 40a0e1b4d3e8724f9996bdc941d7c63f9c12d8f3c647ddbf27c0d246cf14f566
Sep 11 19:30:02.412831 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:02.412793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:02.413031 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:02.412973    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:30:02.413093 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:02.413054    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls podName:33a886a5-12de-4d3a-a526-be3331fdc058 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:04.41303301 +0000 UTC m=+38.647106412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls") pod "dns-default-6gvkd" (UID: "33a886a5-12de-4d3a-a526-be3331fdc058") : secret "dns-default-metrics-tls" not found
Sep 11 19:30:02.453122 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:02.453085    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqj7n" event={"ID":"05887d0c-30a1-4f39-a721-349343bcd827","Type":"ContainerStarted","Data":"40a0e1b4d3e8724f9996bdc941d7c63f9c12d8f3c647ddbf27c0d246cf14f566"}
Sep 11 19:30:02.456022 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:02.455995    2578 generic.go:356] "Generic (PLEG): container finished" podID="ebf7726b-4997-49d9-8caf-0f2996bef34b" containerID="316f997985039e0a0dc56aa590d0b33d6a056d6d4a764a42b8a99ca603a8a979" exitCode=0
Sep 11 19:30:02.456144 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:02.456039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zbz" event={"ID":"ebf7726b-4997-49d9-8caf-0f2996bef34b","Type":"ContainerDied","Data":"316f997985039e0a0dc56aa590d0b33d6a056d6d4a764a42b8a99ca603a8a979"}
Sep 11 19:30:03.462061 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:03.462026    2578 generic.go:356] "Generic (PLEG): container finished" podID="ebf7726b-4997-49d9-8caf-0f2996bef34b" containerID="a5204cd15a2b1934466533b96e2bec736589298057d0647083dc6b98c34a48fc" exitCode=0
Sep 11 19:30:03.462532 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:03.462106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zbz" event={"ID":"ebf7726b-4997-49d9-8caf-0f2996bef34b","Type":"ContainerDied","Data":"a5204cd15a2b1934466533b96e2bec736589298057d0647083dc6b98c34a48fc"}
Sep 11 19:30:04.430379 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:04.430335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:04.430555 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:04.430506    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:30:04.430619 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:04.430573    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls podName:33a886a5-12de-4d3a-a526-be3331fdc058 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:08.430555885 +0000 UTC m=+42.664629289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls") pod "dns-default-6gvkd" (UID: "33a886a5-12de-4d3a-a526-be3331fdc058") : secret "dns-default-metrics-tls" not found
Sep 11 19:30:04.468586 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:04.468546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zbz" event={"ID":"ebf7726b-4997-49d9-8caf-0f2996bef34b","Type":"ContainerStarted","Data":"db869834dd8f6146262521879abcd6e5cfb6438d5892aaa7976dc2c8274355ed"}
Sep 11 19:30:04.497076 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:04.497018    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x2zbz" podStartSLOduration=7.474452978 podStartE2EDuration="37.496996088s" totalImagesPullingTime="30.02254311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:04.494703127 +0000 UTC m=+38.728776548" watchObservedRunningTime="2026-09-11 19:30:04.496996088 +0000 UTC m=+38.731069510"
Sep 11 19:30:05.472733 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:05.472695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqj7n" event={"ID":"05887d0c-30a1-4f39-a721-349343bcd827","Type":"ContainerStarted","Data":"99f50fd2554aeb8f117078d8127767bbabfb401fdacfd9bec80d17f3834951ed"}
Sep 11 19:30:05.490793 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:05.490753    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rqj7n" podStartSLOduration=3.001843309 podStartE2EDuration="5.490739895s" totalImagesPullingTime="2.488896586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:05.48960705 +0000 UTC m=+39.723680472" watchObservedRunningTime="2026-09-11 19:30:05.490739895 +0000 UTC m=+39.724813315"
Sep 11 19:30:08.459931 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:08.459892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:08.460345 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:08.460040    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:30:08.460345 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:08.460102    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls podName:33a886a5-12de-4d3a-a526-be3331fdc058 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:16.460087684 +0000 UTC m=+50.694161083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls") pod "dns-default-6gvkd" (UID: "33a886a5-12de-4d3a-a526-be3331fdc058") : secret "dns-default-metrics-tls" not found
Sep 11 19:30:16.512011 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:16.511977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:16.512478 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:16.512080    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:30:16.512478 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:16.512138    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls podName:33a886a5-12de-4d3a-a526-be3331fdc058 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:32.512126035 +0000 UTC m=+66.746199433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls") pod "dns-default-6gvkd" (UID: "33a886a5-12de-4d3a-a526-be3331fdc058") : secret "dns-default-metrics-tls" not found
Sep 11 19:30:26.445639 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:26.445613    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnhl6"
Sep 11 19:30:32.008762 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.008719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:30:32.008762 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.008776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:30:32.011926 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.011906    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 19:30:32.012050 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.011967    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 19:30:32.019390 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:32.019374    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 19:30:32.019471 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:32.019443    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs podName:d3883618-051d-4804-aa8d-222af6c1e9f7 nodeName:}" failed. No retries permitted until 2026-09-11 19:31:36.019422037 +0000 UTC m=+130.253495447 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs") pod "network-metrics-daemon-bw2r8" (UID: "d3883618-051d-4804-aa8d-222af6c1e9f7") : secret "metrics-daemon-secret" not found
Sep 11 19:30:32.022327 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.022308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/456845ab-9551-431f-8431-d833f553beef-original-pull-secret\") pod \"global-pull-secret-syncer-8fjjd\" (UID: \"456845ab-9551-431f-8431-d833f553beef\") " pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:30:32.109201 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.109167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mn48\" (UniqueName: \"kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48\") pod \"network-check-target-k7gfv\" (UID: \"0caa7ad4-06df-4431-80e7-b714ba485085\") " pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:30:32.112379 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.112359    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 19:30:32.121934 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.121916    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 19:30:32.132580 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.132562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mn48\" (UniqueName: \"kubernetes.io/projected/0caa7ad4-06df-4431-80e7-b714ba485085-kube-api-access-7mn48\") pod \"network-check-target-k7gfv\" (UID: \"0caa7ad4-06df-4431-80e7-b714ba485085\") " pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:30:32.167542 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.167523    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2xtcq\""
Sep 11 19:30:32.175040 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.175024    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:30:32.176296 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.176280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fjjd"
Sep 11 19:30:32.475203 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.475167    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k7gfv"]
Sep 11 19:30:32.479584 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:30:32.479557    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0caa7ad4_06df_4431_80e7_b714ba485085.slice/crio-6b082a1f69793898d2ad705a249e59aea859dd4b1d35ca946fa278d1e6ba5a63 WatchSource:0}: Error finding container 6b082a1f69793898d2ad705a249e59aea859dd4b1d35ca946fa278d1e6ba5a63: Status 404 returned error can't find the container with id 6b082a1f69793898d2ad705a249e59aea859dd4b1d35ca946fa278d1e6ba5a63
Sep 11 19:30:32.495682 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.495661    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8fjjd"]
Sep 11 19:30:32.498567 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:30:32.498548    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456845ab_9551_431f_8431_d833f553beef.slice/crio-e78ae45a9e062b92771f94595e0bddf841f276e4df484209f00711cfe94a5962 WatchSource:0}: Error finding container e78ae45a9e062b92771f94595e0bddf841f276e4df484209f00711cfe94a5962: Status 404 returned error can't find the container with id e78ae45a9e062b92771f94595e0bddf841f276e4df484209f00711cfe94a5962
Sep 11 19:30:32.512481 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.512460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:30:32.512621 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:32.512604    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:30:32.512694 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:30:32.512682    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls podName:33a886a5-12de-4d3a-a526-be3331fdc058 nodeName:}" failed. No retries permitted until 2026-09-11 19:31:04.512661866 +0000 UTC m=+98.746735267 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls") pod "dns-default-6gvkd" (UID: "33a886a5-12de-4d3a-a526-be3331fdc058") : secret "dns-default-metrics-tls" not found
Sep 11 19:30:32.537069 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.537011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8fjjd" event={"ID":"456845ab-9551-431f-8431-d833f553beef","Type":"ContainerStarted","Data":"e78ae45a9e062b92771f94595e0bddf841f276e4df484209f00711cfe94a5962"}
Sep 11 19:30:32.538157 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:32.538138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k7gfv" event={"ID":"0caa7ad4-06df-4431-80e7-b714ba485085","Type":"ContainerStarted","Data":"6b082a1f69793898d2ad705a249e59aea859dd4b1d35ca946fa278d1e6ba5a63"}
Sep 11 19:30:37.553787 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:37.553751    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8fjjd" event={"ID":"456845ab-9551-431f-8431-d833f553beef","Type":"ContainerStarted","Data":"3adb225121f4132df8150d7766d8d42efba9cfc4a647a064e9ecc4d39947c6a6"}
Sep 11 19:30:37.555335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:37.555313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k7gfv" event={"ID":"0caa7ad4-06df-4431-80e7-b714ba485085","Type":"ContainerStarted","Data":"856bba33c56f94acc9ca9ef2010e10a6319aa058439758db5c8a5f030e982f7a"}
Sep 11 19:30:37.555491 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:37.555475    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:30:37.571760 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:37.571715    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8fjjd" podStartSLOduration=66.063282281 podStartE2EDuration="1m10.571701136s" totalImagesPullingTime="4.508418855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:37.571396647 +0000 UTC m=+71.805470067" watchObservedRunningTime="2026-09-11 19:30:37.571701136 +0000 UTC m=+71.805774556"
Sep 11 19:30:37.590771 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:30:37.590734    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k7gfv" podStartSLOduration=66.068003742 podStartE2EDuration="1m10.590721964s" totalImagesPullingTime="4.522718222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:37.589574919 +0000 UTC m=+71.823648339" watchObservedRunningTime="2026-09-11 19:30:37.590721964 +0000 UTC m=+71.824795385"
Sep 11 19:31:04.519454 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:31:04.519421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:31:04.519878 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:31:04.519556    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:31:04.519878 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:31:04.519612    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls podName:33a886a5-12de-4d3a-a526-be3331fdc058 nodeName:}" failed. No retries permitted until 2026-09-11 19:32:08.51959743 +0000 UTC m=+162.753670829 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls") pod "dns-default-6gvkd" (UID: "33a886a5-12de-4d3a-a526-be3331fdc058") : secret "dns-default-metrics-tls" not found
Sep 11 19:31:08.559956 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:31:08.559923    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k7gfv"
Sep 11 19:31:36.119229 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:31:36.119191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:31:36.119704 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:31:36.119317    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 19:31:36.119704 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:31:36.119374    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs podName:d3883618-051d-4804-aa8d-222af6c1e9f7 nodeName:}" failed. No retries permitted until 2026-09-11 19:33:38.119360358 +0000 UTC m=+252.353433757 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs") pod "network-metrics-daemon-bw2r8" (UID: "d3883618-051d-4804-aa8d-222af6c1e9f7") : secret "metrics-daemon-secret" not found
Sep 11 19:32:03.653432 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:32:03.653392    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6gvkd" podUID="33a886a5-12de-4d3a-a526-be3331fdc058"
Sep 11 19:32:03.759790 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:32:03.759761    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:32:04.271427 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:32:04.271392    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:32:08.528157 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:32:08.528111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:32:08.528575 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:32:08.528273    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:32:08.528575 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:32:08.528335    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls podName:33a886a5-12de-4d3a-a526-be3331fdc058 nodeName:}" failed. No retries permitted until 2026-09-11 19:34:10.528320898 +0000 UTC m=+284.762394297 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls") pod "dns-default-6gvkd" (UID: "33a886a5-12de-4d3a-a526-be3331fdc058") : secret "dns-default-metrics-tls" not found
Sep 11 19:32:19.251296 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:32:19.251193    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:33:36.145586 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.145552    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lvd8b"]
Sep 11 19:33:36.147249 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.147233    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lvd8b"
Sep 11 19:33:36.151740 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.151692    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-kcmtv"]
Sep 11 19:33:36.151914 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.151885    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gxsp8\""
Sep 11 19:33:36.151958 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.151931    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 19:33:36.152503 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.152468    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:33:36.153728 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.153700    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.156791 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.156774    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 19:33:36.157509 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.157496    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 19:33:36.157652 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.157630    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-z4gws\""
Sep 11 19:33:36.157772 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.157632    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 19:33:36.157772 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.157632    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:33:36.164998 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.164977    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 19:33:36.166315 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.166293    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lvd8b"]
Sep 11 19:33:36.170146 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.170120    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-kcmtv"]
Sep 11 19:33:36.199142 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.199103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9kfr\" (UniqueName: \"kubernetes.io/projected/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-kube-api-access-f9kfr\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.199346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.199158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-serving-cert\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.199346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.199197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-trusted-ca\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.199346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.199247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-config\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.199346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.199323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj5gc\" (UniqueName: \"kubernetes.io/projected/69bfd8d1-1e43-4168-b4f0-b67f1351dfc4-kube-api-access-dj5gc\") pod \"volume-data-source-validator-86695b7cc7-lvd8b\" (UID: \"69bfd8d1-1e43-4168-b4f0-b67f1351dfc4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lvd8b"
Sep 11 19:33:36.249350 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.249314    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"]
Sep 11 19:33:36.250977 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.250957    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"]
Sep 11 19:33:36.251948 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.251931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"
Sep 11 19:33:36.253706 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.253680    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:36.255082 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.255061    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 19:33:36.255207 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.255192    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:33:36.255474 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.255451    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 19:33:36.255557 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.255477    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m72gt\""
Sep 11 19:33:36.255557 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.255523    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 19:33:36.261634 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.261614    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 19:33:36.261984 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.261971    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4l6zn\""
Sep 11 19:33:36.263562 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.263547    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 19:33:36.263653 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.263569    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 19:33:36.263653 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.263596    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 19:33:36.271125 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.271102    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"]
Sep 11 19:33:36.271763 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.271747    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"]
Sep 11 19:33:36.299602 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.299573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-pnqh4\" (UID: \"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"
Sep 11 19:33:36.299602 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.299604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9kfr\" (UniqueName: \"kubernetes.io/projected/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-kube-api-access-f9kfr\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.299796 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.299623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx8q2\" (UniqueName: \"kubernetes.io/projected/bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e-kube-api-access-mx8q2\") pod \"kube-storage-version-migrator-operator-6c8f84f897-pnqh4\" (UID: \"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"
Sep 11 19:33:36.299796 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.299643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f6188ee1-7af8-498b-8361-0733f5531394-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:36.299796 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.299767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:36.299908 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.299810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-serving-cert\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.299908 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.299827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-trusted-ca\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.299908 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.299865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-config\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.299908 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.299894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-pnqh4\" (UID: \"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"
Sep 11 19:33:36.300051 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.299913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj5gc\" (UniqueName: \"kubernetes.io/projected/69bfd8d1-1e43-4168-b4f0-b67f1351dfc4-kube-api-access-dj5gc\") pod \"volume-data-source-validator-86695b7cc7-lvd8b\" (UID: \"69bfd8d1-1e43-4168-b4f0-b67f1351dfc4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lvd8b"
Sep 11 19:33:36.300051 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.299938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qtng\" (UniqueName: \"kubernetes.io/projected/f6188ee1-7af8-498b-8361-0733f5531394-kube-api-access-8qtng\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:36.300674 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.300649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-config\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.300772 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.300689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-trusted-ca\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.302459 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.302429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-serving-cert\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.310121 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.310086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9kfr\" (UniqueName: \"kubernetes.io/projected/82e402d8-49e7-48bb-9d9c-b64ff6b64e9e-kube-api-access-f9kfr\") pod \"console-operator-696884fb9c-kcmtv\" (UID: \"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e\") " pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.310460 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.310442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj5gc\" (UniqueName: \"kubernetes.io/projected/69bfd8d1-1e43-4168-b4f0-b67f1351dfc4-kube-api-access-dj5gc\") pod \"volume-data-source-validator-86695b7cc7-lvd8b\" (UID: \"69bfd8d1-1e43-4168-b4f0-b67f1351dfc4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lvd8b"
Sep 11 19:33:36.344616 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.344585    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-57b5479c4b-82pb9"]
Sep 11 19:33:36.346893 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.346876    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.349633 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.349582    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 19:33:36.349633 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.349620    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 19:33:36.349842 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.349637    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 19:33:36.349842 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.349637    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2csf9\""
Sep 11 19:33:36.349842 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.349694    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 19:33:36.350016 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.349995    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 19:33:36.350226 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.350067    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 19:33:36.358281 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.358247    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57b5479c4b-82pb9"]
Sep 11 19:33:36.400839 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.400754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-pnqh4\" (UID: \"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"
Sep 11 19:33:36.400839 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.400791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qtng\" (UniqueName: \"kubernetes.io/projected/f6188ee1-7af8-498b-8361-0733f5531394-kube-api-access-8qtng\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:36.400839 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.400820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-pnqh4\" (UID: \"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"
Sep 11 19:33:36.401122 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.400848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d95k\" (UniqueName: \"kubernetes.io/projected/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-kube-api-access-2d95k\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.401122 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.400881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx8q2\" (UniqueName: \"kubernetes.io/projected/bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e-kube-api-access-mx8q2\") pod \"kube-storage-version-migrator-operator-6c8f84f897-pnqh4\" (UID: \"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"
Sep 11 19:33:36.401122 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.400911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f6188ee1-7af8-498b-8361-0733f5531394-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:36.401122 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.400948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:36.401122 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.400972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-default-certificate\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.401122 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:36.401042    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:36.401122 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:36.401120    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls podName:f6188ee1-7af8-498b-8361-0733f5531394 nodeName:}" failed. No retries permitted until 2026-09-11 19:33:36.901098758 +0000 UTC m=+251.135172171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2ftt4" (UID: "f6188ee1-7af8-498b-8361-0733f5531394") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:36.401484 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.401143    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-stats-auth\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.401484 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.401175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.401484 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.401207    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.401484 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.401456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-pnqh4\" (UID: \"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"
Sep 11 19:33:36.401649 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.401633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f6188ee1-7af8-498b-8361-0733f5531394-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:36.403295 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.403276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-pnqh4\" (UID: \"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"
Sep 11 19:33:36.412233 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.412208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qtng\" (UniqueName: \"kubernetes.io/projected/f6188ee1-7af8-498b-8361-0733f5531394-kube-api-access-8qtng\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:36.412377 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.412353    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx8q2\" (UniqueName: \"kubernetes.io/projected/bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e-kube-api-access-mx8q2\") pod \"kube-storage-version-migrator-operator-6c8f84f897-pnqh4\" (UID: \"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"
Sep 11 19:33:36.456215 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.456181    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lvd8b"
Sep 11 19:33:36.463334 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.463307    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:36.502480 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.502436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.502729 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.502523    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d95k\" (UniqueName: \"kubernetes.io/projected/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-kube-api-access-2d95k\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.502729 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.502587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-default-certificate\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.502729 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:36.502656    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle podName:c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f nodeName:}" failed. No retries permitted until 2026-09-11 19:33:37.002630857 +0000 UTC m=+251.236704275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle") pod "router-default-57b5479c4b-82pb9" (UID: "c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f") : configmap references non-existent config key: service-ca.crt
Sep 11 19:33:36.502729 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.502693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-stats-auth\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.503039 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.502733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.503039 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:36.502886    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:33:36.503039 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:36.502940    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs podName:c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f nodeName:}" failed. No retries permitted until 2026-09-11 19:33:37.002925856 +0000 UTC m=+251.236999274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs") pod "router-default-57b5479c4b-82pb9" (UID: "c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f") : secret "router-metrics-certs-default" not found
Sep 11 19:33:36.506181 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.506110    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-default-certificate\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.506958 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.506936    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-stats-auth\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.512796 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.512747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d95k\" (UniqueName: \"kubernetes.io/projected/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-kube-api-access-2d95k\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:36.561626 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.561591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"
Sep 11 19:33:36.725252 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.725185    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lvd8b"]
Sep 11 19:33:36.727908 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:33:36.727879    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bfd8d1_1e43_4168_b4f0_b67f1351dfc4.slice/crio-f8ffbdbc65c47643827af79b905e3518afe60c618a3d6ba30d903edd06413d4d WatchSource:0}: Error finding container f8ffbdbc65c47643827af79b905e3518afe60c618a3d6ba30d903edd06413d4d: Status 404 returned error can't find the container with id f8ffbdbc65c47643827af79b905e3518afe60c618a3d6ba30d903edd06413d4d
Sep 11 19:33:36.731430 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.731404    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-kcmtv"]
Sep 11 19:33:36.733904 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:33:36.733879    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e402d8_49e7_48bb_9d9c_b64ff6b64e9e.slice/crio-95a89e9aed4090bd83c3d7b62627a54ed1782a1acbaaec74109393e425952406 WatchSource:0}: Error finding container 95a89e9aed4090bd83c3d7b62627a54ed1782a1acbaaec74109393e425952406: Status 404 returned error can't find the container with id 95a89e9aed4090bd83c3d7b62627a54ed1782a1acbaaec74109393e425952406
Sep 11 19:33:36.826890 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.826857    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4"]
Sep 11 19:33:36.829495 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:33:36.829465    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf5ef96_5c81_4d9e_bac4_fb2ebad0201e.slice/crio-2a095b8bf4f85c942648d693edf8403a251d57ec12ecb39020985a880317a345 WatchSource:0}: Error finding container 2a095b8bf4f85c942648d693edf8403a251d57ec12ecb39020985a880317a345: Status 404 returned error can't find the container with id 2a095b8bf4f85c942648d693edf8403a251d57ec12ecb39020985a880317a345
Sep 11 19:33:36.905803 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.905773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:36.905935 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:36.905918    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:36.905995 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:36.905985    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls podName:f6188ee1-7af8-498b-8361-0733f5531394 nodeName:}" failed. No retries permitted until 2026-09-11 19:33:37.905963625 +0000 UTC m=+252.140037047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2ftt4" (UID: "f6188ee1-7af8-498b-8361-0733f5531394") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:36.982320 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.982216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" event={"ID":"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e","Type":"ContainerStarted","Data":"95a89e9aed4090bd83c3d7b62627a54ed1782a1acbaaec74109393e425952406"}
Sep 11 19:33:36.983422 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.983392    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4" event={"ID":"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e","Type":"ContainerStarted","Data":"2a095b8bf4f85c942648d693edf8403a251d57ec12ecb39020985a880317a345"}
Sep 11 19:33:36.984543 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:36.984521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lvd8b" event={"ID":"69bfd8d1-1e43-4168-b4f0-b67f1351dfc4","Type":"ContainerStarted","Data":"f8ffbdbc65c47643827af79b905e3518afe60c618a3d6ba30d903edd06413d4d"}
Sep 11 19:33:37.007056 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:37.007035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:37.007148 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:37.007066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:37.007200 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:37.007172    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle podName:c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f nodeName:}" failed. No retries permitted until 2026-09-11 19:33:38.007159685 +0000 UTC m=+252.241233088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle") pod "router-default-57b5479c4b-82pb9" (UID: "c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f") : configmap references non-existent config key: service-ca.crt
Sep 11 19:33:37.007200 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:37.007171    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:33:37.007305 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:37.007220    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs podName:c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f nodeName:}" failed. No retries permitted until 2026-09-11 19:33:38.007207318 +0000 UTC m=+252.241280732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs") pod "router-default-57b5479c4b-82pb9" (UID: "c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f") : secret "router-metrics-certs-default" not found
Sep 11 19:33:37.914366 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:37.914282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:37.914784 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:37.914447    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:37.914784 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:37.914507    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls podName:f6188ee1-7af8-498b-8361-0733f5531394 nodeName:}" failed. No retries permitted until 2026-09-11 19:33:39.914492235 +0000 UTC m=+254.148565635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2ftt4" (UID: "f6188ee1-7af8-498b-8361-0733f5531394") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:37.989447 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:37.989406    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lvd8b" event={"ID":"69bfd8d1-1e43-4168-b4f0-b67f1351dfc4","Type":"ContainerStarted","Data":"d84345aee9d99d12feac525c654abcc4a08e651fecc5ae8ec3b09f05e8a568bc"}
Sep 11 19:33:38.004208 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:38.004152    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-lvd8b" podStartSLOduration=0.916805683 podStartE2EDuration="2.004135766s" totalImagesPullingTime="1.087330083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:33:38.003757975 +0000 UTC m=+252.237831399" watchObservedRunningTime="2026-09-11 19:33:38.004135766 +0000 UTC m=+252.238209188"
Sep 11 19:33:38.015281 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:38.015234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:38.015281 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:38.015283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:38.015449 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:38.015396    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:33:38.015487 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:38.015464    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs podName:c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f nodeName:}" failed. No retries permitted until 2026-09-11 19:33:40.015443948 +0000 UTC m=+254.249517367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs") pod "router-default-57b5479c4b-82pb9" (UID: "c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f") : secret "router-metrics-certs-default" not found
Sep 11 19:33:38.015487 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:38.015483    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle podName:c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f nodeName:}" failed. No retries permitted until 2026-09-11 19:33:40.015473268 +0000 UTC m=+254.249546671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle") pod "router-default-57b5479c4b-82pb9" (UID: "c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f") : configmap references non-existent config key: service-ca.crt
Sep 11 19:33:38.216593 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:38.216506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:33:38.216751 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:38.216679    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 19:33:38.216828 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:38.216778    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs podName:d3883618-051d-4804-aa8d-222af6c1e9f7 nodeName:}" failed. No retries permitted until 2026-09-11 19:35:40.216756648 +0000 UTC m=+374.450830062 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs") pod "network-metrics-daemon-bw2r8" (UID: "d3883618-051d-4804-aa8d-222af6c1e9f7") : secret "metrics-daemon-secret" not found
Sep 11 19:33:39.929503 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:39.929465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:39.929922 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:39.929613    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:39.929922 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:39.929680    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls podName:f6188ee1-7af8-498b-8361-0733f5531394 nodeName:}" failed. No retries permitted until 2026-09-11 19:33:43.929666343 +0000 UTC m=+258.163739747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2ftt4" (UID: "f6188ee1-7af8-498b-8361-0733f5531394") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:39.998910 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:39.998872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4" event={"ID":"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e","Type":"ContainerStarted","Data":"98d19c2ccd20ddbb64222a6fffa20852ea937785e9d8c83090fe6e2c1203d9c8"}
Sep 11 19:33:40.000512 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.000495    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/0.log"
Sep 11 19:33:40.000629 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.000530    2578 generic.go:356] "Generic (PLEG): container finished" podID="82e402d8-49e7-48bb-9d9c-b64ff6b64e9e" containerID="5ba977940c4f2af250c146aab35d5f37f84484500951a2a87b4f177ed27b717d" exitCode=255
Sep 11 19:33:40.000629 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.000581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" event={"ID":"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e","Type":"ContainerDied","Data":"5ba977940c4f2af250c146aab35d5f37f84484500951a2a87b4f177ed27b717d"}
Sep 11 19:33:40.000765 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.000753    2578 scope.go:117] "RemoveContainer" containerID="5ba977940c4f2af250c146aab35d5f37f84484500951a2a87b4f177ed27b717d"
Sep 11 19:33:40.016047 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.016010    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4" podStartSLOduration=1.834847727 podStartE2EDuration="4.015993067s" totalImagesPullingTime="2.18114534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:33:40.014955556 +0000 UTC m=+254.249028978" watchObservedRunningTime="2026-09-11 19:33:40.015993067 +0000 UTC m=+254.250066488"
Sep 11 19:33:40.031596 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.030955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:40.031596 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.030996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:40.031596 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:40.031391    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:33:40.031596 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:40.031456    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs podName:c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f nodeName:}" failed. No retries permitted until 2026-09-11 19:33:44.031437987 +0000 UTC m=+258.265511415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs") pod "router-default-57b5479c4b-82pb9" (UID: "c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f") : secret "router-metrics-certs-default" not found
Sep 11 19:33:40.031596 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:40.031510    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle podName:c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f nodeName:}" failed. No retries permitted until 2026-09-11 19:33:44.031498669 +0000 UTC m=+258.265572070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle") pod "router-default-57b5479c4b-82pb9" (UID: "c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f") : configmap references non-existent config key: service-ca.crt
Sep 11 19:33:40.328222 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.328187    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb"]
Sep 11 19:33:40.330232 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.330211    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb"
Sep 11 19:33:40.333088 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.333069    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 19:33:40.333189 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.333086    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 19:33:40.333189 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.333143    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cjx94\""
Sep 11 19:33:40.340376 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.340353    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb"]
Sep 11 19:33:40.437376 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.434421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n7kc\" (UniqueName: \"kubernetes.io/projected/cf231fad-024c-4086-97f1-144d81d4f4b8-kube-api-access-7n7kc\") pod \"migrator-8b4d697c5-7mmwb\" (UID: \"cf231fad-024c-4086-97f1-144d81d4f4b8\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb"
Sep 11 19:33:40.503984 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.503952    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n2tfr"]
Sep 11 19:33:40.505889 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.505874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.508701 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.508679    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 19:33:40.508834 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.508728    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vrbnh\""
Sep 11 19:33:40.509003 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.508988    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 19:33:40.509083 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.509014    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 19:33:40.509301 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.509288    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 19:33:40.516362 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.516341    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n2tfr"]
Sep 11 19:33:40.535155 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.535125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.535286 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.535160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa43f2be-8cbd-4298-afc6-7d829039738e-crio-socket\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.535286 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.535184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa43f2be-8cbd-4298-afc6-7d829039738e-data-volume\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.535394 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.535306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7kc\" (UniqueName: \"kubernetes.io/projected/cf231fad-024c-4086-97f1-144d81d4f4b8-kube-api-access-7n7kc\") pod \"migrator-8b4d697c5-7mmwb\" (UID: \"cf231fad-024c-4086-97f1-144d81d4f4b8\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb"
Sep 11 19:33:40.535394 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.535336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.535394 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.535362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h7fq\" (UniqueName: \"kubernetes.io/projected/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-api-access-4h7fq\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.544769 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.544737    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n7kc\" (UniqueName: \"kubernetes.io/projected/cf231fad-024c-4086-97f1-144d81d4f4b8-kube-api-access-7n7kc\") pod \"migrator-8b4d697c5-7mmwb\" (UID: \"cf231fad-024c-4086-97f1-144d81d4f4b8\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb"
Sep 11 19:33:40.636604 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.636506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.636604 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.636549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h7fq\" (UniqueName: \"kubernetes.io/projected/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-api-access-4h7fq\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.636604 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.636594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.636874 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.636613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa43f2be-8cbd-4298-afc6-7d829039738e-crio-socket\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.636874 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.636628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa43f2be-8cbd-4298-afc6-7d829039738e-data-volume\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.636874 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:40.636676    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:33:40.636874 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:40.636705    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:33:40.636874 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.636740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa43f2be-8cbd-4298-afc6-7d829039738e-crio-socket\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.636874 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:40.636769    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls podName:aa43f2be-8cbd-4298-afc6-7d829039738e nodeName:}" failed. No retries permitted until 2026-09-11 19:33:41.136749163 +0000 UTC m=+255.370822579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n2tfr" (UID: "aa43f2be-8cbd-4298-afc6-7d829039738e") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:33:40.636874 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:40.636788    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm podName:aa43f2be-8cbd-4298-afc6-7d829039738e nodeName:}" failed. No retries permitted until 2026-09-11 19:33:41.136778578 +0000 UTC m=+255.370851978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n2tfr" (UID: "aa43f2be-8cbd-4298-afc6-7d829039738e") : configmap "kube-rbac-proxy" not found
Sep 11 19:33:40.637160 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.636907    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa43f2be-8cbd-4298-afc6-7d829039738e-data-volume\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.638483 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.638469    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb"
Sep 11 19:33:40.644623 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.644599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h7fq\" (UniqueName: \"kubernetes.io/projected/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-api-access-4h7fq\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:40.904032 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:40.903949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb"]
Sep 11 19:33:40.907298 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:33:40.907275    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf231fad_024c_4086_97f1_144d81d4f4b8.slice/crio-3dbfe216fe709dd42873e4fde0d12ca723593a1cc730a6cfd3862feec7d2121c WatchSource:0}: Error finding container 3dbfe216fe709dd42873e4fde0d12ca723593a1cc730a6cfd3862feec7d2121c: Status 404 returned error can't find the container with id 3dbfe216fe709dd42873e4fde0d12ca723593a1cc730a6cfd3862feec7d2121c
Sep 11 19:33:41.004809 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:41.004779    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/1.log"
Sep 11 19:33:41.005202 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:41.005185    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/0.log"
Sep 11 19:33:41.005241 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:41.005216    2578 generic.go:356] "Generic (PLEG): container finished" podID="82e402d8-49e7-48bb-9d9c-b64ff6b64e9e" containerID="661d9f8e80fa5b2561db7971dff78641620f64ddd48bd1d38ca4bf3656938b02" exitCode=255
Sep 11 19:33:41.005335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:41.005310    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" event={"ID":"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e","Type":"ContainerDied","Data":"661d9f8e80fa5b2561db7971dff78641620f64ddd48bd1d38ca4bf3656938b02"}
Sep 11 19:33:41.005466 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:41.005368    2578 scope.go:117] "RemoveContainer" containerID="5ba977940c4f2af250c146aab35d5f37f84484500951a2a87b4f177ed27b717d"
Sep 11 19:33:41.005576 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:41.005559    2578 scope.go:117] "RemoveContainer" containerID="661d9f8e80fa5b2561db7971dff78641620f64ddd48bd1d38ca4bf3656938b02"
Sep 11 19:33:41.005792 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:41.005768    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-kcmtv_openshift-console-operator(82e402d8-49e7-48bb-9d9c-b64ff6b64e9e)\"" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" podUID="82e402d8-49e7-48bb-9d9c-b64ff6b64e9e"
Sep 11 19:33:41.006619 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:41.006596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb" event={"ID":"cf231fad-024c-4086-97f1-144d81d4f4b8","Type":"ContainerStarted","Data":"3dbfe216fe709dd42873e4fde0d12ca723593a1cc730a6cfd3862feec7d2121c"}
Sep 11 19:33:41.141393 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:41.141353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:41.141598 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:41.141428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:41.141598 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:41.141486    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:33:41.141598 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:41.141537    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:33:41.141598 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:41.141564    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm podName:aa43f2be-8cbd-4298-afc6-7d829039738e nodeName:}" failed. No retries permitted until 2026-09-11 19:33:42.141541653 +0000 UTC m=+256.375615076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n2tfr" (UID: "aa43f2be-8cbd-4298-afc6-7d829039738e") : configmap "kube-rbac-proxy" not found
Sep 11 19:33:41.141598 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:41.141584    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls podName:aa43f2be-8cbd-4298-afc6-7d829039738e nodeName:}" failed. No retries permitted until 2026-09-11 19:33:42.141573219 +0000 UTC m=+256.375646618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n2tfr" (UID: "aa43f2be-8cbd-4298-afc6-7d829039738e") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:33:42.012873 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:42.012847    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/1.log"
Sep 11 19:33:42.013312 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:42.013227    2578 scope.go:117] "RemoveContainer" containerID="661d9f8e80fa5b2561db7971dff78641620f64ddd48bd1d38ca4bf3656938b02"
Sep 11 19:33:42.013452 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:42.013433    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-kcmtv_openshift-console-operator(82e402d8-49e7-48bb-9d9c-b64ff6b64e9e)\"" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" podUID="82e402d8-49e7-48bb-9d9c-b64ff6b64e9e"
Sep 11 19:33:42.151270 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:42.151233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:42.151355 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:42.151339    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:33:42.151390 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:42.151362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:42.151423 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:42.151392    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm podName:aa43f2be-8cbd-4298-afc6-7d829039738e nodeName:}" failed. No retries permitted until 2026-09-11 19:33:44.151378096 +0000 UTC m=+258.385451500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n2tfr" (UID: "aa43f2be-8cbd-4298-afc6-7d829039738e") : configmap "kube-rbac-proxy" not found
Sep 11 19:33:42.151481 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:42.151455    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:33:42.151530 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:42.151506    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls podName:aa43f2be-8cbd-4298-afc6-7d829039738e nodeName:}" failed. No retries permitted until 2026-09-11 19:33:44.151491013 +0000 UTC m=+258.385564424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n2tfr" (UID: "aa43f2be-8cbd-4298-afc6-7d829039738e") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:33:43.017908 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:43.017877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb" event={"ID":"cf231fad-024c-4086-97f1-144d81d4f4b8","Type":"ContainerStarted","Data":"44d3194b767ccd029de8287b3bd3252f04f57fcf54daf9535a32d43c898c7ef2"}
Sep 11 19:33:43.018291 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:43.017928    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb" event={"ID":"cf231fad-024c-4086-97f1-144d81d4f4b8","Type":"ContainerStarted","Data":"9a318796b06df152c8932a4f18d3b7041a41bc7b2cc1a63b58ffbc4fd34106c3"}
Sep 11 19:33:43.034090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:43.034048    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7mmwb" podStartSLOduration=1.8044612899999999 podStartE2EDuration="3.034031679s" totalImagesPullingTime="1.229570389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:33:43.033863281 +0000 UTC m=+257.267936702" watchObservedRunningTime="2026-09-11 19:33:43.034031679 +0000 UTC m=+257.268105097"
Sep 11 19:33:43.066077 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:43.066054    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-csxbt_5872393d-579f-412d-8edc-bfb8b84c2492/dns-node-resolver/0.log"
Sep 11 19:33:43.964605 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:43.964568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:43.964782 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:43.964718    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:43.964819 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:43.964784    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls podName:f6188ee1-7af8-498b-8361-0733f5531394 nodeName:}" failed. No retries permitted until 2026-09-11 19:33:51.964769754 +0000 UTC m=+266.198843152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2ftt4" (UID: "f6188ee1-7af8-498b-8361-0733f5531394") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:44.065447 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:44.065408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:44.065447 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:44.065444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:44.065806 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:44.065561    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:33:44.065806 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:44.065591    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle podName:c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f nodeName:}" failed. No retries permitted until 2026-09-11 19:33:52.065573247 +0000 UTC m=+266.299646651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle") pod "router-default-57b5479c4b-82pb9" (UID: "c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f") : configmap references non-existent config key: service-ca.crt
Sep 11 19:33:44.065806 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:44.065613    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs podName:c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f nodeName:}" failed. No retries permitted until 2026-09-11 19:33:52.065606242 +0000 UTC m=+266.299679641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs") pod "router-default-57b5479c4b-82pb9" (UID: "c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f") : secret "router-metrics-certs-default" not found
Sep 11 19:33:44.166176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:44.166141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:44.166353 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:44.166215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:44.166353 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:44.166250    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:33:44.166353 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:44.166350    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm podName:aa43f2be-8cbd-4298-afc6-7d829039738e nodeName:}" failed. No retries permitted until 2026-09-11 19:33:48.166334199 +0000 UTC m=+262.400407599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n2tfr" (UID: "aa43f2be-8cbd-4298-afc6-7d829039738e") : configmap "kube-rbac-proxy" not found
Sep 11 19:33:44.166459 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:44.166356    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:33:44.166459 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:44.166401    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls podName:aa43f2be-8cbd-4298-afc6-7d829039738e nodeName:}" failed. No retries permitted until 2026-09-11 19:33:48.166385563 +0000 UTC m=+262.400458961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n2tfr" (UID: "aa43f2be-8cbd-4298-afc6-7d829039738e") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:33:44.263833 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:44.263766    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rq2xf_2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc/node-ca/0.log"
Sep 11 19:33:45.063485 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:45.063446    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqj7n_05887d0c-30a1-4f39-a721-349343bcd827/serve-healthcheck-canary/0.log"
Sep 11 19:33:45.463814 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:45.463739    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-7mmwb_cf231fad-024c-4086-97f1-144d81d4f4b8/migrator/0.log"
Sep 11 19:33:45.663020 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:45.662979    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-7mmwb_cf231fad-024c-4086-97f1-144d81d4f4b8/graceful-termination/0.log"
Sep 11 19:33:45.879356 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:45.879330    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-pnqh4_bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e/kube-storage-version-migrator-operator/0.log"
Sep 11 19:33:46.463714 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:46.463676    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:46.463886 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:46.463729    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:33:46.464166 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:46.464048    2578 scope.go:117] "RemoveContainer" containerID="661d9f8e80fa5b2561db7971dff78641620f64ddd48bd1d38ca4bf3656938b02"
Sep 11 19:33:46.464198 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:46.464181    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-kcmtv_openshift-console-operator(82e402d8-49e7-48bb-9d9c-b64ff6b64e9e)\"" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" podUID="82e402d8-49e7-48bb-9d9c-b64ff6b64e9e"
Sep 11 19:33:48.196901 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:48.196816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:48.196901 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:48.196877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:48.197326 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:48.196942    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:33:48.197326 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:48.196980    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:33:48.197326 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:48.196994    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm podName:aa43f2be-8cbd-4298-afc6-7d829039738e nodeName:}" failed. No retries permitted until 2026-09-11 19:33:56.196981021 +0000 UTC m=+270.431054420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n2tfr" (UID: "aa43f2be-8cbd-4298-afc6-7d829039738e") : configmap "kube-rbac-proxy" not found
Sep 11 19:33:48.197326 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:48.197032    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls podName:aa43f2be-8cbd-4298-afc6-7d829039738e nodeName:}" failed. No retries permitted until 2026-09-11 19:33:56.197019484 +0000 UTC m=+270.431092883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n2tfr" (UID: "aa43f2be-8cbd-4298-afc6-7d829039738e") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:33:52.027014 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:52.026966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:33:52.027443 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:52.027115    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:52.027443 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:52.027187    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls podName:f6188ee1-7af8-498b-8361-0733f5531394 nodeName:}" failed. No retries permitted until 2026-09-11 19:34:08.027172394 +0000 UTC m=+282.261245792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-2ftt4" (UID: "f6188ee1-7af8-498b-8361-0733f5531394") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:33:52.127368 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:52.127331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:52.127368 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:52.127368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:52.128072 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:52.128046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-service-ca-bundle\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:52.129977 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:52.129959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f-metrics-certs\") pod \"router-default-57b5479c4b-82pb9\" (UID: \"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f\") " pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:52.256153 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:52.256124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:52.527552 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:52.527510    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57b5479c4b-82pb9"]
Sep 11 19:33:52.530150 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:33:52.530108    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ccfd5b_fb8a_40d5_81fb_a8cfe305e10f.slice/crio-7a2a55ecb6194b725ad766ec4a682fb2bfc761cafd74cb2b60de1a3cbd79bebd WatchSource:0}: Error finding container 7a2a55ecb6194b725ad766ec4a682fb2bfc761cafd74cb2b60de1a3cbd79bebd: Status 404 returned error can't find the container with id 7a2a55ecb6194b725ad766ec4a682fb2bfc761cafd74cb2b60de1a3cbd79bebd
Sep 11 19:33:53.050945 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:53.050908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57b5479c4b-82pb9" event={"ID":"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f","Type":"ContainerStarted","Data":"4e0b23c6c15acb3104dc3ab7ffcbcbe7ebd41b3d53d2df9d2f4b298faeda0ab7"}
Sep 11 19:33:53.051302 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:53.050960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57b5479c4b-82pb9" event={"ID":"c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f","Type":"ContainerStarted","Data":"7a2a55ecb6194b725ad766ec4a682fb2bfc761cafd74cb2b60de1a3cbd79bebd"}
Sep 11 19:33:53.071426 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:53.071386    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-57b5479c4b-82pb9" podStartSLOduration=17.0713729 podStartE2EDuration="17.0713729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:33:53.070498649 +0000 UTC m=+267.304572070" watchObservedRunningTime="2026-09-11 19:33:53.0713729 +0000 UTC m=+267.305446321"
Sep 11 19:33:53.256819 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:53.256789    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:53.259206 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:53.259181    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:54.053530 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:54.053499    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:54.054776 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:54.054762    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-57b5479c4b-82pb9"
Sep 11 19:33:56.258620 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:56.258589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:56.259093 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:56.258647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:56.259154 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:56.259098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa43f2be-8cbd-4298-afc6-7d829039738e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:56.261107 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:56.261086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa43f2be-8cbd-4298-afc6-7d829039738e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2tfr\" (UID: \"aa43f2be-8cbd-4298-afc6-7d829039738e\") " pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:56.415516 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:56.415481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n2tfr"
Sep 11 19:33:56.683731 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:56.683696    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n2tfr"]
Sep 11 19:33:56.687194 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:33:56.687161    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa43f2be_8cbd_4298_afc6_7d829039738e.slice/crio-ea2f0c3da0f56bcfcd0e4c5d8226715787f4148039499947169ee531185924ec WatchSource:0}: Error finding container ea2f0c3da0f56bcfcd0e4c5d8226715787f4148039499947169ee531185924ec: Status 404 returned error can't find the container with id ea2f0c3da0f56bcfcd0e4c5d8226715787f4148039499947169ee531185924ec
Sep 11 19:33:57.065545 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:57.065516    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n2tfr" event={"ID":"aa43f2be-8cbd-4298-afc6-7d829039738e","Type":"ContainerStarted","Data":"5d8f592ff02b3d80b9d2a482295f9d757ef7e9bc70a88c3ed5bbed6b5dfcc5d3"}
Sep 11 19:33:57.065678 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:57.065593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n2tfr" event={"ID":"aa43f2be-8cbd-4298-afc6-7d829039738e","Type":"ContainerStarted","Data":"ea2f0c3da0f56bcfcd0e4c5d8226715787f4148039499947169ee531185924ec"}
Sep 11 19:33:58.070393 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:58.070354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n2tfr" event={"ID":"aa43f2be-8cbd-4298-afc6-7d829039738e","Type":"ContainerStarted","Data":"e64e099d2804a48b01cf15c925034a872f712ba98b4f76993d6c0c868ae9d7c8"}
Sep 11 19:33:58.251419 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:58.251392    2578 scope.go:117] "RemoveContainer" containerID="661d9f8e80fa5b2561db7971dff78641620f64ddd48bd1d38ca4bf3656938b02"
Sep 11 19:33:59.075494 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:59.075471    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:33:59.075879 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:59.075854    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/1.log"
Sep 11 19:33:59.075938 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:59.075884    2578 generic.go:356] "Generic (PLEG): container finished" podID="82e402d8-49e7-48bb-9d9c-b64ff6b64e9e" containerID="a76036d4ad2652acb5c7828a90ba892fa04a3270c953bfaafa4221bb09d83d89" exitCode=255
Sep 11 19:33:59.075981 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:59.075955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" event={"ID":"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e","Type":"ContainerDied","Data":"a76036d4ad2652acb5c7828a90ba892fa04a3270c953bfaafa4221bb09d83d89"}
Sep 11 19:33:59.076027 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:59.076011    2578 scope.go:117] "RemoveContainer" containerID="661d9f8e80fa5b2561db7971dff78641620f64ddd48bd1d38ca4bf3656938b02"
Sep 11 19:33:59.076329 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:59.076313    2578 scope.go:117] "RemoveContainer" containerID="a76036d4ad2652acb5c7828a90ba892fa04a3270c953bfaafa4221bb09d83d89"
Sep 11 19:33:59.076504 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:33:59.076485    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-kcmtv_openshift-console-operator(82e402d8-49e7-48bb-9d9c-b64ff6b64e9e)\"" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" podUID="82e402d8-49e7-48bb-9d9c-b64ff6b64e9e"
Sep 11 19:33:59.078112 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:59.078090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n2tfr" event={"ID":"aa43f2be-8cbd-4298-afc6-7d829039738e","Type":"ContainerStarted","Data":"4c3eaf81ffce515bcc8427c5cfe7493bbe7128e61b3c80bca6632004577a87cb"}
Sep 11 19:33:59.110105 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:33:59.110063    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n2tfr" podStartSLOduration=17.081093867 podStartE2EDuration="19.110047996s" totalImagesPullingTime="2.028954129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:33:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:33:59.109198201 +0000 UTC m=+273.343271616" watchObservedRunningTime="2026-09-11 19:33:59.110047996 +0000 UTC m=+273.344121432"
Sep 11 19:34:00.083498 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:00.083468    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:34:02.146658 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.146627    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d5f659b96-k46cs"]
Sep 11 19:34:02.150025 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.150001    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.153887 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.153859    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5wflx\""
Sep 11 19:34:02.153887 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.153859    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 19:34:02.154045 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.153895    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 19:34:02.154045 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.153906    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 19:34:02.159634 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.159617    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 19:34:02.165111 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.165092    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5f659b96-k46cs"]
Sep 11 19:34:02.201515 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.201488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-trusted-ca\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.201643 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.201519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-ca-trust-extracted\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.201643 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.201566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-image-registry-private-configuration\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.201643 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.201628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn989\" (UniqueName: \"kubernetes.io/projected/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-kube-api-access-jn989\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.201811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.201654    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-registry-tls\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.201811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.201676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-installation-pull-secrets\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.201811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.201735    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-bound-sa-token\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.201811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.201774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-registry-certificates\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.303123 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.303086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-image-registry-private-configuration\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.303123 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.303123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn989\" (UniqueName: \"kubernetes.io/projected/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-kube-api-access-jn989\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.303405 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.303141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-registry-tls\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.303405 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.303162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-installation-pull-secrets\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.303405 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.303190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-bound-sa-token\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.303405 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.303216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-registry-certificates\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.303405 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.303287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-trusted-ca\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.303405 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.303314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-ca-trust-extracted\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.303727 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.303711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-ca-trust-extracted\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.304326 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.304291    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-registry-certificates\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.304433 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.304301    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-trusted-ca\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.305836 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.305815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-image-registry-private-configuration\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.305960 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.305937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-installation-pull-secrets\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.306025 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.306012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-registry-tls\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.313110 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.313086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-bound-sa-token\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.313279 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.313239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn989\" (UniqueName: \"kubernetes.io/projected/dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89-kube-api-access-jn989\") pod \"image-registry-5d5f659b96-k46cs\" (UID: \"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89\") " pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.460353 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.460246    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:02.733199 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:02.733121    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5f659b96-k46cs"]
Sep 11 19:34:02.736148 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:34:02.736117    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcab1ffc_45e4_48e4_8d9b_65ecb68e9d89.slice/crio-4c637cd4ff3abe60dec9c596c7b51e8ef774e11e0fe9e24a98967dcc47cb6a52 WatchSource:0}: Error finding container 4c637cd4ff3abe60dec9c596c7b51e8ef774e11e0fe9e24a98967dcc47cb6a52: Status 404 returned error can't find the container with id 4c637cd4ff3abe60dec9c596c7b51e8ef774e11e0fe9e24a98967dcc47cb6a52
Sep 11 19:34:03.095375 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:03.095343    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5f659b96-k46cs" event={"ID":"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89","Type":"ContainerStarted","Data":"0dd58101b89d643a6b91e38d4aea70eaff09ba9bc6761ef560fe14eda24ab927"}
Sep 11 19:34:03.095516 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:03.095389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5f659b96-k46cs" event={"ID":"dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89","Type":"ContainerStarted","Data":"4c637cd4ff3abe60dec9c596c7b51e8ef774e11e0fe9e24a98967dcc47cb6a52"}
Sep 11 19:34:03.095516 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:03.095418    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:03.119749 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:03.119692    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d5f659b96-k46cs" podStartSLOduration=1.119673777 podStartE2EDuration="1.119673777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:03.118145266 +0000 UTC m=+277.352218698" watchObservedRunningTime="2026-09-11 19:34:03.119673777 +0000 UTC m=+277.353747199"
Sep 11 19:34:06.464239 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:06.464192    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:34:06.464239 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:06.464275    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:34:06.464665 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:06.464579    2578 scope.go:117] "RemoveContainer" containerID="a76036d4ad2652acb5c7828a90ba892fa04a3270c953bfaafa4221bb09d83d89"
Sep 11 19:34:06.464752 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:34:06.464733    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-kcmtv_openshift-console-operator(82e402d8-49e7-48bb-9d9c-b64ff6b64e9e)\"" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" podUID="82e402d8-49e7-48bb-9d9c-b64ff6b64e9e"
Sep 11 19:34:06.760607 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:34:06.760522    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6gvkd" podUID="33a886a5-12de-4d3a-a526-be3331fdc058"
Sep 11 19:34:07.109515 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:07.109486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:34:08.045001 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:08.044963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:34:08.047456 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:08.047437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6188ee1-7af8-498b-8361-0733f5531394-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-2ftt4\" (UID: \"f6188ee1-7af8-498b-8361-0733f5531394\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:34:08.067293 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:08.067271    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"
Sep 11 19:34:08.334445 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:08.334416    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4"]
Sep 11 19:34:08.337068 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:34:08.337034    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6188ee1_7af8_498b_8361_0733f5531394.slice/crio-da42b2d5618f6810df136f00f4ac5113ea48b7854ef23922bb0994b50097374e WatchSource:0}: Error finding container da42b2d5618f6810df136f00f4ac5113ea48b7854ef23922bb0994b50097374e: Status 404 returned error can't find the container with id da42b2d5618f6810df136f00f4ac5113ea48b7854ef23922bb0994b50097374e
Sep 11 19:34:09.118400 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:09.118366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4" event={"ID":"f6188ee1-7af8-498b-8361-0733f5531394","Type":"ContainerStarted","Data":"da42b2d5618f6810df136f00f4ac5113ea48b7854ef23922bb0994b50097374e"}
Sep 11 19:34:10.563220 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:10.563198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:34:10.565565 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:10.565546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33a886a5-12de-4d3a-a526-be3331fdc058-metrics-tls\") pod \"dns-default-6gvkd\" (UID: \"33a886a5-12de-4d3a-a526-be3331fdc058\") " pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:34:10.713099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:10.713063    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6smxv\""
Sep 11 19:34:10.720473 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:10.720452    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:34:10.991738 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:10.991665    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6gvkd"]
Sep 11 19:34:10.994986 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:34:10.994961    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a886a5_12de_4d3a_a526_be3331fdc058.slice/crio-ab16c1d37a9d69e6d76155f7cc8a02980e2c0a71a81f726e95d74743a307bc01 WatchSource:0}: Error finding container ab16c1d37a9d69e6d76155f7cc8a02980e2c0a71a81f726e95d74743a307bc01: Status 404 returned error can't find the container with id ab16c1d37a9d69e6d76155f7cc8a02980e2c0a71a81f726e95d74743a307bc01
Sep 11 19:34:11.126193 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:11.126159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4" event={"ID":"f6188ee1-7af8-498b-8361-0733f5531394","Type":"ContainerStarted","Data":"2baad4f2d85a169e418392900c6c049582c6da8f19bca99368213e5a4c0a9f6a"}
Sep 11 19:34:11.127454 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:11.127435    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gvkd" event={"ID":"33a886a5-12de-4d3a-a526-be3331fdc058","Type":"ContainerStarted","Data":"ab16c1d37a9d69e6d76155f7cc8a02980e2c0a71a81f726e95d74743a307bc01"}
Sep 11 19:34:11.142652 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:11.142542    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-2ftt4" podStartSLOduration=33.362541187 podStartE2EDuration="35.142524625s" totalImagesPullingTime="1.779983438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:11.142496771 +0000 UTC m=+285.376570193" watchObservedRunningTime="2026-09-11 19:34:11.142524625 +0000 UTC m=+285.376598025"
Sep 11 19:34:13.136551 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:13.136517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gvkd" event={"ID":"33a886a5-12de-4d3a-a526-be3331fdc058","Type":"ContainerStarted","Data":"025fcde784b31a204837b4e5fa4d1da4753b35abe74f8f889ced26db97052414"}
Sep 11 19:34:13.136949 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:13.136574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6gvkd" event={"ID":"33a886a5-12de-4d3a-a526-be3331fdc058","Type":"ContainerStarted","Data":"6d19b646f1ad328148e51a0b7f61b657cb795a06ef3ca1ae93c1d9dbf11e42e0"}
Sep 11 19:34:13.136949 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:13.136670    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:34:13.156490 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:13.156446    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6gvkd" podStartSLOduration=251.711080888 podStartE2EDuration="4m13.156430861s" totalImagesPullingTime="1.445349973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:13.155898628 +0000 UTC m=+287.389972049" watchObservedRunningTime="2026-09-11 19:34:13.156430861 +0000 UTC m=+287.390504282"
Sep 11 19:34:18.251603 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:18.251571    2578 scope.go:117] "RemoveContainer" containerID="a76036d4ad2652acb5c7828a90ba892fa04a3270c953bfaafa4221bb09d83d89"
Sep 11 19:34:18.251991 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:34:18.251734    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-kcmtv_openshift-console-operator(82e402d8-49e7-48bb-9d9c-b64ff6b64e9e)\"" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" podUID="82e402d8-49e7-48bb-9d9c-b64ff6b64e9e"
Sep 11 19:34:19.012443 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.012409    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tnn2z"]
Sep 11 19:34:19.014507 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.014493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.017287 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.017251    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 19:34:19.017501 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.017485    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 19:34:19.017582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.017488    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 19:34:19.018530 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.018508    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 19:34:19.018638 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.018510    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7lgv6\""
Sep 11 19:34:19.129309 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.129250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42aea996-aa20-4104-8165-53908543c58e-root\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.129309 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.129308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42aea996-aa20-4104-8165-53908543c58e-sys\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.129548 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.129383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42aea996-aa20-4104-8165-53908543c58e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.129548 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.129426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42aea996-aa20-4104-8165-53908543c58e-metrics-client-ca\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.129548 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.129455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm5bg\" (UniqueName: \"kubernetes.io/projected/42aea996-aa20-4104-8165-53908543c58e-kube-api-access-sm5bg\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.129548 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.129483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42aea996-aa20-4104-8165-53908543c58e-node-exporter-wtmp\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.129684 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.129557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42aea996-aa20-4104-8165-53908543c58e-node-exporter-tls\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.129684 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.129591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42aea996-aa20-4104-8165-53908543c58e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.129684 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.129624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42aea996-aa20-4104-8165-53908543c58e-node-exporter-textfile\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230336 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230307    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42aea996-aa20-4104-8165-53908543c58e-node-exporter-wtmp\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230493 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42aea996-aa20-4104-8165-53908543c58e-node-exporter-tls\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230493 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42aea996-aa20-4104-8165-53908543c58e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230493 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42aea996-aa20-4104-8165-53908543c58e-node-exporter-textfile\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42aea996-aa20-4104-8165-53908543c58e-node-exporter-wtmp\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42aea996-aa20-4104-8165-53908543c58e-root\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230549    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42aea996-aa20-4104-8165-53908543c58e-root\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42aea996-aa20-4104-8165-53908543c58e-sys\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230589    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42aea996-aa20-4104-8165-53908543c58e-sys\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230643    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42aea996-aa20-4104-8165-53908543c58e-node-exporter-textfile\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42aea996-aa20-4104-8165-53908543c58e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230906 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42aea996-aa20-4104-8165-53908543c58e-metrics-client-ca\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.230906 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.230731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm5bg\" (UniqueName: \"kubernetes.io/projected/42aea996-aa20-4104-8165-53908543c58e-kube-api-access-sm5bg\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.231170 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.231151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42aea996-aa20-4104-8165-53908543c58e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.231230 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.231215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42aea996-aa20-4104-8165-53908543c58e-metrics-client-ca\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.233352 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.233327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42aea996-aa20-4104-8165-53908543c58e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.233532 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.233512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42aea996-aa20-4104-8165-53908543c58e-node-exporter-tls\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.240342 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.240319    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm5bg\" (UniqueName: \"kubernetes.io/projected/42aea996-aa20-4104-8165-53908543c58e-kube-api-access-sm5bg\") pod \"node-exporter-tnn2z\" (UID: \"42aea996-aa20-4104-8165-53908543c58e\") " pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.323687 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:19.323657    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tnn2z"
Sep 11 19:34:19.333925 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:34:19.333901    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42aea996_aa20_4104_8165_53908543c58e.slice/crio-16c1d7f3aad200fc50ca710f6ef2ef7825d7e7e7b72d8be74a86feffbb45245c WatchSource:0}: Error finding container 16c1d7f3aad200fc50ca710f6ef2ef7825d7e7e7b72d8be74a86feffbb45245c: Status 404 returned error can't find the container with id 16c1d7f3aad200fc50ca710f6ef2ef7825d7e7e7b72d8be74a86feffbb45245c
Sep 11 19:34:20.044064 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.044029    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:34:20.047080 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.047062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.050079 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.050055    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-75bsp\""
Sep 11 19:34:20.050462 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.050420    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 19:34:20.050462 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.050431    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 19:34:20.050612 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.050431    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 19:34:20.050612 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.050577    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 19:34:20.050729 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.050710    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 19:34:20.050859 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.050844    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 19:34:20.051210 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.051039    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 19:34:20.051210 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.051043    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 19:34:20.051210 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.051085    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 19:34:20.063860 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.063838    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:34:20.136857 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.136828    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-web-config\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137021 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.136865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137021 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.136893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137021 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.136917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137021 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.137001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137253 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.137051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137253 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.137096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-out\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137253 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.137161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137253 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.137192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137253 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.137216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137253 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.137238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgsh4\" (UniqueName: \"kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-kube-api-access-wgsh4\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137503 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.137319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.137503 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.137358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.160551 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.160518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnn2z" event={"ID":"42aea996-aa20-4104-8165-53908543c58e","Type":"ContainerStarted","Data":"16c1d7f3aad200fc50ca710f6ef2ef7825d7e7e7b72d8be74a86feffbb45245c"}
Sep 11 19:34:20.240126 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240126 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240386 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240386 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgsh4\" (UniqueName: \"kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-kube-api-access-wgsh4\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240386 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240205    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240386 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240386 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-web-config\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240386 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:34:20.240292    2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 11 19:34:20.240386 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240386 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240386 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:34:20.240374    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-main-tls podName:5e4e9060-6ba2-46e3-bc5b-c5095126490b nodeName:}" failed. No retries permitted until 2026-09-11 19:34:20.740352471 +0000 UTC m=+294.974425889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b") : secret "alertmanager-main-tls" not found
Sep 11 19:34:20.240753 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240753 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240753 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.240753 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.240513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-out\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.241401 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.241377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.242561 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.241966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.242561 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.242099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.243698 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.243654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.245749 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.245723    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-web-config\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.245955 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.245933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.246177 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.246160    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.246291 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.246251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.246571 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.246548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-out\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.246988 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.246921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.248286 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.248237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.252842 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.252801    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgsh4\" (UniqueName: \"kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-kube-api-access-wgsh4\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.744274 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.744180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.746673 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.746644    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:20.958122 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:20.958085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:34:21.007468 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.007442    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-854b59dffc-b5pmx"]
Sep 11 19:34:21.010650 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.010626    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.013615 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.013591    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 11 19:34:21.013723 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.013646    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 11 19:34:21.014905 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.014705    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 11 19:34:21.015248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.015057    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 11 19:34:21.015248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.015121    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sqxgv\""
Sep 11 19:34:21.015248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.015228    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 11 19:34:21.015462 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.015337    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cfqg465522g1i\""
Sep 11 19:34:21.021962 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.021939    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-854b59dffc-b5pmx"]
Sep 11 19:34:21.147347 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.147310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plhh7\" (UniqueName: \"kubernetes.io/projected/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-kube-api-access-plhh7\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.147530 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.147385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.147530 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.147414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-metrics-client-ca\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.147530 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.147454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-grpc-tls\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.147631 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.147535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.147631 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.147565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.147631 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.147589    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-tls\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.147631 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.147610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.169854 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.169822    2578 generic.go:356] "Generic (PLEG): container finished" podID="42aea996-aa20-4104-8165-53908543c58e" containerID="653c8b5ad310bd65be75bd67726586061e764b64917bd30444e35a691bf38663" exitCode=0
Sep 11 19:34:21.170031 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.169887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnn2z" event={"ID":"42aea996-aa20-4104-8165-53908543c58e","Type":"ContainerDied","Data":"653c8b5ad310bd65be75bd67726586061e764b64917bd30444e35a691bf38663"}
Sep 11 19:34:21.239526 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.239500    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:34:21.241686 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:34:21.241662    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4e9060_6ba2_46e3_bc5b_c5095126490b.slice/crio-e021442a747f9c31d7b68705b900b4246aaef6a296c1c1029bd0a0ed59ca1b77 WatchSource:0}: Error finding container e021442a747f9c31d7b68705b900b4246aaef6a296c1c1029bd0a0ed59ca1b77: Status 404 returned error can't find the container with id e021442a747f9c31d7b68705b900b4246aaef6a296c1c1029bd0a0ed59ca1b77
Sep 11 19:34:21.248353 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.248328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhh7\" (UniqueName: \"kubernetes.io/projected/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-kube-api-access-plhh7\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.248450 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.248410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.248450 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.248437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-metrics-client-ca\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.248561 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.248461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-grpc-tls\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.248561 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.248506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.248561 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.248545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.248707 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.248569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-tls\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.248707 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.248597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.249731 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.249709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-metrics-client-ca\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.251716 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.251674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.251855 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.251813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.251953 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.251870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-grpc-tls\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.251953 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.251942    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.252071 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.251955    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-tls\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.252680 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.252660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.256418 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.256368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plhh7\" (UniqueName: \"kubernetes.io/projected/d9dec28a-2042-484e-8cbc-2d48b8e4aaa2-kube-api-access-plhh7\") pod \"thanos-querier-854b59dffc-b5pmx\" (UID: \"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2\") " pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.323463 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.323422    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:21.599850 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:21.599511    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-854b59dffc-b5pmx"]
Sep 11 19:34:21.601993 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:34:21.601966    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9dec28a_2042_484e_8cbc_2d48b8e4aaa2.slice/crio-ef8d3b2ea06e88fa76f4df621fa31233e31f5c3603197a936e3977ac7220863a WatchSource:0}: Error finding container ef8d3b2ea06e88fa76f4df621fa31233e31f5c3603197a936e3977ac7220863a: Status 404 returned error can't find the container with id ef8d3b2ea06e88fa76f4df621fa31233e31f5c3603197a936e3977ac7220863a
Sep 11 19:34:22.177597 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:22.177547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnn2z" event={"ID":"42aea996-aa20-4104-8165-53908543c58e","Type":"ContainerStarted","Data":"323ce6e62650c0b217f817eb5d412329253f342d09254274dad290837382e37b"}
Sep 11 19:34:22.178066 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:22.177617    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tnn2z" event={"ID":"42aea996-aa20-4104-8165-53908543c58e","Type":"ContainerStarted","Data":"094f78965af9fa8a22ff2a93d1b3b867889366d08ea1eee2e1b1fd160654aa02"}
Sep 11 19:34:22.178998 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:22.178915    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerStarted","Data":"e021442a747f9c31d7b68705b900b4246aaef6a296c1c1029bd0a0ed59ca1b77"}
Sep 11 19:34:22.180603 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:22.180569    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx" event={"ID":"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2","Type":"ContainerStarted","Data":"ef8d3b2ea06e88fa76f4df621fa31233e31f5c3603197a936e3977ac7220863a"}
Sep 11 19:34:22.251810 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:34:22.251763    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bw2r8" podUID="d3883618-051d-4804-aa8d-222af6c1e9f7"
Sep 11 19:34:22.465407 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:22.465313    2578 patch_prober.go:28] interesting pod/image-registry-5d5f659b96-k46cs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 19:34:22.465407 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:22.465376    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d5f659b96-k46cs" podUID="dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:34:23.142013 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.141980    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6gvkd"
Sep 11 19:34:23.161486 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.161424    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tnn2z" podStartSLOduration=4.057416838 podStartE2EDuration="5.161401476s" totalImagesPullingTime="1.034732949s" totalInitContainerRuntime="69.251689ms" isStatefulPod=true podCreationTimestamp="2026-09-11 19:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:22.198316597 +0000 UTC m=+296.432390019" watchObservedRunningTime="2026-09-11 19:34:23.161401476 +0000 UTC m=+297.395474899"
Sep 11 19:34:23.187457 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.187420    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerID="314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164" exitCode=0
Sep 11 19:34:23.187900 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.187509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerDied","Data":"314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164"}
Sep 11 19:34:23.742454 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.742434    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"]
Sep 11 19:34:23.744482 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.744464    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"
Sep 11 19:34:23.747184 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.747055    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 19:34:23.747184 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.747063    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cbjmx\""
Sep 11 19:34:23.753380 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.753342    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"]
Sep 11 19:34:23.874441 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.874348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn8jp\" (UniqueName: \"kubernetes.io/projected/90a0938b-6206-4ac6-9125-86c3fc255d7d-kube-api-access-cn8jp\") pod \"monitoring-plugin-5d85778b9d-jls84\" (UID: \"90a0938b-6206-4ac6-9125-86c3fc255d7d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"
Sep 11 19:34:23.874587 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.874518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90a0938b-6206-4ac6-9125-86c3fc255d7d-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jls84\" (UID: \"90a0938b-6206-4ac6-9125-86c3fc255d7d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"
Sep 11 19:34:23.975322 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.975279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90a0938b-6206-4ac6-9125-86c3fc255d7d-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jls84\" (UID: \"90a0938b-6206-4ac6-9125-86c3fc255d7d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"
Sep 11 19:34:23.975513 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.975348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn8jp\" (UniqueName: \"kubernetes.io/projected/90a0938b-6206-4ac6-9125-86c3fc255d7d-kube-api-access-cn8jp\") pod \"monitoring-plugin-5d85778b9d-jls84\" (UID: \"90a0938b-6206-4ac6-9125-86c3fc255d7d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"
Sep 11 19:34:23.975513 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:34:23.975412    2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 11 19:34:23.975513 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:34:23.975493    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90a0938b-6206-4ac6-9125-86c3fc255d7d-monitoring-plugin-cert podName:90a0938b-6206-4ac6-9125-86c3fc255d7d nodeName:}" failed. No retries permitted until 2026-09-11 19:34:24.475471569 +0000 UTC m=+298.709544968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/90a0938b-6206-4ac6-9125-86c3fc255d7d-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-jls84" (UID: "90a0938b-6206-4ac6-9125-86c3fc255d7d") : secret "monitoring-plugin-cert" not found
Sep 11 19:34:23.984540 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:23.984511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn8jp\" (UniqueName: \"kubernetes.io/projected/90a0938b-6206-4ac6-9125-86c3fc255d7d-kube-api-access-cn8jp\") pod \"monitoring-plugin-5d85778b9d-jls84\" (UID: \"90a0938b-6206-4ac6-9125-86c3fc255d7d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"
Sep 11 19:34:24.103637 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:24.103609    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d5f659b96-k46cs"
Sep 11 19:34:24.200634 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:24.200539    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx" event={"ID":"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2","Type":"ContainerStarted","Data":"e5f08213475a338f45fd6c8d13797d269c1d481ebdcd494c03efefe855f0a782"}
Sep 11 19:34:24.201007 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:24.200657    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx" event={"ID":"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2","Type":"ContainerStarted","Data":"66878d569ed0dbeb73aa0b8b21329439ed6353d22107d13364de4be32f919b75"}
Sep 11 19:34:24.201007 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:24.200698    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx" event={"ID":"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2","Type":"ContainerStarted","Data":"832130afbe78c5c6bf803a4d95e43038ae50eaf55eb7f629f9085b7a27474f67"}
Sep 11 19:34:24.480153 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:24.480052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90a0938b-6206-4ac6-9125-86c3fc255d7d-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jls84\" (UID: \"90a0938b-6206-4ac6-9125-86c3fc255d7d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"
Sep 11 19:34:24.483285 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:24.483228    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90a0938b-6206-4ac6-9125-86c3fc255d7d-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jls84\" (UID: \"90a0938b-6206-4ac6-9125-86c3fc255d7d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"
Sep 11 19:34:24.655362 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:24.655324    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"
Sep 11 19:34:25.057881 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.057855    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"]
Sep 11 19:34:25.061339 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:34:25.061310    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a0938b_6206_4ac6_9125_86c3fc255d7d.slice/crio-ed453c3adfc24610dd61c2ba2c21dba67b799da39ccbde7b6090e85c22dc625c WatchSource:0}: Error finding container ed453c3adfc24610dd61c2ba2c21dba67b799da39ccbde7b6090e85c22dc625c: Status 404 returned error can't find the container with id ed453c3adfc24610dd61c2ba2c21dba67b799da39ccbde7b6090e85c22dc625c
Sep 11 19:34:25.208462 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.208418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerStarted","Data":"11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d"}
Sep 11 19:34:25.208894 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.208488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerStarted","Data":"fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64"}
Sep 11 19:34:25.208894 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.208537    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerStarted","Data":"646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c"}
Sep 11 19:34:25.208894 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.208584    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerStarted","Data":"eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b"}
Sep 11 19:34:25.208894 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.208613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerStarted","Data":"ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c"}
Sep 11 19:34:25.208894 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.208634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerStarted","Data":"85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db"}
Sep 11 19:34:25.211630 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.211602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx" event={"ID":"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2","Type":"ContainerStarted","Data":"344e57523a91f1395841278b242a7e2e5f9d059be0e1d355365bae3193fe51a4"}
Sep 11 19:34:25.211755 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.211668    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx" event={"ID":"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2","Type":"ContainerStarted","Data":"57a5d9de1a82e0f50d874d53726405daa63be2c0ea6413bcfb1e747d491d2638"}
Sep 11 19:34:25.211755 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.211705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx" event={"ID":"d9dec28a-2042-484e-8cbc-2d48b8e4aaa2","Type":"ContainerStarted","Data":"f26741cade6345f605f69a892206aa7a17618d12a733e96b8c941ac78ab15362"}
Sep 11 19:34:25.211862 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.211841    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:25.212897 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.212870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84" event={"ID":"90a0938b-6206-4ac6-9125-86c3fc255d7d","Type":"ContainerStarted","Data":"ed453c3adfc24610dd61c2ba2c21dba67b799da39ccbde7b6090e85c22dc625c"}
Sep 11 19:34:25.252400 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.252348    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.358708152 podStartE2EDuration="5.25232715s" totalImagesPullingTime="2.875727204s" totalInitContainerRuntime="17.891794ms" isStatefulPod=false podCreationTimestamp="2026-09-11 19:34:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:25.250743275 +0000 UTC m=+299.484816708" watchObservedRunningTime="2026-09-11 19:34:25.25232715 +0000 UTC m=+299.486400571"
Sep 11 19:34:25.286850 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:25.286754    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx" podStartSLOduration=2.310010052 podStartE2EDuration="5.286736597s" totalImagesPullingTime="2.976726545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:34:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:25.28574963 +0000 UTC m=+299.519823051" watchObservedRunningTime="2026-09-11 19:34:25.286736597 +0000 UTC m=+299.520810017"
Sep 11 19:34:26.476934 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:26.476907    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:34:26.477553 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:26.477533    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:34:26.487848 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:26.487829    2578 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 19:34:27.223332 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:27.223296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84" event={"ID":"90a0938b-6206-4ac6-9125-86c3fc255d7d","Type":"ContainerStarted","Data":"8ec063a6c092dff9338b3b57ed382aa6621ff1b91038137db3b1d8395a9002d2"}
Sep 11 19:34:27.223522 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:27.223461    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"
Sep 11 19:34:27.228138 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:27.228119    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84"
Sep 11 19:34:27.240088 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:27.240043    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jls84" podStartSLOduration=2.8341125 podStartE2EDuration="4.240028987s" totalImagesPullingTime="1.405916487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:27.238808279 +0000 UTC m=+301.472881701" watchObservedRunningTime="2026-09-11 19:34:27.240028987 +0000 UTC m=+301.474102408"
Sep 11 19:34:29.251219 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:29.251178    2578 scope.go:117] "RemoveContainer" containerID="a76036d4ad2652acb5c7828a90ba892fa04a3270c953bfaafa4221bb09d83d89"
Sep 11 19:34:30.236516 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.236491    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:34:30.236660 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.236609    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" event={"ID":"82e402d8-49e7-48bb-9d9c-b64ff6b64e9e","Type":"ContainerStarted","Data":"da6cf3cd49a1285569f27ae4ab41e27116a223456a3629e47aaa07e4bffec456"}
Sep 11 19:34:30.236926 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.236898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:34:30.255742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.255682    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv" podStartSLOduration=51.981059077 podStartE2EDuration="54.255664571s" totalImagesPullingTime="2.274605494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:30.25470678 +0000 UTC m=+304.488780200" watchObservedRunningTime="2026-09-11 19:34:30.255664571 +0000 UTC m=+304.489737994"
Sep 11 19:34:30.303550 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.303521    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-kcmtv"
Sep 11 19:34:30.477474 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.477441    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-cv8cv"]
Sep 11 19:34:30.479622 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.479603    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-cv8cv"
Sep 11 19:34:30.482211 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.482188    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 19:34:30.482388 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.482313    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 19:34:30.482525 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.482509    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-csp8h\""
Sep 11 19:34:30.492379 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.492325    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-cv8cv"]
Sep 11 19:34:30.636156 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.636120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82n7m\" (UniqueName: \"kubernetes.io/projected/2022384e-6b81-4d04-a091-44e464490a58-kube-api-access-82n7m\") pod \"downloads-76f99584f4-cv8cv\" (UID: \"2022384e-6b81-4d04-a091-44e464490a58\") " pod="openshift-console/downloads-76f99584f4-cv8cv"
Sep 11 19:34:30.737565 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.737529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82n7m\" (UniqueName: \"kubernetes.io/projected/2022384e-6b81-4d04-a091-44e464490a58-kube-api-access-82n7m\") pod \"downloads-76f99584f4-cv8cv\" (UID: \"2022384e-6b81-4d04-a091-44e464490a58\") " pod="openshift-console/downloads-76f99584f4-cv8cv"
Sep 11 19:34:30.747243 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.747178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82n7m\" (UniqueName: \"kubernetes.io/projected/2022384e-6b81-4d04-a091-44e464490a58-kube-api-access-82n7m\") pod \"downloads-76f99584f4-cv8cv\" (UID: \"2022384e-6b81-4d04-a091-44e464490a58\") " pod="openshift-console/downloads-76f99584f4-cv8cv"
Sep 11 19:34:30.788585 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:30.788557    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-cv8cv"
Sep 11 19:34:31.060949 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:31.060874    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-cv8cv"]
Sep 11 19:34:31.064394 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:34:31.064370    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2022384e_6b81_4d04_a091_44e464490a58.slice/crio-0fe38ae965dbf114426d9a3acc155647cb272381375e38162f4ef6fd34b64e70 WatchSource:0}: Error finding container 0fe38ae965dbf114426d9a3acc155647cb272381375e38162f4ef6fd34b64e70: Status 404 returned error can't find the container with id 0fe38ae965dbf114426d9a3acc155647cb272381375e38162f4ef6fd34b64e70
Sep 11 19:34:31.066712 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:31.066695    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:34:31.224309 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:31.224279    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-854b59dffc-b5pmx"
Sep 11 19:34:31.241828 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:31.241793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-cv8cv" event={"ID":"2022384e-6b81-4d04-a091-44e464490a58","Type":"ContainerStarted","Data":"0fe38ae965dbf114426d9a3acc155647cb272381375e38162f4ef6fd34b64e70"}
Sep 11 19:34:36.253786 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.253498    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:34:36.649150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.649115    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bcfc598b4-hznn8"]
Sep 11 19:34:36.651640 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.651614    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.656341 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.656294    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 19:34:36.656464 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.656346    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 19:34:36.656464 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.656354    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 19:34:36.656464 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.656364    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 19:34:36.656464 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.656363    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hnsfh\""
Sep 11 19:34:36.656662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.656572    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 19:34:36.664024 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.664001    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcfc598b4-hznn8"]
Sep 11 19:34:36.691846 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.691811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-config\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.692005 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.691874    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-oauth-serving-cert\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.692005 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.691913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qrgj\" (UniqueName: \"kubernetes.io/projected/4dcfe468-014a-49bd-8ed5-f7544dae7139-kube-api-access-8qrgj\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.692005 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.691976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-oauth-config\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.692005 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.692000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-serving-cert\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.692178 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.692016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-service-ca\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.792491 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.792397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-oauth-serving-cert\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.792674 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.792509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qrgj\" (UniqueName: \"kubernetes.io/projected/4dcfe468-014a-49bd-8ed5-f7544dae7139-kube-api-access-8qrgj\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.792674 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.792647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-oauth-config\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.792783 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.792682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-serving-cert\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.792783 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.792711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-service-ca\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.792783 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.792740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-config\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.793225 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.793191    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-oauth-serving-cert\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.793440 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.793407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-config\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.793599 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.793580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-service-ca\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.795868 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.795846    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-serving-cert\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.796248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.796228    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-oauth-config\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.805812 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.805791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qrgj\" (UniqueName: \"kubernetes.io/projected/4dcfe468-014a-49bd-8ed5-f7544dae7139-kube-api-access-8qrgj\") pod \"console-7bcfc598b4-hznn8\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") " pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:36.963956 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:36.963861    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:34:37.243078 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:37.242999    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcfc598b4-hznn8"]
Sep 11 19:34:37.246296 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:34:37.246238    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcfe468_014a_49bd_8ed5_f7544dae7139.slice/crio-ed3bd0b9a4482d3a412cfd02c7c80b0081adb02108471164a1c732a306bc8115 WatchSource:0}: Error finding container ed3bd0b9a4482d3a412cfd02c7c80b0081adb02108471164a1c732a306bc8115: Status 404 returned error can't find the container with id ed3bd0b9a4482d3a412cfd02c7c80b0081adb02108471164a1c732a306bc8115
Sep 11 19:34:37.269624 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:37.269592    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfc598b4-hznn8" event={"ID":"4dcfe468-014a-49bd-8ed5-f7544dae7139","Type":"ContainerStarted","Data":"ed3bd0b9a4482d3a412cfd02c7c80b0081adb02108471164a1c732a306bc8115"}
Sep 11 19:34:45.180971 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.180932    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bf86c8bcc-z79c4"]
Sep 11 19:34:45.183558 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.183536    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.193103 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.193081    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 19:34:45.195931 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.195906    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf86c8bcc-z79c4"]
Sep 11 19:34:45.274628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.274595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-service-ca\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.274788 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.274646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-serving-cert\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.274788 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.274724    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-oauth-config\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.274788 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.274776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtv64\" (UniqueName: \"kubernetes.io/projected/165ad526-06ec-4e77-bbe2-9a17100c644a-kube-api-access-mtv64\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.274997 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.274797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-oauth-serving-cert\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.274997 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.274830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-console-config\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.274997 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.274917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-trusted-ca-bundle\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.376175 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.376140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-service-ca\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.376394 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.376189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-serving-cert\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.376394 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.376220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-oauth-config\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.376394 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.376249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtv64\" (UniqueName: \"kubernetes.io/projected/165ad526-06ec-4e77-bbe2-9a17100c644a-kube-api-access-mtv64\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.376394 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.376305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-oauth-serving-cert\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.376394 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.376347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-console-config\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.376673 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.376400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-trusted-ca-bundle\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.376931 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.376903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-service-ca\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.377299 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.377271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-oauth-serving-cert\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.377387 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.377315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-trusted-ca-bundle\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.377442 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.377418    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-console-config\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.379563 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.379542    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-oauth-config\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.379931 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.379910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-serving-cert\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.386750 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.386707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtv64\" (UniqueName: \"kubernetes.io/projected/165ad526-06ec-4e77-bbe2-9a17100c644a-kube-api-access-mtv64\") pod \"console-7bf86c8bcc-z79c4\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") " pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:45.495317 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:45.495197    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:47.824740 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:47.824686    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf86c8bcc-z79c4"]
Sep 11 19:34:47.827469 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:34:47.827436    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165ad526_06ec_4e77_bbe2_9a17100c644a.slice/crio-6528ae08a6ef9e9b1413602c452d61a190db9c1a69c32f6599696ed1f419a2b7 WatchSource:0}: Error finding container 6528ae08a6ef9e9b1413602c452d61a190db9c1a69c32f6599696ed1f419a2b7: Status 404 returned error can't find the container with id 6528ae08a6ef9e9b1413602c452d61a190db9c1a69c32f6599696ed1f419a2b7
Sep 11 19:34:48.320890 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:48.320855    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-cv8cv" event={"ID":"2022384e-6b81-4d04-a091-44e464490a58","Type":"ContainerStarted","Data":"2210efe025b27e3f79ed7c98412ae55e9ed4575d4e944f320cd53a980f1ecce0"}
Sep 11 19:34:48.321347 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:48.321318    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-cv8cv"
Sep 11 19:34:48.323463 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:48.323437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfc598b4-hznn8" event={"ID":"4dcfe468-014a-49bd-8ed5-f7544dae7139","Type":"ContainerStarted","Data":"cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0"}
Sep 11 19:34:48.325310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:48.325247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf86c8bcc-z79c4" event={"ID":"165ad526-06ec-4e77-bbe2-9a17100c644a","Type":"ContainerStarted","Data":"88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21"}
Sep 11 19:34:48.325402 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:48.325340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf86c8bcc-z79c4" event={"ID":"165ad526-06ec-4e77-bbe2-9a17100c644a","Type":"ContainerStarted","Data":"6528ae08a6ef9e9b1413602c452d61a190db9c1a69c32f6599696ed1f419a2b7"}
Sep 11 19:34:48.336163 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:48.336139    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-cv8cv"
Sep 11 19:34:48.357853 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:48.357811    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-cv8cv" podStartSLOduration=1.8134801569999999 podStartE2EDuration="18.357793797s" totalImagesPullingTime="16.54431364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:48.340999091 +0000 UTC m=+322.575072513" watchObservedRunningTime="2026-09-11 19:34:48.357793797 +0000 UTC m=+322.591867239"
Sep 11 19:34:48.391181 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:48.391120    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bf86c8bcc-z79c4" podStartSLOduration=3.391102487 podStartE2EDuration="3.391102487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:48.389900841 +0000 UTC m=+322.623974262" watchObservedRunningTime="2026-09-11 19:34:48.391102487 +0000 UTC m=+322.625175906"
Sep 11 19:34:48.409307 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:48.409230    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bcfc598b4-hznn8" podStartSLOduration=2.102087494 podStartE2EDuration="12.409207103s" totalImagesPullingTime="10.307119609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:48.406615258 +0000 UTC m=+322.640688676" watchObservedRunningTime="2026-09-11 19:34:48.409207103 +0000 UTC m=+322.643280526"
Sep 11 19:34:55.495636 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:55.495590    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:55.496213 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:55.495670    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:55.501546 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:55.501518    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:56.376433 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:56.376394    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:34:56.424818 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:56.424769    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcfc598b4-hznn8"]
Sep 11 19:34:56.965014 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:34:56.964978    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:35:01.229501 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:01.229470    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57b5479c4b-82pb9_c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f/router/0.log"
Sep 11 19:35:01.240081 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:01.240057    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqj7n_05887d0c-30a1-4f39-a721-349343bcd827/serve-healthcheck-canary/0.log"
Sep 11 19:35:15.451175 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:15.451138    2578 generic.go:356] "Generic (PLEG): container finished" podID="bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e" containerID="98d19c2ccd20ddbb64222a6fffa20852ea937785e9d8c83090fe6e2c1203d9c8" exitCode=0
Sep 11 19:35:15.451739 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:15.451214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4" event={"ID":"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e","Type":"ContainerDied","Data":"98d19c2ccd20ddbb64222a6fffa20852ea937785e9d8c83090fe6e2c1203d9c8"}
Sep 11 19:35:15.451739 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:15.451622    2578 scope.go:117] "RemoveContainer" containerID="98d19c2ccd20ddbb64222a6fffa20852ea937785e9d8c83090fe6e2c1203d9c8"
Sep 11 19:35:16.457391 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:16.457359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-pnqh4" event={"ID":"bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e","Type":"ContainerStarted","Data":"8ec6d8e3dd95caac4bc6558d724da7ed2e914c213e13d7a4cf8644290373297b"}
Sep 11 19:35:21.453326 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.453200    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bcfc598b4-hznn8" podUID="4dcfe468-014a-49bd-8ed5-f7544dae7139" containerName="console" containerID="cri-o://cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0" gracePeriod=15
Sep 11 19:35:21.734578 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.734550    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:35:21.801420 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.801393    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-service-ca\") pod \"4dcfe468-014a-49bd-8ed5-f7544dae7139\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") "
Sep 11 19:35:21.801603 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.801443    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-oauth-serving-cert\") pod \"4dcfe468-014a-49bd-8ed5-f7544dae7139\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") "
Sep 11 19:35:21.801603 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.801495    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-oauth-config\") pod \"4dcfe468-014a-49bd-8ed5-f7544dae7139\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") "
Sep 11 19:35:21.801603 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.801539    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-serving-cert\") pod \"4dcfe468-014a-49bd-8ed5-f7544dae7139\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") "
Sep 11 19:35:21.801765 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.801667    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-config\") pod \"4dcfe468-014a-49bd-8ed5-f7544dae7139\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") "
Sep 11 19:35:21.801765 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.801712    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qrgj\" (UniqueName: \"kubernetes.io/projected/4dcfe468-014a-49bd-8ed5-f7544dae7139-kube-api-access-8qrgj\") pod \"4dcfe468-014a-49bd-8ed5-f7544dae7139\" (UID: \"4dcfe468-014a-49bd-8ed5-f7544dae7139\") "
Sep 11 19:35:21.801954 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.801845    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-service-ca" (OuterVolumeSpecName: "service-ca") pod "4dcfe468-014a-49bd-8ed5-f7544dae7139" (UID: "4dcfe468-014a-49bd-8ed5-f7544dae7139"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:35:21.802003 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.801933    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4dcfe468-014a-49bd-8ed5-f7544dae7139" (UID: "4dcfe468-014a-49bd-8ed5-f7544dae7139"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:35:21.802049 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.802021    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-config" (OuterVolumeSpecName: "console-config") pod "4dcfe468-014a-49bd-8ed5-f7544dae7139" (UID: "4dcfe468-014a-49bd-8ed5-f7544dae7139"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:35:21.803932 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.803905    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4dcfe468-014a-49bd-8ed5-f7544dae7139" (UID: "4dcfe468-014a-49bd-8ed5-f7544dae7139"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:35:21.804022 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.803954    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4dcfe468-014a-49bd-8ed5-f7544dae7139" (UID: "4dcfe468-014a-49bd-8ed5-f7544dae7139"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:35:21.804022 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.803965    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcfe468-014a-49bd-8ed5-f7544dae7139-kube-api-access-8qrgj" (OuterVolumeSpecName: "kube-api-access-8qrgj") pod "4dcfe468-014a-49bd-8ed5-f7544dae7139" (UID: "4dcfe468-014a-49bd-8ed5-f7544dae7139"). InnerVolumeSpecName "kube-api-access-8qrgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:35:21.903312 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.903278    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-serving-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:21.903312 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.903305    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-config\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:21.903312 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.903315    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qrgj\" (UniqueName: \"kubernetes.io/projected/4dcfe468-014a-49bd-8ed5-f7544dae7139-kube-api-access-8qrgj\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:21.903312 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.903324    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:21.903552 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.903332    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dcfe468-014a-49bd-8ed5-f7544dae7139-oauth-serving-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:21.903552 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:21.903340    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dcfe468-014a-49bd-8ed5-f7544dae7139-console-oauth-config\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:22.482137 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:22.482100    2578 generic.go:356] "Generic (PLEG): container finished" podID="4dcfe468-014a-49bd-8ed5-f7544dae7139" containerID="cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0" exitCode=0
Sep 11 19:35:22.482137 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:22.482141    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfc598b4-hznn8"
Sep 11 19:35:22.482554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:22.482193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfc598b4-hznn8" event={"ID":"4dcfe468-014a-49bd-8ed5-f7544dae7139","Type":"ContainerDied","Data":"cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0"}
Sep 11 19:35:22.482554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:22.482235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfc598b4-hznn8" event={"ID":"4dcfe468-014a-49bd-8ed5-f7544dae7139","Type":"ContainerDied","Data":"ed3bd0b9a4482d3a412cfd02c7c80b0081adb02108471164a1c732a306bc8115"}
Sep 11 19:35:22.482554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:22.482254    2578 scope.go:117] "RemoveContainer" containerID="cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0"
Sep 11 19:35:22.490412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:22.490394    2578 scope.go:117] "RemoveContainer" containerID="cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0"
Sep 11 19:35:22.490677 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:35:22.490659    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0\": container with ID starting with cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0 not found: ID does not exist" containerID="cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0"
Sep 11 19:35:22.490740 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:22.490685    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0"} err="failed to get container status \"cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0\": rpc error: code = NotFound desc = could not find container \"cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0\": container with ID starting with cdfeea3c787c24b48388c1ab7bbc801ee4cb200767e1a87ad0c64a1c6f838fe0 not found: ID does not exist"
Sep 11 19:35:22.498809 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:22.498788    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcfc598b4-hznn8"]
Sep 11 19:35:22.501985 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:22.501967    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bcfc598b4-hznn8"]
Sep 11 19:35:24.257075 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:24.257045    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dcfe468-014a-49bd-8ed5-f7544dae7139" path="/var/lib/kubelet/pods/4dcfe468-014a-49bd-8ed5-f7544dae7139/volumes"
Sep 11 19:35:39.209144 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.209111    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:35:39.209651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.209418    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="alertmanager" containerID="cri-o://85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db" gracePeriod=120
Sep 11 19:35:39.209651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.209473    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy-metric" containerID="cri-o://fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64" gracePeriod=120
Sep 11 19:35:39.209651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.209531    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="prom-label-proxy" containerID="cri-o://11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d" gracePeriod=120
Sep 11 19:35:39.209651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.209552    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy" containerID="cri-o://646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c" gracePeriod=120
Sep 11 19:35:39.209651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.209501    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy-web" containerID="cri-o://eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b" gracePeriod=120
Sep 11 19:35:39.209651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.209527    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="config-reloader" containerID="cri-o://ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c" gracePeriod=120
Sep 11 19:35:39.548191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.548108    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerID="11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d" exitCode=0
Sep 11 19:35:39.548191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.548132    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerID="646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c" exitCode=0
Sep 11 19:35:39.548191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.548138    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerID="ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c" exitCode=0
Sep 11 19:35:39.548191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.548144    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerID="85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db" exitCode=0
Sep 11 19:35:39.548191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.548184    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerDied","Data":"11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d"}
Sep 11 19:35:39.548461 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.548240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerDied","Data":"646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c"}
Sep 11 19:35:39.548461 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.548283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerDied","Data":"ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c"}
Sep 11 19:35:39.548461 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:39.548308    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerDied","Data":"85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db"}
Sep 11 19:35:40.256846 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.256812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:35:40.259404 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.259380    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3883618-051d-4804-aa8d-222af6c1e9f7-metrics-certs\") pod \"network-metrics-daemon-bw2r8\" (UID: \"d3883618-051d-4804-aa8d-222af6c1e9f7\") " pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:35:40.448551 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.448527    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:40.457292 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.457252    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7w7kq\""
Sep 11 19:35:40.464165 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.464149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bw2r8"
Sep 11 19:35:40.557016 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.556977    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerID="fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64" exitCode=0
Sep 11 19:35:40.557016 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.557014    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerID="eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b" exitCode=0
Sep 11 19:35:40.557221 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.557060    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerDied","Data":"fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64"}
Sep 11 19:35:40.557221 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.557076    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:40.557221 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.557155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerDied","Data":"eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b"}
Sep 11 19:35:40.557221 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.557183    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e4e9060-6ba2-46e3-bc5b-c5095126490b","Type":"ContainerDied","Data":"e021442a747f9c31d7b68705b900b4246aaef6a296c1c1029bd0a0ed59ca1b77"}
Sep 11 19:35:40.557221 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.557215    2578 scope.go:117] "RemoveContainer" containerID="11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d"
Sep 11 19:35:40.559439 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559416    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-main-tls\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559547 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559451    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559547 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559474    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-trusted-ca-bundle\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559547 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559503    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-metrics-client-ca\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559547 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559526    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-main-db\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559752 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559565    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-tls-assets\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559752 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559608    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559752 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559651    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-volume\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559752 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559680    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-cluster-tls-config\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559752 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559714    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-web-config\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559978 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559736    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgsh4\" (UniqueName: \"kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-kube-api-access-wgsh4\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559978 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559802    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-out\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.559978 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559829    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-web\") pod \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\" (UID: \"5e4e9060-6ba2-46e3-bc5b-c5095126490b\") "
Sep 11 19:35:40.560119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.559969    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:35:40.560119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.560000    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:35:40.560119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.560085    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.560119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.560105    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e4e9060-6ba2-46e3-bc5b-c5095126490b-metrics-client-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.560922 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.560646    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:35:40.564136 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.564101    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:35:40.564244 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.564218    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:35:40.564653 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.564624    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-out" (OuterVolumeSpecName: "config-out") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:35:40.565250 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.565217    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:35:40.565250 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.565290    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-volume" (OuterVolumeSpecName: "config-volume") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:35:40.565520 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.565478    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:35:40.566214 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.566174    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-kube-api-access-wgsh4" (OuterVolumeSpecName: "kube-api-access-wgsh4") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "kube-api-access-wgsh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:35:40.566955 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.566916    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:35:40.567940 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.567922    2578 scope.go:117] "RemoveContainer" containerID="fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64"
Sep 11 19:35:40.569226 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.569204    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:35:40.576391 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.576371    2578 scope.go:117] "RemoveContainer" containerID="646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c"
Sep 11 19:35:40.576826 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.576807    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-web-config" (OuterVolumeSpecName: "web-config") pod "5e4e9060-6ba2-46e3-bc5b-c5095126490b" (UID: "5e4e9060-6ba2-46e3-bc5b-c5095126490b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:35:40.583759 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.583742    2578 scope.go:117] "RemoveContainer" containerID="eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b"
Sep 11 19:35:40.590688 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.590671    2578 scope.go:117] "RemoveContainer" containerID="ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c"
Sep 11 19:35:40.597654 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.597635    2578 scope.go:117] "RemoveContainer" containerID="85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db"
Sep 11 19:35:40.604412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.604380    2578 scope.go:117] "RemoveContainer" containerID="314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164"
Sep 11 19:35:40.611067 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.611038    2578 scope.go:117] "RemoveContainer" containerID="11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d"
Sep 11 19:35:40.611341 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:35:40.611324    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d\": container with ID starting with 11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d not found: ID does not exist" containerID="11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d"
Sep 11 19:35:40.611409 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.611355    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d"} err="failed to get container status \"11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d\": rpc error: code = NotFound desc = could not find container \"11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d\": container with ID starting with 11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d not found: ID does not exist"
Sep 11 19:35:40.611409 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.611381    2578 scope.go:117] "RemoveContainer" containerID="fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64"
Sep 11 19:35:40.611677 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:35:40.611659    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64\": container with ID starting with fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64 not found: ID does not exist" containerID="fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64"
Sep 11 19:35:40.611712 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.611683    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64"} err="failed to get container status \"fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64\": rpc error: code = NotFound desc = could not find container \"fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64\": container with ID starting with fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64 not found: ID does not exist"
Sep 11 19:35:40.611712 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.611698    2578 scope.go:117] "RemoveContainer" containerID="646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c"
Sep 11 19:35:40.611930 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:35:40.611912    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c\": container with ID starting with 646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c not found: ID does not exist" containerID="646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c"
Sep 11 19:35:40.611990 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.611937    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c"} err="failed to get container status \"646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c\": rpc error: code = NotFound desc = could not find container \"646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c\": container with ID starting with 646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c not found: ID does not exist"
Sep 11 19:35:40.611990 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.611957    2578 scope.go:117] "RemoveContainer" containerID="eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b"
Sep 11 19:35:40.612212 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:35:40.612196    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b\": container with ID starting with eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b not found: ID does not exist" containerID="eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b"
Sep 11 19:35:40.612249 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.612217    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b"} err="failed to get container status \"eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b\": rpc error: code = NotFound desc = could not find container \"eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b\": container with ID starting with eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b not found: ID does not exist"
Sep 11 19:35:40.612249 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.612243    2578 scope.go:117] "RemoveContainer" containerID="ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c"
Sep 11 19:35:40.612532 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:35:40.612516    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c\": container with ID starting with ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c not found: ID does not exist" containerID="ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c"
Sep 11 19:35:40.612576 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.612536    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c"} err="failed to get container status \"ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c\": rpc error: code = NotFound desc = could not find container \"ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c\": container with ID starting with ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c not found: ID does not exist"
Sep 11 19:35:40.612576 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.612552    2578 scope.go:117] "RemoveContainer" containerID="85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db"
Sep 11 19:35:40.612791 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:35:40.612775    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db\": container with ID starting with 85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db not found: ID does not exist" containerID="85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db"
Sep 11 19:35:40.612846 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.612797    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db"} err="failed to get container status \"85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db\": rpc error: code = NotFound desc = could not find container \"85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db\": container with ID starting with 85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db not found: ID does not exist"
Sep 11 19:35:40.612846 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.612815    2578 scope.go:117] "RemoveContainer" containerID="314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164"
Sep 11 19:35:40.613070 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:35:40.613055    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164\": container with ID starting with 314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164 not found: ID does not exist" containerID="314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164"
Sep 11 19:35:40.613106 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.613074    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164"} err="failed to get container status \"314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164\": rpc error: code = NotFound desc = could not find container \"314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164\": container with ID starting with 314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164 not found: ID does not exist"
Sep 11 19:35:40.613106 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.613087    2578 scope.go:117] "RemoveContainer" containerID="11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d"
Sep 11 19:35:40.613311 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.613290    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d"} err="failed to get container status \"11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d\": rpc error: code = NotFound desc = could not find container \"11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d\": container with ID starting with 11bf8aeb06b263bf714763c808ca123efa5bc6716c02bd8b7fd96044be29f17d not found: ID does not exist"
Sep 11 19:35:40.613373 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.613313    2578 scope.go:117] "RemoveContainer" containerID="fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64"
Sep 11 19:35:40.613527 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.613510    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64"} err="failed to get container status \"fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64\": rpc error: code = NotFound desc = could not find container \"fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64\": container with ID starting with fc59cefda38822d00ad8b96dca8fb0fbce0e28c973cd2b2ad2423e25af543a64 not found: ID does not exist"
Sep 11 19:35:40.613597 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.613529    2578 scope.go:117] "RemoveContainer" containerID="646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c"
Sep 11 19:35:40.613776 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.613759    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c"} err="failed to get container status \"646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c\": rpc error: code = NotFound desc = could not find container \"646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c\": container with ID starting with 646bbf995d3b635962c3587ea1970e1b0d5ea4d52500010ecf288b425fac377c not found: ID does not exist"
Sep 11 19:35:40.613821 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.613778    2578 scope.go:117] "RemoveContainer" containerID="eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b"
Sep 11 19:35:40.614006 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.613988    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b"} err="failed to get container status \"eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b\": rpc error: code = NotFound desc = could not find container \"eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b\": container with ID starting with eb84ec91820292729bf759577cf52ee07dd186ee5c6a4c555f103ca9d003045b not found: ID does not exist"
Sep 11 19:35:40.614048 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.614006    2578 scope.go:117] "RemoveContainer" containerID="ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c"
Sep 11 19:35:40.614230 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.614212    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c"} err="failed to get container status \"ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c\": rpc error: code = NotFound desc = could not find container \"ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c\": container with ID starting with ee8a5d2ba38efdc17bc195fa70edfb3b7157bdee61b9740b75dd14bf76a7e40c not found: ID does not exist"
Sep 11 19:35:40.614331 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.614232    2578 scope.go:117] "RemoveContainer" containerID="85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db"
Sep 11 19:35:40.614495 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.614478    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db"} err="failed to get container status \"85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db\": rpc error: code = NotFound desc = could not find container \"85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db\": container with ID starting with 85d049c78a281d3d5cb28252a2cb7faf5680e0be33528abcc8d9ed5ae84a09db not found: ID does not exist"
Sep 11 19:35:40.614543 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.614496    2578 scope.go:117] "RemoveContainer" containerID="314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164"
Sep 11 19:35:40.614697 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.614682    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164"} err="failed to get container status \"314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164\": rpc error: code = NotFound desc = could not find container \"314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164\": container with ID starting with 314524eea6bffe575ae2ba3e85354cd416423ea5795f8149848eac5e0eab0164 not found: ID does not exist"
Sep 11 19:35:40.661162 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.661130    2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-cluster-tls-config\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.661335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.661178    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-web-config\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.661335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.661187    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgsh4\" (UniqueName: \"kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-kube-api-access-wgsh4\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.661335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.661196    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-out\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.661335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.661206    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.661335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.661215    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-main-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.661335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.661224    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.661335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.661232    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e4e9060-6ba2-46e3-bc5b-c5095126490b-alertmanager-main-db\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.661335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.661240    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e4e9060-6ba2-46e3-bc5b-c5095126490b-tls-assets\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.661335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.661249    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.661335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.661275    2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e4e9060-6ba2-46e3-bc5b-c5095126490b-config-volume\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:35:40.737940 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.737907    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bw2r8"]
Sep 11 19:35:40.740349 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:35:40.740323    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3883618_051d_4804_aa8d_222af6c1e9f7.slice/crio-41db0345598c70d8f5de289d14ccdb243b32b505ee1f5cbcd0cad12c3b3e9bf3 WatchSource:0}: Error finding container 41db0345598c70d8f5de289d14ccdb243b32b505ee1f5cbcd0cad12c3b3e9bf3: Status 404 returned error can't find the container with id 41db0345598c70d8f5de289d14ccdb243b32b505ee1f5cbcd0cad12c3b3e9bf3
Sep 11 19:35:40.883213 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.883188    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:35:40.889021 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.889000    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:35:40.949592 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949563    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:35:40.949855 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949840    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="init-config-reloader"
Sep 11 19:35:40.949899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949858    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="init-config-reloader"
Sep 11 19:35:40.949899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949866    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy-metric"
Sep 11 19:35:40.949899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949872    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy-metric"
Sep 11 19:35:40.949899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949883    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dcfe468-014a-49bd-8ed5-f7544dae7139" containerName="console"
Sep 11 19:35:40.949899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949888    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dcfe468-014a-49bd-8ed5-f7544dae7139" containerName="console"
Sep 11 19:35:40.949899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949896    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="config-reloader"
Sep 11 19:35:40.949899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949901    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="config-reloader"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949907    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy-web"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949912    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy-web"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949918    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949923    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949933    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="alertmanager"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949938    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="alertmanager"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949943    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="prom-label-proxy"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949947    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="prom-label-proxy"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949990    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="alertmanager"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.949999    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="prom-label-proxy"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.950006    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="config-reloader"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.950011    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy-web"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.950017    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.950023    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dcfe468-014a-49bd-8ed5-f7544dae7139" containerName="console"
Sep 11 19:35:40.950090 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.950029    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" containerName="kube-rbac-proxy-metric"
Sep 11 19:35:40.953438 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.953423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:40.965191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.965163    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-75bsp\""
Sep 11 19:35:40.965337 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.965215    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 19:35:40.965446 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.965430    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 19:35:40.965515 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.965445    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 19:35:40.965693 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:40.965677    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 19:35:41.013179 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.013154    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 19:35:41.013491 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.013479    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 19:35:41.013685 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.013670    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 19:35:41.013965 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.013950    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 19:35:41.014728 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.014714    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 19:35:41.020431 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.020412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:35:41.063599 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01b996fb-a303-4812-be1c-d9c908024e84-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.063786 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.063786 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.063786 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01b996fb-a303-4812-be1c-d9c908024e84-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.063786 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvs2f\" (UniqueName: \"kubernetes.io/projected/01b996fb-a303-4812-be1c-d9c908024e84-kube-api-access-jvs2f\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.063968 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b996fb-a303-4812-be1c-d9c908024e84-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.063968 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.063968 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-config-volume\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.063968 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.063968 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01b996fb-a303-4812-be1c-d9c908024e84-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.063968 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-web-config\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.063968 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.063957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01b996fb-a303-4812-be1c-d9c908024e84-config-out\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.064188 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.064025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.164933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.164856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.164933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.164913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-config-volume\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.165150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.164943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.165150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.164974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01b996fb-a303-4812-be1c-d9c908024e84-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.165150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.164994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-web-config\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.165150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.165021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01b996fb-a303-4812-be1c-d9c908024e84-config-out\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.165150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.165054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.166985 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.165481    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01b996fb-a303-4812-be1c-d9c908024e84-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.166985 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.165575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.166985 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.165609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.166985 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.165632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01b996fb-a303-4812-be1c-d9c908024e84-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.166985 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.165661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvs2f\" (UniqueName: \"kubernetes.io/projected/01b996fb-a303-4812-be1c-d9c908024e84-kube-api-access-jvs2f\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.166985 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.165686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b996fb-a303-4812-be1c-d9c908024e84-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.166985 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.166290    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01b996fb-a303-4812-be1c-d9c908024e84-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.166985 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.166645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b996fb-a303-4812-be1c-d9c908024e84-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.167495 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.167065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01b996fb-a303-4812-be1c-d9c908024e84-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.168237 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.168208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.169099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.168678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.169099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.168921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01b996fb-a303-4812-be1c-d9c908024e84-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.169248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.169124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01b996fb-a303-4812-be1c-d9c908024e84-config-out\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.169248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.169162    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-config-volume\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.169937 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.169862    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.170134 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.170118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.170352 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.170330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-web-config\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.170733 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.170709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01b996fb-a303-4812-be1c-d9c908024e84-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.180766 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.180741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvs2f\" (UniqueName: \"kubernetes.io/projected/01b996fb-a303-4812-be1c-d9c908024e84-kube-api-access-jvs2f\") pod \"alertmanager-main-0\" (UID: \"01b996fb-a303-4812-be1c-d9c908024e84\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.262748 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.262711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:35:41.556380 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.556345    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:35:41.563671 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:41.563647    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bw2r8" event={"ID":"d3883618-051d-4804-aa8d-222af6c1e9f7","Type":"ContainerStarted","Data":"41db0345598c70d8f5de289d14ccdb243b32b505ee1f5cbcd0cad12c3b3e9bf3"}
Sep 11 19:35:41.622693 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:35:41.622664    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b996fb_a303_4812_be1c_d9c908024e84.slice/crio-925479a47493953a5b5bac3e3da315eaaab8e44d99776b34677380890acedcc2 WatchSource:0}: Error finding container 925479a47493953a5b5bac3e3da315eaaab8e44d99776b34677380890acedcc2: Status 404 returned error can't find the container with id 925479a47493953a5b5bac3e3da315eaaab8e44d99776b34677380890acedcc2
Sep 11 19:35:42.256585 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:42.256503    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e4e9060-6ba2-46e3-bc5b-c5095126490b" path="/var/lib/kubelet/pods/5e4e9060-6ba2-46e3-bc5b-c5095126490b/volumes"
Sep 11 19:35:42.575103 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:42.575072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bw2r8" event={"ID":"d3883618-051d-4804-aa8d-222af6c1e9f7","Type":"ContainerStarted","Data":"b18bef3cb329e21229a299384aa6310a3b6a6c0eaf97bdf1433e19d46cee4219"}
Sep 11 19:35:42.575505 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:42.575149    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bw2r8" event={"ID":"d3883618-051d-4804-aa8d-222af6c1e9f7","Type":"ContainerStarted","Data":"1d64f229cee9abe0f8c4ac0d0f419f5fd94af1834d840c12b3604d11d7d45ce6"}
Sep 11 19:35:42.576570 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:42.576545    2578 generic.go:356] "Generic (PLEG): container finished" podID="01b996fb-a303-4812-be1c-d9c908024e84" containerID="6abe9c16106e6e5525928e710c6967bde17178944d32cf33d70b7941f71dcb51" exitCode=0
Sep 11 19:35:42.576678 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:42.576606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b996fb-a303-4812-be1c-d9c908024e84","Type":"ContainerDied","Data":"6abe9c16106e6e5525928e710c6967bde17178944d32cf33d70b7941f71dcb51"}
Sep 11 19:35:42.576678 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:42.576655    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b996fb-a303-4812-be1c-d9c908024e84","Type":"ContainerStarted","Data":"925479a47493953a5b5bac3e3da315eaaab8e44d99776b34677380890acedcc2"}
Sep 11 19:35:42.592619 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:42.592582    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bw2r8" podStartSLOduration=374.688753371 podStartE2EDuration="6m15.592569858s" totalImagesPullingTime="903.816487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:42.592304652 +0000 UTC m=+376.826378074" watchObservedRunningTime="2026-09-11 19:35:42.592569858 +0000 UTC m=+376.826643278"
Sep 11 19:35:43.255497 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.255414    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-bcd6f-bkmmn"]
Sep 11 19:35:43.257787 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.257735    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.263745 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.263719    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 19:35:43.263885 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.263772    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 19:35:43.263885 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.263796    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9n9f8\""
Sep 11 19:35:43.264027 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.264005    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 19:35:43.264190 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.264173    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 19:35:43.266868 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.266849    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 19:35:43.271584 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.271564    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 19:35:43.286302 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.286273    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bcd6f-bkmmn"]
Sep 11 19:35:43.384205 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.384165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.384205 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.384206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-telemeter-client-tls\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.384439 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.384225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5d26\" (UniqueName: \"kubernetes.io/projected/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-kube-api-access-z5d26\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.384439 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.384244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-metrics-client-ca\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.384439 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.384297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.384439 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.384315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-secret-telemeter-client\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.384439 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.384339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-federate-client-tls\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.384439 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.384360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-serving-certs-ca-bundle\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.485686 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.485653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.485686 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.485685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-telemeter-client-tls\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.485883 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.485705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5d26\" (UniqueName: \"kubernetes.io/projected/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-kube-api-access-z5d26\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.485883 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.485815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-metrics-client-ca\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.485883 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.485863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.486030 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.485886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-secret-telemeter-client\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.486088 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.486015    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-federate-client-tls\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.486208 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.486181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-serving-certs-ca-bundle\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.486613 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.486571    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-metrics-client-ca\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.486715 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.486695    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.486819 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.486798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-serving-certs-ca-bundle\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.488935 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.488917    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-telemeter-client-tls\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.489059 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.489040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-secret-telemeter-client\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.489107 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.489048    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.489437 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.489416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-federate-client-tls\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.494512 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.494496    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5d26\" (UniqueName: \"kubernetes.io/projected/b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b-kube-api-access-z5d26\") pod \"telemeter-client-bcd6f-bkmmn\" (UID: \"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b\") " pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.578122 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.578091    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn"
Sep 11 19:35:43.584833 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.584805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b996fb-a303-4812-be1c-d9c908024e84","Type":"ContainerStarted","Data":"1b6f97c63d95691dbdfb1ddf94536bbb7d1dbc5dc2a2889623eae0de8e506d1b"}
Sep 11 19:35:43.584964 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.584881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b996fb-a303-4812-be1c-d9c908024e84","Type":"ContainerStarted","Data":"25a74c75d2500f9b8c2ca997dbd0f3b343a9f73914f9b4cd03a702863b3fd242"}
Sep 11 19:35:43.584964 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.584925    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b996fb-a303-4812-be1c-d9c908024e84","Type":"ContainerStarted","Data":"f5cf1e1faf193ba296829ee680cbc6ac4ffea8c6e80082ecce9d942bfaaebffb"}
Sep 11 19:35:43.584964 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.584960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b996fb-a303-4812-be1c-d9c908024e84","Type":"ContainerStarted","Data":"951fe030f2e6dbcf213eb679b9507a5eb110fc1cb121c3829f27ac263e9c7c05"}
Sep 11 19:35:43.585129 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.584998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b996fb-a303-4812-be1c-d9c908024e84","Type":"ContainerStarted","Data":"a04c75add806e755b7077d99eb51d9158698b1470e594006ab57e22cded0d6df"}
Sep 11 19:35:43.585129 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.585040    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b996fb-a303-4812-be1c-d9c908024e84","Type":"ContainerStarted","Data":"e50679537f201b310dbef1f0744ce901b922cf0d3d78f0c7157f01b74a56e008"}
Sep 11 19:35:43.614058 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.614007    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.598724559 podStartE2EDuration="3.613989335s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.264776ms" isStatefulPod=false podCreationTimestamp="2026-09-11 19:35:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:43.612064425 +0000 UTC m=+377.846137857" watchObservedRunningTime="2026-09-11 19:35:43.613989335 +0000 UTC m=+377.848062756"
Sep 11 19:35:43.872993 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:43.872966    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bcd6f-bkmmn"]
Sep 11 19:35:43.873546 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:35:43.873524    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ed1793_1dfb_4cd4_9946_fed8cc80cd8b.slice/crio-43075ac79b3349762e880c49765ead254861172d5b5f8156dd2ad505b7cbcbce WatchSource:0}: Error finding container 43075ac79b3349762e880c49765ead254861172d5b5f8156dd2ad505b7cbcbce: Status 404 returned error can't find the container with id 43075ac79b3349762e880c49765ead254861172d5b5f8156dd2ad505b7cbcbce
Sep 11 19:35:44.592416 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:44.592374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn" event={"ID":"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b","Type":"ContainerStarted","Data":"43075ac79b3349762e880c49765ead254861172d5b5f8156dd2ad505b7cbcbce"}
Sep 11 19:35:46.604074 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.604038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn" event={"ID":"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b","Type":"ContainerStarted","Data":"5e0d882e6ea882a74462f646104634de82a6b76267561c6e98ed52cb50104bdb"}
Sep 11 19:35:46.604499 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.604094    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn" event={"ID":"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b","Type":"ContainerStarted","Data":"93dcfa45f02634c7f1fb13f9ec65247d406fd83f7a3986639d20a7814bc31943"}
Sep 11 19:35:46.604499 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.604113    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn" event={"ID":"b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b","Type":"ContainerStarted","Data":"a82a947068c2950b49109ee6a8c5af7457948b8792b6b1379f17e2d779a219a9"}
Sep 11 19:35:46.628340 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.628287    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-bcd6f-bkmmn" podStartSLOduration=1.8176587849999999 podStartE2EDuration="3.628251715s" totalImagesPullingTime="1.81059293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:35:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:46.627421014 +0000 UTC m=+380.861494428" watchObservedRunningTime="2026-09-11 19:35:46.628251715 +0000 UTC m=+380.862325141"
Sep 11 19:35:46.719765 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.719732    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8565c7487c-c6d2t"]
Sep 11 19:35:46.725204 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.725181    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.733016 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.732989    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8565c7487c-c6d2t"]
Sep 11 19:35:46.818981 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.818939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-console-config\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.818981 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.818998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxcdf\" (UniqueName: \"kubernetes.io/projected/058f389e-be24-43ab-81a6-b1d76e198e5f-kube-api-access-pxcdf\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.819252 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.819058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-serving-cert\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.819252 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.819108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-oauth-config\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.819252 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.819136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-service-ca\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.819252 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.819207    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-trusted-ca-bundle\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.819252 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.819238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-oauth-serving-cert\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.920197 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.920107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-trusted-ca-bundle\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.920197 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.920146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-oauth-serving-cert\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.920197 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.920197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-console-config\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.920510 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.920231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxcdf\" (UniqueName: \"kubernetes.io/projected/058f389e-be24-43ab-81a6-b1d76e198e5f-kube-api-access-pxcdf\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.920510 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.920253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-serving-cert\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.920510 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.920314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-oauth-config\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.920510 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.920341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-service-ca\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.921049 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.921022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-console-config\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.921049 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.921041    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-oauth-serving-cert\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.921201 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.921168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-service-ca\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.921201 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.921168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-trusted-ca-bundle\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.923396 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.923376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-serving-cert\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.923500 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.923480    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-oauth-config\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:46.929918 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:46.929896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxcdf\" (UniqueName: \"kubernetes.io/projected/058f389e-be24-43ab-81a6-b1d76e198e5f-kube-api-access-pxcdf\") pod \"console-8565c7487c-c6d2t\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") " pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:47.036713 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:47.036685    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:47.327889 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:47.327860    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8565c7487c-c6d2t"]
Sep 11 19:35:47.331296 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:35:47.331239    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058f389e_be24_43ab_81a6_b1d76e198e5f.slice/crio-5746a006519dcb0c255d0a62b9940fe54200139d508fe8970aea674383fb3d3b WatchSource:0}: Error finding container 5746a006519dcb0c255d0a62b9940fe54200139d508fe8970aea674383fb3d3b: Status 404 returned error can't find the container with id 5746a006519dcb0c255d0a62b9940fe54200139d508fe8970aea674383fb3d3b
Sep 11 19:35:47.610139 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:47.610043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8565c7487c-c6d2t" event={"ID":"058f389e-be24-43ab-81a6-b1d76e198e5f","Type":"ContainerStarted","Data":"58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1"}
Sep 11 19:35:47.610139 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:47.610100    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8565c7487c-c6d2t" event={"ID":"058f389e-be24-43ab-81a6-b1d76e198e5f","Type":"ContainerStarted","Data":"5746a006519dcb0c255d0a62b9940fe54200139d508fe8970aea674383fb3d3b"}
Sep 11 19:35:47.629382 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:47.629334    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8565c7487c-c6d2t" podStartSLOduration=1.629319589 podStartE2EDuration="1.629319589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:47.62696611 +0000 UTC m=+381.861039531" watchObservedRunningTime="2026-09-11 19:35:47.629319589 +0000 UTC m=+381.863393009"
Sep 11 19:35:57.036925 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:57.036892    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:57.037483 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:57.036943    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:57.041787 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:57.041762    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:57.655370 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:57.655342    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:35:57.700925 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:35:57.700894    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf86c8bcc-z79c4"]
Sep 11 19:36:22.725861 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:22.725800    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bf86c8bcc-z79c4" podUID="165ad526-06ec-4e77-bbe2-9a17100c644a" containerName="console" containerID="cri-o://88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21" gracePeriod=15
Sep 11 19:36:22.971126 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:22.971101    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:36:23.032144 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.032064    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-serving-cert\") pod \"165ad526-06ec-4e77-bbe2-9a17100c644a\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") "
Sep 11 19:36:23.032144 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.032112    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-oauth-serving-cert\") pod \"165ad526-06ec-4e77-bbe2-9a17100c644a\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") "
Sep 11 19:36:23.032144 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.032135    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtv64\" (UniqueName: \"kubernetes.io/projected/165ad526-06ec-4e77-bbe2-9a17100c644a-kube-api-access-mtv64\") pod \"165ad526-06ec-4e77-bbe2-9a17100c644a\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") "
Sep 11 19:36:23.032452 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.032187    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-trusted-ca-bundle\") pod \"165ad526-06ec-4e77-bbe2-9a17100c644a\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") "
Sep 11 19:36:23.032452 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.032207    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-service-ca\") pod \"165ad526-06ec-4e77-bbe2-9a17100c644a\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") "
Sep 11 19:36:23.032452 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.032249    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-console-config\") pod \"165ad526-06ec-4e77-bbe2-9a17100c644a\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") "
Sep 11 19:36:23.032452 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.032298    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-oauth-config\") pod \"165ad526-06ec-4e77-bbe2-9a17100c644a\" (UID: \"165ad526-06ec-4e77-bbe2-9a17100c644a\") "
Sep 11 19:36:23.032660 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.032629    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-service-ca" (OuterVolumeSpecName: "service-ca") pod "165ad526-06ec-4e77-bbe2-9a17100c644a" (UID: "165ad526-06ec-4e77-bbe2-9a17100c644a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:36:23.032660 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.032642    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "165ad526-06ec-4e77-bbe2-9a17100c644a" (UID: "165ad526-06ec-4e77-bbe2-9a17100c644a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:36:23.032765 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.032712    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-console-config" (OuterVolumeSpecName: "console-config") pod "165ad526-06ec-4e77-bbe2-9a17100c644a" (UID: "165ad526-06ec-4e77-bbe2-9a17100c644a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:36:23.032873 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.032856    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "165ad526-06ec-4e77-bbe2-9a17100c644a" (UID: "165ad526-06ec-4e77-bbe2-9a17100c644a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:36:23.034528 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.034500    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "165ad526-06ec-4e77-bbe2-9a17100c644a" (UID: "165ad526-06ec-4e77-bbe2-9a17100c644a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:36:23.034632 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.034554    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/165ad526-06ec-4e77-bbe2-9a17100c644a-kube-api-access-mtv64" (OuterVolumeSpecName: "kube-api-access-mtv64") pod "165ad526-06ec-4e77-bbe2-9a17100c644a" (UID: "165ad526-06ec-4e77-bbe2-9a17100c644a"). InnerVolumeSpecName "kube-api-access-mtv64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:36:23.034676 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.034663    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "165ad526-06ec-4e77-bbe2-9a17100c644a" (UID: "165ad526-06ec-4e77-bbe2-9a17100c644a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:36:23.133165 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.133116    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-serving-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:36:23.133165 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.133159    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-oauth-serving-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:36:23.133165 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.133172    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtv64\" (UniqueName: \"kubernetes.io/projected/165ad526-06ec-4e77-bbe2-9a17100c644a-kube-api-access-mtv64\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:36:23.133455 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.133185    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-trusted-ca-bundle\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:36:23.133455 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.133196    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:36:23.133455 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.133207    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/165ad526-06ec-4e77-bbe2-9a17100c644a-console-config\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:36:23.133455 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.133217    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/165ad526-06ec-4e77-bbe2-9a17100c644a-console-oauth-config\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:36:23.757067 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.757034    2578 generic.go:356] "Generic (PLEG): container finished" podID="165ad526-06ec-4e77-bbe2-9a17100c644a" containerID="88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21" exitCode=0
Sep 11 19:36:23.757484 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.757077    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf86c8bcc-z79c4"
Sep 11 19:36:23.757484 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.757096    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf86c8bcc-z79c4" event={"ID":"165ad526-06ec-4e77-bbe2-9a17100c644a","Type":"ContainerDied","Data":"88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21"}
Sep 11 19:36:23.757484 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.757138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf86c8bcc-z79c4" event={"ID":"165ad526-06ec-4e77-bbe2-9a17100c644a","Type":"ContainerDied","Data":"6528ae08a6ef9e9b1413602c452d61a190db9c1a69c32f6599696ed1f419a2b7"}
Sep 11 19:36:23.757484 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.757156    2578 scope.go:117] "RemoveContainer" containerID="88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21"
Sep 11 19:36:23.765957 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.765938    2578 scope.go:117] "RemoveContainer" containerID="88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21"
Sep 11 19:36:23.766219 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:36:23.766204    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21\": container with ID starting with 88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21 not found: ID does not exist" containerID="88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21"
Sep 11 19:36:23.766288 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.766227    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21"} err="failed to get container status \"88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21\": rpc error: code = NotFound desc = could not find container \"88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21\": container with ID starting with 88872511dafd5b207d99dad8132225bff80acc43c7f8af81b06ded01e465cf21 not found: ID does not exist"
Sep 11 19:36:23.790035 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.790008    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf86c8bcc-z79c4"]
Sep 11 19:36:23.795932 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:23.795909    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bf86c8bcc-z79c4"]
Sep 11 19:36:24.261547 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:36:24.261516    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="165ad526-06ec-4e77-bbe2-9a17100c644a" path="/var/lib/kubelet/pods/165ad526-06ec-4e77-bbe2-9a17100c644a/volumes"
Sep 11 19:37:04.434527 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.434496    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d97f495cb-gd7vn"]
Sep 11 19:37:04.435094 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.434881    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165ad526-06ec-4e77-bbe2-9a17100c644a" containerName="console"
Sep 11 19:37:04.435094 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.434899    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="165ad526-06ec-4e77-bbe2-9a17100c644a" containerName="console"
Sep 11 19:37:04.435094 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.434992    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="165ad526-06ec-4e77-bbe2-9a17100c644a" containerName="console"
Sep 11 19:37:04.438115 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.438093    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.451078 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.451055    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d97f495cb-gd7vn"]
Sep 11 19:37:04.573886 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.573854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-console-config\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.573886 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.573898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-oauth-config\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.574089 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.573944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-service-ca\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.574089 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.573967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-oauth-serving-cert\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.574089 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.573988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bhvw\" (UniqueName: \"kubernetes.io/projected/205625d8-85c7-41ce-80c3-627463548de0-kube-api-access-2bhvw\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.574186 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.574104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-trusted-ca-bundle\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.574186 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.574134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-serving-cert\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.675312 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.675276    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-oauth-serving-cert\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.675446 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.675321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bhvw\" (UniqueName: \"kubernetes.io/projected/205625d8-85c7-41ce-80c3-627463548de0-kube-api-access-2bhvw\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.675446 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.675366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-trusted-ca-bundle\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.675446 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.675383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-serving-cert\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.675446 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.675404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-console-config\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.675446 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.675431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-oauth-config\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.675667 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.675464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-service-ca\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.675984 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.675956    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-oauth-serving-cert\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.676190 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.676165    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-console-config\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.676233 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.676182    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-trusted-ca-bundle\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.676386 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.676369    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-service-ca\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.677933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.677912    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-serving-cert\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.678025 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.677968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-oauth-config\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.683269 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.683233    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bhvw\" (UniqueName: \"kubernetes.io/projected/205625d8-85c7-41ce-80c3-627463548de0-kube-api-access-2bhvw\") pod \"console-6d97f495cb-gd7vn\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") " pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:04.751496 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:04.751413    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:05.021345 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:05.021251    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d97f495cb-gd7vn"]
Sep 11 19:37:05.024289 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:37:05.024244    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205625d8_85c7_41ce_80c3_627463548de0.slice/crio-92fac80c5e01510406755654700420c052e01feeea986603246bfdf0e8fa3731 WatchSource:0}: Error finding container 92fac80c5e01510406755654700420c052e01feeea986603246bfdf0e8fa3731: Status 404 returned error can't find the container with id 92fac80c5e01510406755654700420c052e01feeea986603246bfdf0e8fa3731
Sep 11 19:37:05.929159 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:05.929124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d97f495cb-gd7vn" event={"ID":"205625d8-85c7-41ce-80c3-627463548de0","Type":"ContainerStarted","Data":"e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f"}
Sep 11 19:37:05.929570 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:05.929178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d97f495cb-gd7vn" event={"ID":"205625d8-85c7-41ce-80c3-627463548de0","Type":"ContainerStarted","Data":"92fac80c5e01510406755654700420c052e01feeea986603246bfdf0e8fa3731"}
Sep 11 19:37:05.947116 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:05.947065    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d97f495cb-gd7vn" podStartSLOduration=1.947049404 podStartE2EDuration="1.947049404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:37:05.945887572 +0000 UTC m=+460.179960993" watchObservedRunningTime="2026-09-11 19:37:05.947049404 +0000 UTC m=+460.181122857"
Sep 11 19:37:14.752220 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:14.752176    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:14.752711 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:14.752238    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:14.756993 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:14.756970    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:14.968129 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:14.968102    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:37:15.012530 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:15.012452    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8565c7487c-c6d2t"]
Sep 11 19:37:40.034606 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.034540    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8565c7487c-c6d2t" podUID="058f389e-be24-43ab-81a6-b1d76e198e5f" containerName="console" containerID="cri-o://58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1" gracePeriod=15
Sep 11 19:37:40.270387 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.270362    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:37:40.375908 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.375867    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-trusted-ca-bundle\") pod \"058f389e-be24-43ab-81a6-b1d76e198e5f\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") "
Sep 11 19:37:40.376085 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.375921    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-oauth-config\") pod \"058f389e-be24-43ab-81a6-b1d76e198e5f\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") "
Sep 11 19:37:40.376085 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.375964    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-console-config\") pod \"058f389e-be24-43ab-81a6-b1d76e198e5f\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") "
Sep 11 19:37:40.376085 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.375993    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-oauth-serving-cert\") pod \"058f389e-be24-43ab-81a6-b1d76e198e5f\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") "
Sep 11 19:37:40.376085 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.376060    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxcdf\" (UniqueName: \"kubernetes.io/projected/058f389e-be24-43ab-81a6-b1d76e198e5f-kube-api-access-pxcdf\") pod \"058f389e-be24-43ab-81a6-b1d76e198e5f\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") "
Sep 11 19:37:40.376085 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.376082    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-service-ca\") pod \"058f389e-be24-43ab-81a6-b1d76e198e5f\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") "
Sep 11 19:37:40.376385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.376112    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-serving-cert\") pod \"058f389e-be24-43ab-81a6-b1d76e198e5f\" (UID: \"058f389e-be24-43ab-81a6-b1d76e198e5f\") "
Sep 11 19:37:40.376477 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.376363    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "058f389e-be24-43ab-81a6-b1d76e198e5f" (UID: "058f389e-be24-43ab-81a6-b1d76e198e5f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:37:40.376533 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.376482    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-console-config" (OuterVolumeSpecName: "console-config") pod "058f389e-be24-43ab-81a6-b1d76e198e5f" (UID: "058f389e-be24-43ab-81a6-b1d76e198e5f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:37:40.376571 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.376549    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "058f389e-be24-43ab-81a6-b1d76e198e5f" (UID: "058f389e-be24-43ab-81a6-b1d76e198e5f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:37:40.376571 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.376552    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-service-ca" (OuterVolumeSpecName: "service-ca") pod "058f389e-be24-43ab-81a6-b1d76e198e5f" (UID: "058f389e-be24-43ab-81a6-b1d76e198e5f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:37:40.378432 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.378411    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "058f389e-be24-43ab-81a6-b1d76e198e5f" (UID: "058f389e-be24-43ab-81a6-b1d76e198e5f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:37:40.378779 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.378750    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "058f389e-be24-43ab-81a6-b1d76e198e5f" (UID: "058f389e-be24-43ab-81a6-b1d76e198e5f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:37:40.378837 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.378770    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/058f389e-be24-43ab-81a6-b1d76e198e5f-kube-api-access-pxcdf" (OuterVolumeSpecName: "kube-api-access-pxcdf") pod "058f389e-be24-43ab-81a6-b1d76e198e5f" (UID: "058f389e-be24-43ab-81a6-b1d76e198e5f"). InnerVolumeSpecName "kube-api-access-pxcdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:37:40.477028 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.476983    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-trusted-ca-bundle\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:37:40.477028 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.477019    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-oauth-config\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:37:40.477028 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.477030    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-console-config\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:37:40.477028 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.477039    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-oauth-serving-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:37:40.477281 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.477048    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxcdf\" (UniqueName: \"kubernetes.io/projected/058f389e-be24-43ab-81a6-b1d76e198e5f-kube-api-access-pxcdf\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:37:40.477281 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.477057    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/058f389e-be24-43ab-81a6-b1d76e198e5f-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:37:40.477281 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:40.477065    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/058f389e-be24-43ab-81a6-b1d76e198e5f-console-serving-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:37:41.072975 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:41.072940    2578 generic.go:356] "Generic (PLEG): container finished" podID="058f389e-be24-43ab-81a6-b1d76e198e5f" containerID="58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1" exitCode=0
Sep 11 19:37:41.073434 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:41.072990    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8565c7487c-c6d2t"
Sep 11 19:37:41.073434 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:41.073006    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8565c7487c-c6d2t" event={"ID":"058f389e-be24-43ab-81a6-b1d76e198e5f","Type":"ContainerDied","Data":"58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1"}
Sep 11 19:37:41.073434 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:41.073055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8565c7487c-c6d2t" event={"ID":"058f389e-be24-43ab-81a6-b1d76e198e5f","Type":"ContainerDied","Data":"5746a006519dcb0c255d0a62b9940fe54200139d508fe8970aea674383fb3d3b"}
Sep 11 19:37:41.073434 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:41.073082    2578 scope.go:117] "RemoveContainer" containerID="58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1"
Sep 11 19:37:41.082678 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:41.082658    2578 scope.go:117] "RemoveContainer" containerID="58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1"
Sep 11 19:37:41.082945 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:37:41.082927    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1\": container with ID starting with 58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1 not found: ID does not exist" containerID="58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1"
Sep 11 19:37:41.083002 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:41.082954    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1"} err="failed to get container status \"58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1\": rpc error: code = NotFound desc = could not find container \"58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1\": container with ID starting with 58e3d507a5900c5c6b4e14ddbd7a76f5bba5deab1879ccf909f0d3cabd86cdc1 not found: ID does not exist"
Sep 11 19:37:41.104082 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:41.104058    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8565c7487c-c6d2t"]
Sep 11 19:37:41.116682 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:41.116660    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8565c7487c-c6d2t"]
Sep 11 19:37:42.256307 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:37:42.256252    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="058f389e-be24-43ab-81a6-b1d76e198e5f" path="/var/lib/kubelet/pods/058f389e-be24-43ab-81a6-b1d76e198e5f/volumes"
Sep 11 19:38:48.138913 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.138878    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r"]
Sep 11 19:38:48.139393 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.139224    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="058f389e-be24-43ab-81a6-b1d76e198e5f" containerName="console"
Sep 11 19:38:48.139393 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.139236    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="058f389e-be24-43ab-81a6-b1d76e198e5f" containerName="console"
Sep 11 19:38:48.139393 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.139323    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="058f389e-be24-43ab-81a6-b1d76e198e5f" containerName="console"
Sep 11 19:38:48.142447 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.142433    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r"
Sep 11 19:38:48.145353 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.145326    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qddm5\""
Sep 11 19:38:48.145469 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.145368    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 19:38:48.145469 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.145368    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 19:38:48.151962 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.151942    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r"]
Sep 11 19:38:48.229624 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.229592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08dc6228-fcee-445d-8f9c-bbe1ead196e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jxt2r\" (UID: \"08dc6228-fcee-445d-8f9c-bbe1ead196e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r"
Sep 11 19:38:48.229624 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.229627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6khn\" (UniqueName: \"kubernetes.io/projected/08dc6228-fcee-445d-8f9c-bbe1ead196e3-kube-api-access-h6khn\") pod \"cert-manager-cainjector-559cdd8c87-jxt2r\" (UID: \"08dc6228-fcee-445d-8f9c-bbe1ead196e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r"
Sep 11 19:38:48.330650 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.330619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08dc6228-fcee-445d-8f9c-bbe1ead196e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jxt2r\" (UID: \"08dc6228-fcee-445d-8f9c-bbe1ead196e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r"
Sep 11 19:38:48.330650 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.330653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6khn\" (UniqueName: \"kubernetes.io/projected/08dc6228-fcee-445d-8f9c-bbe1ead196e3-kube-api-access-h6khn\") pod \"cert-manager-cainjector-559cdd8c87-jxt2r\" (UID: \"08dc6228-fcee-445d-8f9c-bbe1ead196e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r"
Sep 11 19:38:48.339344 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.339319    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08dc6228-fcee-445d-8f9c-bbe1ead196e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jxt2r\" (UID: \"08dc6228-fcee-445d-8f9c-bbe1ead196e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r"
Sep 11 19:38:48.339577 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.339558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6khn\" (UniqueName: \"kubernetes.io/projected/08dc6228-fcee-445d-8f9c-bbe1ead196e3-kube-api-access-h6khn\") pod \"cert-manager-cainjector-559cdd8c87-jxt2r\" (UID: \"08dc6228-fcee-445d-8f9c-bbe1ead196e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r"
Sep 11 19:38:48.466298 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.466199    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r"
Sep 11 19:38:48.734920 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:48.734897    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r"]
Sep 11 19:38:48.737035 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:38:48.737006    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08dc6228_fcee_445d_8f9c_bbe1ead196e3.slice/crio-19127bbf80c12bb2ec9e676419779b9dc8e06c2108eeff84d9af4108cab3b9d6 WatchSource:0}: Error finding container 19127bbf80c12bb2ec9e676419779b9dc8e06c2108eeff84d9af4108cab3b9d6: Status 404 returned error can't find the container with id 19127bbf80c12bb2ec9e676419779b9dc8e06c2108eeff84d9af4108cab3b9d6
Sep 11 19:38:49.353426 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:49.353385    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r" event={"ID":"08dc6228-fcee-445d-8f9c-bbe1ead196e3","Type":"ContainerStarted","Data":"19127bbf80c12bb2ec9e676419779b9dc8e06c2108eeff84d9af4108cab3b9d6"}
Sep 11 19:38:52.368350 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:52.368313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r" event={"ID":"08dc6228-fcee-445d-8f9c-bbe1ead196e3","Type":"ContainerStarted","Data":"303aa29fd9df055d7e16417001e71e8d6d4f1752b44b831a01312c3cdf81730c"}
Sep 11 19:38:52.384008 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:38:52.383937    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jxt2r" podStartSLOduration=1.54818644 podStartE2EDuration="4.383918925s" totalImagesPullingTime="2.835732485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:38:52.38319921 +0000 UTC m=+566.617272630" watchObservedRunningTime="2026-09-11 19:38:52.383918925 +0000 UTC m=+566.617992359"
Sep 11 19:39:19.317057 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.317024    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"]
Sep 11 19:39:19.320377 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.320356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.323848 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.323825    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b7k7l\""
Sep 11 19:39:19.323988 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.323914    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 19:39:19.324064 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.324047    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 19:39:19.324162 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.324141    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 19:39:19.324226 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.324172    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 19:39:19.337757 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.337737    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"]
Sep 11 19:39:19.386649 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.386621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5lsn\" (UniqueName: \"kubernetes.io/projected/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-kube-api-access-v5lsn\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.386744 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.386654    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-manifests\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.386744 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.386718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-tmp\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.386836 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.386747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.386836 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.386777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.487799 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.487774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.487935 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.487833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5lsn\" (UniqueName: \"kubernetes.io/projected/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-kube-api-access-v5lsn\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.487935 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.487856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-manifests\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.487935 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.487881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-tmp\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.487935 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.487904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.488339 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.488308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-manifests\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.490188 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.490159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-tmp\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.490474 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.490456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.490588 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.490569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.496836 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.496817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5lsn\" (UniqueName: \"kubernetes.io/projected/3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f-kube-api-access-v5lsn\") pod \"opendatahub-operator-controller-manager-cccd5967-t9f5k\" (UID: \"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f\") " pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.631049 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.630963    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:19.907470 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:19.907448    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"]
Sep 11 19:39:19.909915 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:39:19.909885    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0bc630_d0bf_4f2f_87c4_26adf3cf9a0f.slice/crio-252ef147899b3738232ec5ca58bbdecf63373e9745f2f1f683e4558807b0c90f WatchSource:0}: Error finding container 252ef147899b3738232ec5ca58bbdecf63373e9745f2f1f683e4558807b0c90f: Status 404 returned error can't find the container with id 252ef147899b3738232ec5ca58bbdecf63373e9745f2f1f683e4558807b0c90f
Sep 11 19:39:20.487119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:20.487083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k" event={"ID":"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f","Type":"ContainerStarted","Data":"252ef147899b3738232ec5ca58bbdecf63373e9745f2f1f683e4558807b0c90f"}
Sep 11 19:39:23.504398 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:23.504364    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k" event={"ID":"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f","Type":"ContainerStarted","Data":"bc5c3ce3f833f42ac770b33bfd8ef205b5268dc35a40a15902d10e89e5e643f5"}
Sep 11 19:39:24.509785 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:24.509751    2578 generic.go:356] "Generic (PLEG): container finished" podID="3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f" containerID="bc5c3ce3f833f42ac770b33bfd8ef205b5268dc35a40a15902d10e89e5e643f5" exitCode=0
Sep 11 19:39:24.510193 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:24.509841    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k" event={"ID":"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f","Type":"ContainerDied","Data":"bc5c3ce3f833f42ac770b33bfd8ef205b5268dc35a40a15902d10e89e5e643f5"}
Sep 11 19:39:25.516282 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:25.516179    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k" event={"ID":"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f","Type":"ContainerStarted","Data":"efbdf365efabaf184cf72af07f9cb83d75203f20df9151067f0c2684d990294f"}
Sep 11 19:39:25.516720 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:25.516308    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:25.538864 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:25.538819    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k" podStartSLOduration=1.932372124 podStartE2EDuration="6.53880505s" totalImagesPullingTime="3.590658051s" totalInitContainerRuntime="1.015774875s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:39:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:39:25.536140088 +0000 UTC m=+599.770213509" watchObservedRunningTime="2026-09-11 19:39:25.53880505 +0000 UTC m=+599.772878505"
Sep 11 19:39:26.506408 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:26.506311    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:39:26.517075 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:26.506703    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:39:35.558741 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:35.558706    2578 generic.go:356] "Generic (PLEG): container finished" podID="3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f" containerID="efbdf365efabaf184cf72af07f9cb83d75203f20df9151067f0c2684d990294f" exitCode=1
Sep 11 19:39:35.559116 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:35.558778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k" event={"ID":"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f","Type":"ContainerDied","Data":"efbdf365efabaf184cf72af07f9cb83d75203f20df9151067f0c2684d990294f"}
Sep 11 19:39:35.559200 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:35.559185    2578 scope.go:117] "RemoveContainer" containerID="efbdf365efabaf184cf72af07f9cb83d75203f20df9151067f0c2684d990294f"
Sep 11 19:39:35.559520 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:35.559507    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:39:36.564994 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:36.564963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k" event={"ID":"3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f","Type":"ContainerStarted","Data":"4bbdc98d1d5e9e5432da12a66753ed6ce011e9ca6ba4841b3333cf15357aa9ce"}
Sep 11 19:39:36.565390 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:36.565168    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:39.323399 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.323368    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6986d97c98-rg6pg"]
Sep 11 19:39:39.328701 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.328678    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.337730 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.337704    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6986d97c98-rg6pg"]
Sep 11 19:39:39.458200 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.458161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-console-config\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.458366 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.458212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-service-ca\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.458366 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.458227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nvtx\" (UniqueName: \"kubernetes.io/projected/fe1899d1-c74a-4967-81fb-5f373c374ed9-kube-api-access-2nvtx\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.458366 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.458334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe1899d1-c74a-4967-81fb-5f373c374ed9-console-serving-cert\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.458366 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.458356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe1899d1-c74a-4967-81fb-5f373c374ed9-console-oauth-config\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.458501 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.458406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-trusted-ca-bundle\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.458501 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.458460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-oauth-serving-cert\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.559761 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.559715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe1899d1-c74a-4967-81fb-5f373c374ed9-console-serving-cert\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.559761 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.559763    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe1899d1-c74a-4967-81fb-5f373c374ed9-console-oauth-config\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.559988 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.559799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-trusted-ca-bundle\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.559988 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.559823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-oauth-serving-cert\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.559988 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.559850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-console-config\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.559988 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.559876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-service-ca\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.559988 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.559890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nvtx\" (UniqueName: \"kubernetes.io/projected/fe1899d1-c74a-4967-81fb-5f373c374ed9-kube-api-access-2nvtx\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.563713 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.563688    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-service-ca\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.563823 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.563730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe1899d1-c74a-4967-81fb-5f373c374ed9-console-serving-cert\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.563823 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.563730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe1899d1-c74a-4967-81fb-5f373c374ed9-console-oauth-config\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.563899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.563831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-console-config\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.563899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.563866    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-trusted-ca-bundle\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.563967 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.563897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe1899d1-c74a-4967-81fb-5f373c374ed9-oauth-serving-cert\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.568511 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.568492    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nvtx\" (UniqueName: \"kubernetes.io/projected/fe1899d1-c74a-4967-81fb-5f373c374ed9-kube-api-access-2nvtx\") pod \"console-6986d97c98-rg6pg\" (UID: \"fe1899d1-c74a-4967-81fb-5f373c374ed9\") " pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.639224 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.639166    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:39.909872 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:39.909823    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6986d97c98-rg6pg"]
Sep 11 19:39:39.912205 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:39:39.912172    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1899d1_c74a_4967_81fb_5f373c374ed9.slice/crio-f7df393ec7cd53d7621524aa7b506543afd4dafa4910bf466765084dfaae1072 WatchSource:0}: Error finding container f7df393ec7cd53d7621524aa7b506543afd4dafa4910bf466765084dfaae1072: Status 404 returned error can't find the container with id f7df393ec7cd53d7621524aa7b506543afd4dafa4910bf466765084dfaae1072
Sep 11 19:39:40.583957 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:40.583924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6986d97c98-rg6pg" event={"ID":"fe1899d1-c74a-4967-81fb-5f373c374ed9","Type":"ContainerStarted","Data":"4ae13237349dec572de8243f972dbb71ac76276023a4ac196dd60b94cdcbeeff"}
Sep 11 19:39:40.584357 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:40.583971    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6986d97c98-rg6pg" event={"ID":"fe1899d1-c74a-4967-81fb-5f373c374ed9","Type":"ContainerStarted","Data":"f7df393ec7cd53d7621524aa7b506543afd4dafa4910bf466765084dfaae1072"}
Sep 11 19:39:40.603178 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:40.603133    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6986d97c98-rg6pg" podStartSLOduration=1.603117497 podStartE2EDuration="1.603117497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:39:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:39:40.601823248 +0000 UTC m=+614.835896692" watchObservedRunningTime="2026-09-11 19:39:40.603117497 +0000 UTC m=+614.837190918"
Sep 11 19:39:47.572756 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:47.572684    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cccd5967-t9f5k"
Sep 11 19:39:49.639361 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:49.639326    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:49.639754 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:49.639389    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:49.644128 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:49.644106    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:50.636791 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:50.636765    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6986d97c98-rg6pg"
Sep 11 19:39:50.684357 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:39:50.684328    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d97f495cb-gd7vn"]
Sep 11 19:40:10.012363 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.012331    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"]
Sep 11 19:40:10.019479 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.019459    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:10.022324 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.022297    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 19:40:10.022430 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.022325    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 19:40:10.030951 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.030932    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"]
Sep 11 19:40:10.113437 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.113413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2fnq\" (UniqueName: \"kubernetes.io/projected/64bd7522-4040-4b66-9d06-4b464f925695-kube-api-access-v2fnq\") pod \"kube-auth-proxy-5d55d58b74-z2fdn\" (UID: \"64bd7522-4040-4b66-9d06-4b464f925695\") " pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:10.113573 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.113450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64bd7522-4040-4b66-9d06-4b464f925695-tmp\") pod \"kube-auth-proxy-5d55d58b74-z2fdn\" (UID: \"64bd7522-4040-4b66-9d06-4b464f925695\") " pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:10.113573 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.113475    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64bd7522-4040-4b66-9d06-4b464f925695-tls-certs\") pod \"kube-auth-proxy-5d55d58b74-z2fdn\" (UID: \"64bd7522-4040-4b66-9d06-4b464f925695\") " pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:10.213927 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.213897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2fnq\" (UniqueName: \"kubernetes.io/projected/64bd7522-4040-4b66-9d06-4b464f925695-kube-api-access-v2fnq\") pod \"kube-auth-proxy-5d55d58b74-z2fdn\" (UID: \"64bd7522-4040-4b66-9d06-4b464f925695\") " pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:10.214069 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.213936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64bd7522-4040-4b66-9d06-4b464f925695-tmp\") pod \"kube-auth-proxy-5d55d58b74-z2fdn\" (UID: \"64bd7522-4040-4b66-9d06-4b464f925695\") " pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:10.214069 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.213960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64bd7522-4040-4b66-9d06-4b464f925695-tls-certs\") pod \"kube-auth-proxy-5d55d58b74-z2fdn\" (UID: \"64bd7522-4040-4b66-9d06-4b464f925695\") " pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:10.214069 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:40:10.214046    2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 11 19:40:10.214166 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:40:10.214097    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64bd7522-4040-4b66-9d06-4b464f925695-tls-certs podName:64bd7522-4040-4b66-9d06-4b464f925695 nodeName:}" failed. No retries permitted until 2026-09-11 19:40:10.714082212 +0000 UTC m=+644.948155627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/64bd7522-4040-4b66-9d06-4b464f925695-tls-certs") pod "kube-auth-proxy-5d55d58b74-z2fdn" (UID: "64bd7522-4040-4b66-9d06-4b464f925695") : secret "kube-auth-proxy-tls" not found
Sep 11 19:40:10.216320 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.216301    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64bd7522-4040-4b66-9d06-4b464f925695-tmp\") pod \"kube-auth-proxy-5d55d58b74-z2fdn\" (UID: \"64bd7522-4040-4b66-9d06-4b464f925695\") " pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:10.232098 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.232076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2fnq\" (UniqueName: \"kubernetes.io/projected/64bd7522-4040-4b66-9d06-4b464f925695-kube-api-access-v2fnq\") pod \"kube-auth-proxy-5d55d58b74-z2fdn\" (UID: \"64bd7522-4040-4b66-9d06-4b464f925695\") " pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:10.718657 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.718614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64bd7522-4040-4b66-9d06-4b464f925695-tls-certs\") pod \"kube-auth-proxy-5d55d58b74-z2fdn\" (UID: \"64bd7522-4040-4b66-9d06-4b464f925695\") " pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:10.721526 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.721498    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64bd7522-4040-4b66-9d06-4b464f925695-tls-certs\") pod \"kube-auth-proxy-5d55d58b74-z2fdn\" (UID: \"64bd7522-4040-4b66-9d06-4b464f925695\") " pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:10.929788 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:10.929753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"
Sep 11 19:40:11.211495 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.211467    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn"]
Sep 11 19:40:11.213189 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:40:11.213163    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64bd7522_4040_4b66_9d06_4b464f925695.slice/crio-b5ff77f54587267cd98a60e37adb8b0e7cd97c9cd04f7bc320d96ae611c578d5 WatchSource:0}: Error finding container b5ff77f54587267cd98a60e37adb8b0e7cd97c9cd04f7bc320d96ae611c578d5: Status 404 returned error can't find the container with id b5ff77f54587267cd98a60e37adb8b0e7cd97c9cd04f7bc320d96ae611c578d5
Sep 11 19:40:11.724854 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.724819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn" event={"ID":"64bd7522-4040-4b66-9d06-4b464f925695","Type":"ContainerStarted","Data":"b5ff77f54587267cd98a60e37adb8b0e7cd97c9cd04f7bc320d96ae611c578d5"}
Sep 11 19:40:11.755376 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.755347    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"]
Sep 11 19:40:11.758007 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.757993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.760423 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.760402    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 19:40:11.760972 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.760957    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 19:40:11.761065 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.761046    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 19:40:11.761129 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.761059    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 19:40:11.761184 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.761063    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-p95qw\""
Sep 11 19:40:11.775306 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.775285    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"]
Sep 11 19:40:11.828711 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.828678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.828865 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.828738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.828865 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.828766    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcb65\" (UniqueName: \"kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-kube-api-access-wcb65\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.828865 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.828822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f86e982-9ff5-47e6-b01e-1bfd439122df-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.829061 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.828889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.829061 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.828941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.829061 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.829027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.929632 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.929595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f86e982-9ff5-47e6-b01e-1bfd439122df-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.929788 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.929639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.929788 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.929682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.929788 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.929723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.929788 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.929776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.930015 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.929814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.930015 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.929834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcb65\" (UniqueName: \"kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-kube-api-access-wcb65\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.930555 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.930518    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.932877 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.932814    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.932877 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.932825    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.933040 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.932939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.933040 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.932951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f86e982-9ff5-47e6-b01e-1bfd439122df-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.938403 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.938362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:11.939982 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:11.939957    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcb65\" (UniqueName: \"kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-kube-api-access-wcb65\") pod \"istiod-openshift-gateway-7b7995d5cd-t8dtn\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:12.067729 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:12.067700    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:12.358949 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:12.358912    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"]
Sep 11 19:40:12.362181 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:40:12.362153    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f86e982_9ff5_47e6_b01e_1bfd439122df.slice/crio-812b499da6712c003fa51c72ff6b12f802315fe064dae66d087d590a5b1a28a8 WatchSource:0}: Error finding container 812b499da6712c003fa51c72ff6b12f802315fe064dae66d087d590a5b1a28a8: Status 404 returned error can't find the container with id 812b499da6712c003fa51c72ff6b12f802315fe064dae66d087d590a5b1a28a8
Sep 11 19:40:12.733592 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:12.733492    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn" event={"ID":"4f86e982-9ff5-47e6-b01e-1bfd439122df","Type":"ContainerStarted","Data":"812b499da6712c003fa51c72ff6b12f802315fe064dae66d087d590a5b1a28a8"}
Sep 11 19:40:14.744788 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:14.744752    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn" event={"ID":"64bd7522-4040-4b66-9d06-4b464f925695","Type":"ContainerStarted","Data":"29494b6dda7ad4502aa738a152bb98329d1a05f295f181ad173a44ae2f5ee4e6"}
Sep 11 19:40:14.761686 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:14.761641    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn" podStartSLOduration=3.06424436 podStartE2EDuration="5.761625835s" totalImagesPullingTime="2.697381475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:40:14.760531478 +0000 UTC m=+648.994604900" watchObservedRunningTime="2026-09-11 19:40:14.761625835 +0000 UTC m=+648.995699316"
Sep 11 19:40:15.706086 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:15.706039    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d97f495cb-gd7vn" podUID="205625d8-85c7-41ce-80c3-627463548de0" containerName="console" containerID="cri-o://e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f" gracePeriod=15
Sep 11 19:40:15.954216 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:15.954191    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:40:16.070247 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070216    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bhvw\" (UniqueName: \"kubernetes.io/projected/205625d8-85c7-41ce-80c3-627463548de0-kube-api-access-2bhvw\") pod \"205625d8-85c7-41ce-80c3-627463548de0\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") "
Sep 11 19:40:16.070404 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070273    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-oauth-serving-cert\") pod \"205625d8-85c7-41ce-80c3-627463548de0\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") "
Sep 11 19:40:16.070404 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070299    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-service-ca\") pod \"205625d8-85c7-41ce-80c3-627463548de0\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") "
Sep 11 19:40:16.070404 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070369    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-console-config\") pod \"205625d8-85c7-41ce-80c3-627463548de0\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") "
Sep 11 19:40:16.070404 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070395    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-oauth-config\") pod \"205625d8-85c7-41ce-80c3-627463548de0\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") "
Sep 11 19:40:16.070616 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070423    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-trusted-ca-bundle\") pod \"205625d8-85c7-41ce-80c3-627463548de0\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") "
Sep 11 19:40:16.070616 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070458    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-serving-cert\") pod \"205625d8-85c7-41ce-80c3-627463548de0\" (UID: \"205625d8-85c7-41ce-80c3-627463548de0\") "
Sep 11 19:40:16.070727 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070701    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "205625d8-85c7-41ce-80c3-627463548de0" (UID: "205625d8-85c7-41ce-80c3-627463548de0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:40:16.070872 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070835    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-console-config" (OuterVolumeSpecName: "console-config") pod "205625d8-85c7-41ce-80c3-627463548de0" (UID: "205625d8-85c7-41ce-80c3-627463548de0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:40:16.070872 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070860    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-oauth-serving-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:16.071005 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070840    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-service-ca" (OuterVolumeSpecName: "service-ca") pod "205625d8-85c7-41ce-80c3-627463548de0" (UID: "205625d8-85c7-41ce-80c3-627463548de0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:40:16.071005 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.070924    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "205625d8-85c7-41ce-80c3-627463548de0" (UID: "205625d8-85c7-41ce-80c3-627463548de0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:40:16.072905 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.072888    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "205625d8-85c7-41ce-80c3-627463548de0" (UID: "205625d8-85c7-41ce-80c3-627463548de0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:40:16.073106 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.073087    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "205625d8-85c7-41ce-80c3-627463548de0" (UID: "205625d8-85c7-41ce-80c3-627463548de0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:40:16.073158 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.073118    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/205625d8-85c7-41ce-80c3-627463548de0-kube-api-access-2bhvw" (OuterVolumeSpecName: "kube-api-access-2bhvw") pod "205625d8-85c7-41ce-80c3-627463548de0" (UID: "205625d8-85c7-41ce-80c3-627463548de0"). InnerVolumeSpecName "kube-api-access-2bhvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:40:16.171321 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.171279    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bhvw\" (UniqueName: \"kubernetes.io/projected/205625d8-85c7-41ce-80c3-627463548de0-kube-api-access-2bhvw\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:16.171321 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.171319    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:16.171321 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.171333    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-console-config\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:16.171532 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.171345    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-oauth-config\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:16.171532 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.171355    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/205625d8-85c7-41ce-80c3-627463548de0-trusted-ca-bundle\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:16.171532 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.171367    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/205625d8-85c7-41ce-80c3-627463548de0-console-serving-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:16.755409 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.755375    2578 generic.go:356] "Generic (PLEG): container finished" podID="205625d8-85c7-41ce-80c3-627463548de0" containerID="e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f" exitCode=0
Sep 11 19:40:16.755568 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.755427    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d97f495cb-gd7vn"
Sep 11 19:40:16.755568 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.755438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d97f495cb-gd7vn" event={"ID":"205625d8-85c7-41ce-80c3-627463548de0","Type":"ContainerDied","Data":"e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f"}
Sep 11 19:40:16.755568 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.755477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d97f495cb-gd7vn" event={"ID":"205625d8-85c7-41ce-80c3-627463548de0","Type":"ContainerDied","Data":"92fac80c5e01510406755654700420c052e01feeea986603246bfdf0e8fa3731"}
Sep 11 19:40:16.755568 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.755495    2578 scope.go:117] "RemoveContainer" containerID="e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f"
Sep 11 19:40:16.764234 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.764218    2578 scope.go:117] "RemoveContainer" containerID="e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f"
Sep 11 19:40:16.764522 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:40:16.764504    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f\": container with ID starting with e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f not found: ID does not exist" containerID="e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f"
Sep 11 19:40:16.764567 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.764531    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f"} err="failed to get container status \"e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f\": rpc error: code = NotFound desc = could not find container \"e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f\": container with ID starting with e7e2fc0f73f576cd3fbeb72368fb64c14407530e98db9097e7940c6d111ab83f not found: ID does not exist"
Sep 11 19:40:16.774543 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.774524    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d97f495cb-gd7vn"]
Sep 11 19:40:16.778375 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:16.778353    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d97f495cb-gd7vn"]
Sep 11 19:40:18.256722 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:18.256690    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="205625d8-85c7-41ce-80c3-627463548de0" path="/var/lib/kubelet/pods/205625d8-85c7-41ce-80c3-627463548de0/volumes"
Sep 11 19:40:21.394974 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:21.394938    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:40:21.395287 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:21.395011    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:40:21.785183 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:21.785094    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn" event={"ID":"4f86e982-9ff5-47e6-b01e-1bfd439122df","Type":"ContainerStarted","Data":"30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e"}
Sep 11 19:40:21.785183 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:21.785164    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:21.810185 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:21.810129    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn" podStartSLOduration=1.779581988 podStartE2EDuration="10.810107419s" totalImagesPullingTime="9.030525431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:40:21.806759157 +0000 UTC m=+656.040832580" watchObservedRunningTime="2026-09-11 19:40:21.810107419 +0000 UTC m=+656.044180866"
Sep 11 19:40:22.792368 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:22.792336    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-t8dtn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:40:22.792836 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:22.792401    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn" podUID="4f86e982-9ff5-47e6-b01e-1bfd439122df" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:40:25.792329 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:25.792296    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:30.577695 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.577661    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"]
Sep 11 19:40:30.578051 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.577987    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="205625d8-85c7-41ce-80c3-627463548de0" containerName="console"
Sep 11 19:40:30.578051 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.577998    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="205625d8-85c7-41ce-80c3-627463548de0" containerName="console"
Sep 11 19:40:30.578119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.578073    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="205625d8-85c7-41ce-80c3-627463548de0" containerName="console"
Sep 11 19:40:30.582200 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.582181    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:40:30.585709 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.585688    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 19:40:30.585834 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.585719    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dsg2w\""
Sep 11 19:40:30.598449 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.598430    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"]
Sep 11 19:40:30.607742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.607718    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"]
Sep 11 19:40:30.610952 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.610936    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"
Sep 11 19:40:30.613847 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.613817    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vjngf\""
Sep 11 19:40:30.613990 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.613971    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 19:40:30.624362 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.624341    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"]
Sep 11 19:40:30.703492 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.703453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnj5z\" (UniqueName: \"kubernetes.io/projected/4514493c-badd-4bf0-aad9-6f9b1561d45b-kube-api-access-qnj5z\") pod \"kserve-controller-manager-d6f4b65b8-nnj8n\" (UID: \"4514493c-badd-4bf0-aad9-6f9b1561d45b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:40:30.703662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.703507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdjh5\" (UniqueName: \"kubernetes.io/projected/f0438961-484c-4373-915f-876376264315-kube-api-access-tdjh5\") pod \"llmisvc-controller-manager-777c6bd7d5-bjr5k\" (UID: \"f0438961-484c-4373-915f-876376264315\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"
Sep 11 19:40:30.703662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.703583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4514493c-badd-4bf0-aad9-6f9b1561d45b-cert\") pod \"kserve-controller-manager-d6f4b65b8-nnj8n\" (UID: \"4514493c-badd-4bf0-aad9-6f9b1561d45b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:40:30.703662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.703639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0438961-484c-4373-915f-876376264315-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bjr5k\" (UID: \"f0438961-484c-4373-915f-876376264315\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"
Sep 11 19:40:30.804203 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.804172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnj5z\" (UniqueName: \"kubernetes.io/projected/4514493c-badd-4bf0-aad9-6f9b1561d45b-kube-api-access-qnj5z\") pod \"kserve-controller-manager-d6f4b65b8-nnj8n\" (UID: \"4514493c-badd-4bf0-aad9-6f9b1561d45b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:40:30.804437 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.804230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdjh5\" (UniqueName: \"kubernetes.io/projected/f0438961-484c-4373-915f-876376264315-kube-api-access-tdjh5\") pod \"llmisvc-controller-manager-777c6bd7d5-bjr5k\" (UID: \"f0438961-484c-4373-915f-876376264315\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"
Sep 11 19:40:30.804437 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.804354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4514493c-badd-4bf0-aad9-6f9b1561d45b-cert\") pod \"kserve-controller-manager-d6f4b65b8-nnj8n\" (UID: \"4514493c-badd-4bf0-aad9-6f9b1561d45b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:40:30.804437 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.804386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0438961-484c-4373-915f-876376264315-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bjr5k\" (UID: \"f0438961-484c-4373-915f-876376264315\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"
Sep 11 19:40:30.804594 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:40:30.804506    2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 19:40:30.804594 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:40:30.804563    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4514493c-badd-4bf0-aad9-6f9b1561d45b-cert podName:4514493c-badd-4bf0-aad9-6f9b1561d45b nodeName:}" failed. No retries permitted until 2026-09-11 19:40:31.304547506 +0000 UTC m=+665.538620908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4514493c-badd-4bf0-aad9-6f9b1561d45b-cert") pod "kserve-controller-manager-d6f4b65b8-nnj8n" (UID: "4514493c-badd-4bf0-aad9-6f9b1561d45b") : secret "kserve-webhook-server-cert" not found
Sep 11 19:40:30.807093 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.807062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0438961-484c-4373-915f-876376264315-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bjr5k\" (UID: \"f0438961-484c-4373-915f-876376264315\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"
Sep 11 19:40:30.824515 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.824479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnj5z\" (UniqueName: \"kubernetes.io/projected/4514493c-badd-4bf0-aad9-6f9b1561d45b-kube-api-access-qnj5z\") pod \"kserve-controller-manager-d6f4b65b8-nnj8n\" (UID: \"4514493c-badd-4bf0-aad9-6f9b1561d45b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:40:30.824515 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.824498    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdjh5\" (UniqueName: \"kubernetes.io/projected/f0438961-484c-4373-915f-876376264315-kube-api-access-tdjh5\") pod \"llmisvc-controller-manager-777c6bd7d5-bjr5k\" (UID: \"f0438961-484c-4373-915f-876376264315\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"
Sep 11 19:40:30.922642 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:30.922566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"
Sep 11 19:40:31.200479 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:31.200388    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"]
Sep 11 19:40:31.203112 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:40:31.203075    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf0438961_484c_4373_915f_876376264315.slice/crio-5141e6b83ae468df936320722b5328aa1616b5e0ba92af0e4dce51675df26521 WatchSource:0}: Error finding container 5141e6b83ae468df936320722b5328aa1616b5e0ba92af0e4dce51675df26521: Status 404 returned error can't find the container with id 5141e6b83ae468df936320722b5328aa1616b5e0ba92af0e4dce51675df26521
Sep 11 19:40:31.308911 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:31.308875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4514493c-badd-4bf0-aad9-6f9b1561d45b-cert\") pod \"kserve-controller-manager-d6f4b65b8-nnj8n\" (UID: \"4514493c-badd-4bf0-aad9-6f9b1561d45b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:40:31.309079 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:40:31.308992    2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 19:40:31.309079 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:40:31.309043    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4514493c-badd-4bf0-aad9-6f9b1561d45b-cert podName:4514493c-badd-4bf0-aad9-6f9b1561d45b nodeName:}" failed. No retries permitted until 2026-09-11 19:40:32.309031005 +0000 UTC m=+666.543104404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4514493c-badd-4bf0-aad9-6f9b1561d45b-cert") pod "kserve-controller-manager-d6f4b65b8-nnj8n" (UID: "4514493c-badd-4bf0-aad9-6f9b1561d45b") : secret "kserve-webhook-server-cert" not found
Sep 11 19:40:31.836075 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:31.836039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k" event={"ID":"f0438961-484c-4373-915f-876376264315","Type":"ContainerStarted","Data":"5141e6b83ae468df936320722b5328aa1616b5e0ba92af0e4dce51675df26521"}
Sep 11 19:40:32.318026 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:32.317990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4514493c-badd-4bf0-aad9-6f9b1561d45b-cert\") pod \"kserve-controller-manager-d6f4b65b8-nnj8n\" (UID: \"4514493c-badd-4bf0-aad9-6f9b1561d45b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:40:32.320662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:32.320630    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4514493c-badd-4bf0-aad9-6f9b1561d45b-cert\") pod \"kserve-controller-manager-d6f4b65b8-nnj8n\" (UID: \"4514493c-badd-4bf0-aad9-6f9b1561d45b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:40:32.392438 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:32.392399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:40:32.743438 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:32.743344    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"]
Sep 11 19:40:32.748152 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:40:32.748122    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4514493c_badd_4bf0_aad9_6f9b1561d45b.slice/crio-4eb8834aa371e76b0c31fdd39b3efe33939d29b677f5ee17cf720d51e6a2c915 WatchSource:0}: Error finding container 4eb8834aa371e76b0c31fdd39b3efe33939d29b677f5ee17cf720d51e6a2c915: Status 404 returned error can't find the container with id 4eb8834aa371e76b0c31fdd39b3efe33939d29b677f5ee17cf720d51e6a2c915
Sep 11 19:40:32.841437 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:32.841408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n" event={"ID":"4514493c-badd-4bf0-aad9-6f9b1561d45b","Type":"ContainerStarted","Data":"4eb8834aa371e76b0c31fdd39b3efe33939d29b677f5ee17cf720d51e6a2c915"}
Sep 11 19:40:33.077838 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.077808    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"]
Sep 11 19:40:33.078111 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.078087    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn" podUID="4f86e982-9ff5-47e6-b01e-1bfd439122df" containerName="discovery" containerID="cri-o://30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e" gracePeriod=30
Sep 11 19:40:33.750859 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.750835    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:33.848738 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.848695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k" event={"ID":"f0438961-484c-4373-915f-876376264315","Type":"ContainerStarted","Data":"31f0e01265ba6bb5fec0fd7193db7cacfad50ee7b64f308d767d11ef1ae0e783"}
Sep 11 19:40:33.849124 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.848764    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"
Sep 11 19:40:33.850409 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.850380    2578 generic.go:356] "Generic (PLEG): container finished" podID="4f86e982-9ff5-47e6-b01e-1bfd439122df" containerID="30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e" exitCode=0
Sep 11 19:40:33.850544 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.850437    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"
Sep 11 19:40:33.850544 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.850445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn" event={"ID":"4f86e982-9ff5-47e6-b01e-1bfd439122df","Type":"ContainerDied","Data":"30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e"}
Sep 11 19:40:33.850544 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.850489    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn" event={"ID":"4f86e982-9ff5-47e6-b01e-1bfd439122df","Type":"ContainerDied","Data":"812b499da6712c003fa51c72ff6b12f802315fe064dae66d087d590a5b1a28a8"}
Sep 11 19:40:33.850671 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.850511    2578 scope.go:117] "RemoveContainer" containerID="30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e"
Sep 11 19:40:33.860681 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.860652    2578 scope.go:117] "RemoveContainer" containerID="30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e"
Sep 11 19:40:33.861012 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:40:33.860985    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e\": container with ID starting with 30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e not found: ID does not exist" containerID="30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e"
Sep 11 19:40:33.861105 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.861038    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e"} err="failed to get container status \"30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e\": rpc error: code = NotFound desc = could not find container \"30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e\": container with ID starting with 30bf8241751566d671d870f130f18f0324e1842c7abd3b0c4b45ceb2654d444e not found: ID does not exist"
Sep 11 19:40:33.867072 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.867024    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k" podStartSLOduration=1.4199774170000001 podStartE2EDuration="3.867008193s" totalImagesPullingTime="2.447030776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:40:33.866176406 +0000 UTC m=+668.100249828" watchObservedRunningTime="2026-09-11 19:40:33.867008193 +0000 UTC m=+668.101081615"
Sep 11 19:40:33.932013 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.931986    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-cacerts\") pod \"4f86e982-9ff5-47e6-b01e-1bfd439122df\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") "
Sep 11 19:40:33.932187 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.932028    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcb65\" (UniqueName: \"kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-kube-api-access-wcb65\") pod \"4f86e982-9ff5-47e6-b01e-1bfd439122df\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") "
Sep 11 19:40:33.932187 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.932081    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-token\") pod \"4f86e982-9ff5-47e6-b01e-1bfd439122df\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") "
Sep 11 19:40:33.932187 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.932127    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-ca-configmap\") pod \"4f86e982-9ff5-47e6-b01e-1bfd439122df\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") "
Sep 11 19:40:33.932187 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.932164    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f86e982-9ff5-47e6-b01e-1bfd439122df-local-certs\") pod \"4f86e982-9ff5-47e6-b01e-1bfd439122df\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") "
Sep 11 19:40:33.932442 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.932218    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-kubeconfig\") pod \"4f86e982-9ff5-47e6-b01e-1bfd439122df\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") "
Sep 11 19:40:33.932442 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.932285    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-dns-cert\") pod \"4f86e982-9ff5-47e6-b01e-1bfd439122df\" (UID: \"4f86e982-9ff5-47e6-b01e-1bfd439122df\") "
Sep 11 19:40:33.933000 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.932954    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4f86e982-9ff5-47e6-b01e-1bfd439122df" (UID: "4f86e982-9ff5-47e6-b01e-1bfd439122df"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:40:33.934800 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.934773    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-cacerts" (OuterVolumeSpecName: "cacerts") pod "4f86e982-9ff5-47e6-b01e-1bfd439122df" (UID: "4f86e982-9ff5-47e6-b01e-1bfd439122df"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:40:33.934906 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.934872    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4f86e982-9ff5-47e6-b01e-1bfd439122df" (UID: "4f86e982-9ff5-47e6-b01e-1bfd439122df"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:40:33.935091 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.935067    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4f86e982-9ff5-47e6-b01e-1bfd439122df" (UID: "4f86e982-9ff5-47e6-b01e-1bfd439122df"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:40:33.935188 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.935169    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-kube-api-access-wcb65" (OuterVolumeSpecName: "kube-api-access-wcb65") pod "4f86e982-9ff5-47e6-b01e-1bfd439122df" (UID: "4f86e982-9ff5-47e6-b01e-1bfd439122df"). InnerVolumeSpecName "kube-api-access-wcb65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:40:33.935225 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.935203    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f86e982-9ff5-47e6-b01e-1bfd439122df" (UID: "4f86e982-9ff5-47e6-b01e-1bfd439122df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:40:33.935889 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:33.935865    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f86e982-9ff5-47e6-b01e-1bfd439122df-local-certs" (OuterVolumeSpecName: "local-certs") pod "4f86e982-9ff5-47e6-b01e-1bfd439122df" (UID: "4f86e982-9ff5-47e6-b01e-1bfd439122df"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:40:34.033617 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:34.033581    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-token\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:34.033617 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:34.033613    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-ca-configmap\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:34.033850 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:34.033626    2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f86e982-9ff5-47e6-b01e-1bfd439122df-local-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:34.033850 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:34.033638    2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-kubeconfig\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:34.033850 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:34.033649    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-istio-csr-dns-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:34.033850 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:34.033659    2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4f86e982-9ff5-47e6-b01e-1bfd439122df-cacerts\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:34.033850 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:34.033670    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcb65\" (UniqueName: \"kubernetes.io/projected/4f86e982-9ff5-47e6-b01e-1bfd439122df-kube-api-access-wcb65\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:40:34.176552 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:34.176516    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"]
Sep 11 19:40:34.183619 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:34.183596    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn"]
Sep 11 19:40:34.257583 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:34.257540    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f86e982-9ff5-47e6-b01e-1bfd439122df" path="/var/lib/kubelet/pods/4f86e982-9ff5-47e6-b01e-1bfd439122df/volumes"
Sep 11 19:40:35.863812 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:35.863779    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n" event={"ID":"4514493c-badd-4bf0-aad9-6f9b1561d45b","Type":"ContainerStarted","Data":"e4ce369861527444007e08c289640c5d4738edf47e6cd0afbce20d7f5c8ae25a"}
Sep 11 19:40:35.864208 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:35.863897    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:40:35.880428 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:40:35.880379    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n" podStartSLOduration=3.300791565 podStartE2EDuration="5.880324683s" totalImagesPullingTime="2.579533118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:40:35.879501631 +0000 UTC m=+670.113575053" watchObservedRunningTime="2026-09-11 19:40:35.880324683 +0000 UTC m=+670.114398105"
Sep 11 19:41:04.860320 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:04.860290    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bjr5k"
Sep 11 19:41:06.874379 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:06.874347    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnj8n"
Sep 11 19:41:38.806153 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:38.806118    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-zcmvw"]
Sep 11 19:41:38.806677 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:38.806473    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f86e982-9ff5-47e6-b01e-1bfd439122df" containerName="discovery"
Sep 11 19:41:38.806677 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:38.806485    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f86e982-9ff5-47e6-b01e-1bfd439122df" containerName="discovery"
Sep 11 19:41:38.806677 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:38.806551    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f86e982-9ff5-47e6-b01e-1bfd439122df" containerName="discovery"
Sep 11 19:41:38.809160 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:38.809146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-zcmvw"
Sep 11 19:41:38.812352 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:38.812333    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 19:41:38.812484 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:38.812390    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-685pr\""
Sep 11 19:41:38.813516 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:38.813499    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 19:41:38.820394 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:38.820376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-zcmvw"]
Sep 11 19:41:38.894794 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:38.894759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggqqx\" (UniqueName: \"kubernetes.io/projected/d28f57b4-d701-4deb-9d1a-2fac325c8766-kube-api-access-ggqqx\") pod \"authorino-operator-76b478bd78-zcmvw\" (UID: \"d28f57b4-d701-4deb-9d1a-2fac325c8766\") " pod="kuadrant-system/authorino-operator-76b478bd78-zcmvw"
Sep 11 19:41:38.995857 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:38.995821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqqx\" (UniqueName: \"kubernetes.io/projected/d28f57b4-d701-4deb-9d1a-2fac325c8766-kube-api-access-ggqqx\") pod \"authorino-operator-76b478bd78-zcmvw\" (UID: \"d28f57b4-d701-4deb-9d1a-2fac325c8766\") " pod="kuadrant-system/authorino-operator-76b478bd78-zcmvw"
Sep 11 19:41:39.028744 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:39.028715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggqqx\" (UniqueName: \"kubernetes.io/projected/d28f57b4-d701-4deb-9d1a-2fac325c8766-kube-api-access-ggqqx\") pod \"authorino-operator-76b478bd78-zcmvw\" (UID: \"d28f57b4-d701-4deb-9d1a-2fac325c8766\") " pod="kuadrant-system/authorino-operator-76b478bd78-zcmvw"
Sep 11 19:41:39.119924 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:39.119890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-zcmvw"
Sep 11 19:41:39.398458 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:39.398433    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-zcmvw"]
Sep 11 19:41:39.401134 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:41:39.401101    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28f57b4_d701_4deb_9d1a_2fac325c8766.slice/crio-e334ba8d232bdfb4ba2d9ab46cc51a9ca0eb31b06c1e5697aeedde7ceb63c706 WatchSource:0}: Error finding container e334ba8d232bdfb4ba2d9ab46cc51a9ca0eb31b06c1e5697aeedde7ceb63c706: Status 404 returned error can't find the container with id e334ba8d232bdfb4ba2d9ab46cc51a9ca0eb31b06c1e5697aeedde7ceb63c706
Sep 11 19:41:40.171927 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:40.171895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-zcmvw" event={"ID":"d28f57b4-d701-4deb-9d1a-2fac325c8766","Type":"ContainerStarted","Data":"e334ba8d232bdfb4ba2d9ab46cc51a9ca0eb31b06c1e5697aeedde7ceb63c706"}
Sep 11 19:41:43.265177 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.265145    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"]
Sep 11 19:41:43.267834 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.267819    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:41:43.270249 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.270231    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pt62h\""
Sep 11 19:41:43.290731 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.290710    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"]
Sep 11 19:41:43.333341 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.333317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31b918e3-a974-4cf1-a3dc-f577f4c8be80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" (UID: \"31b918e3-a974-4cf1-a3dc-f577f4c8be80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:41:43.333472 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.333373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mm7m\" (UniqueName: \"kubernetes.io/projected/31b918e3-a974-4cf1-a3dc-f577f4c8be80-kube-api-access-7mm7m\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" (UID: \"31b918e3-a974-4cf1-a3dc-f577f4c8be80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:41:43.434548 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.434516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31b918e3-a974-4cf1-a3dc-f577f4c8be80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" (UID: \"31b918e3-a974-4cf1-a3dc-f577f4c8be80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:41:43.434689 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.434569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mm7m\" (UniqueName: \"kubernetes.io/projected/31b918e3-a974-4cf1-a3dc-f577f4c8be80-kube-api-access-7mm7m\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" (UID: \"31b918e3-a974-4cf1-a3dc-f577f4c8be80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:41:43.434928 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.434910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31b918e3-a974-4cf1-a3dc-f577f4c8be80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" (UID: \"31b918e3-a974-4cf1-a3dc-f577f4c8be80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:41:43.448079 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.448057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mm7m\" (UniqueName: \"kubernetes.io/projected/31b918e3-a974-4cf1-a3dc-f577f4c8be80-kube-api-access-7mm7m\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" (UID: \"31b918e3-a974-4cf1-a3dc-f577f4c8be80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:41:43.578052 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.578014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:41:43.882349 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:43.882326    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"]
Sep 11 19:41:43.884852 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:41:43.884826    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b918e3_a974_4cf1_a3dc_f577f4c8be80.slice/crio-37f10de261ec7beedd010ae7615df12d2b5eaf87f0a8f720399834b7f866b14a WatchSource:0}: Error finding container 37f10de261ec7beedd010ae7615df12d2b5eaf87f0a8f720399834b7f866b14a: Status 404 returned error can't find the container with id 37f10de261ec7beedd010ae7615df12d2b5eaf87f0a8f720399834b7f866b14a
Sep 11 19:41:44.191512 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:44.191431    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx" event={"ID":"31b918e3-a974-4cf1-a3dc-f577f4c8be80","Type":"ContainerStarted","Data":"37f10de261ec7beedd010ae7615df12d2b5eaf87f0a8f720399834b7f866b14a"}
Sep 11 19:41:45.511180 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:45.511143    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"]
Sep 11 19:41:45.513786 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:45.513772    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:41:45.517344 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:45.517324    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vkvr8\""
Sep 11 19:41:45.533123 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:45.533103    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"]
Sep 11 19:41:45.655300 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:45.655243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvmjt\" (UniqueName: \"kubernetes.io/projected/6e7ada85-dd78-452d-8049-5fa1b83991c4-kube-api-access-jvmjt\") pod \"limitador-operator-controller-manager-74495c69f8-fp4lc\" (UID: \"6e7ada85-dd78-452d-8049-5fa1b83991c4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:41:45.756683 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:45.756650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvmjt\" (UniqueName: \"kubernetes.io/projected/6e7ada85-dd78-452d-8049-5fa1b83991c4-kube-api-access-jvmjt\") pod \"limitador-operator-controller-manager-74495c69f8-fp4lc\" (UID: \"6e7ada85-dd78-452d-8049-5fa1b83991c4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:41:45.771713 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:45.771657    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvmjt\" (UniqueName: \"kubernetes.io/projected/6e7ada85-dd78-452d-8049-5fa1b83991c4-kube-api-access-jvmjt\") pod \"limitador-operator-controller-manager-74495c69f8-fp4lc\" (UID: \"6e7ada85-dd78-452d-8049-5fa1b83991c4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:41:45.824220 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:45.824192    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:41:46.101237 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:46.101125    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"]
Sep 11 19:41:46.103463 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:41:46.103436    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7ada85_dd78_452d_8049_5fa1b83991c4.slice/crio-48d99ce75fdd3cace419646fe07b80a2b17a52fe6156746017115a86fd0022b4 WatchSource:0}: Error finding container 48d99ce75fdd3cace419646fe07b80a2b17a52fe6156746017115a86fd0022b4: Status 404 returned error can't find the container with id 48d99ce75fdd3cace419646fe07b80a2b17a52fe6156746017115a86fd0022b4
Sep 11 19:41:46.202320 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:46.202279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc" event={"ID":"6e7ada85-dd78-452d-8049-5fa1b83991c4","Type":"ContainerStarted","Data":"48d99ce75fdd3cace419646fe07b80a2b17a52fe6156746017115a86fd0022b4"}
Sep 11 19:41:47.735680 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:47.734303    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq"]
Sep 11 19:41:47.738554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:47.737743    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq"
Sep 11 19:41:47.743397 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:47.743006    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-27l6r\""
Sep 11 19:41:47.743397 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:47.743244    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 19:41:47.753777 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:47.753723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq"]
Sep 11 19:41:47.875735 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:47.875611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzcd9\" (UniqueName: \"kubernetes.io/projected/4d173d20-f015-442e-9bbd-0a6eb77a24a8-kube-api-access-tzcd9\") pod \"dns-operator-controller-manager-7b84cd7c9c-rwwhq\" (UID: \"4d173d20-f015-442e-9bbd-0a6eb77a24a8\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq"
Sep 11 19:41:47.976512 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:47.976478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzcd9\" (UniqueName: \"kubernetes.io/projected/4d173d20-f015-442e-9bbd-0a6eb77a24a8-kube-api-access-tzcd9\") pod \"dns-operator-controller-manager-7b84cd7c9c-rwwhq\" (UID: \"4d173d20-f015-442e-9bbd-0a6eb77a24a8\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq"
Sep 11 19:41:47.991857 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:47.991783    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzcd9\" (UniqueName: \"kubernetes.io/projected/4d173d20-f015-442e-9bbd-0a6eb77a24a8-kube-api-access-tzcd9\") pod \"dns-operator-controller-manager-7b84cd7c9c-rwwhq\" (UID: \"4d173d20-f015-442e-9bbd-0a6eb77a24a8\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq"
Sep 11 19:41:48.057099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:48.057064    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq"
Sep 11 19:41:50.647825 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:50.647689    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq"]
Sep 11 19:41:50.650742 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:41:50.650712    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d173d20_f015_442e_9bbd_0a6eb77a24a8.slice/crio-dab4732b1d05df3d403514388692fa561bb7552f2c1ea5a9c2df773f69239fb2 WatchSource:0}: Error finding container dab4732b1d05df3d403514388692fa561bb7552f2c1ea5a9c2df773f69239fb2: Status 404 returned error can't find the container with id dab4732b1d05df3d403514388692fa561bb7552f2c1ea5a9c2df773f69239fb2
Sep 11 19:41:51.237463 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:51.237425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq" event={"ID":"4d173d20-f015-442e-9bbd-0a6eb77a24a8","Type":"ContainerStarted","Data":"dab4732b1d05df3d403514388692fa561bb7552f2c1ea5a9c2df773f69239fb2"}
Sep 11 19:41:51.238996 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:51.238965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc" event={"ID":"6e7ada85-dd78-452d-8049-5fa1b83991c4","Type":"ContainerStarted","Data":"ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5"}
Sep 11 19:41:51.239138 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:51.239047    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:41:51.240660 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:51.240636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx" event={"ID":"31b918e3-a974-4cf1-a3dc-f577f4c8be80","Type":"ContainerStarted","Data":"cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964"}
Sep 11 19:41:51.240794 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:51.240752    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:41:51.279306 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:51.279238    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx" podStartSLOduration=1.7727819299999998 podStartE2EDuration="8.279225553s" totalImagesPullingTime="6.506443623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:41:51.279034972 +0000 UTC m=+745.513108393" watchObservedRunningTime="2026-09-11 19:41:51.279225553 +0000 UTC m=+745.513298975"
Sep 11 19:41:51.284279 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:51.280825    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc" podStartSLOduration=2.005747438 podStartE2EDuration="6.280814342s" totalImagesPullingTime="4.275066904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:41:51.25719778 +0000 UTC m=+745.491271204" watchObservedRunningTime="2026-09-11 19:41:51.280814342 +0000 UTC m=+745.514887763"
Sep 11 19:41:53.253311 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.253277    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq" event={"ID":"4d173d20-f015-442e-9bbd-0a6eb77a24a8","Type":"ContainerStarted","Data":"7d8e08ba02f8d5059003598fb32902e69303a62611502ada749119041dc599b5"}
Sep 11 19:41:53.253705 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.253398    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq"
Sep 11 19:41:53.273579 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.273534    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq" podStartSLOduration=4.130068282 podStartE2EDuration="6.273520603s" totalImagesPullingTime="2.143452321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:41:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:41:53.271791245 +0000 UTC m=+747.505864663" watchObservedRunningTime="2026-09-11 19:41:53.273520603 +0000 UTC m=+747.507594023"
Sep 11 19:41:53.427147 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.427113    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"]
Sep 11 19:41:53.429617 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.429594    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:53.433051 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.433020    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 19:41:53.433152 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.433112    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 19:41:53.433152 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.433129    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9z8fl\""
Sep 11 19:41:53.443133 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.443111    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"]
Sep 11 19:41:53.528434 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.528362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69pvz\" (UniqueName: \"kubernetes.io/projected/0e1ca10d-1813-41b1-9865-b2f79a49938b-kube-api-access-69pvz\") pod \"kuadrant-console-plugin-fbdd4f445-l8hc5\" (UID: \"0e1ca10d-1813-41b1-9865-b2f79a49938b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:53.528434 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.528423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e1ca10d-1813-41b1-9865-b2f79a49938b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-l8hc5\" (UID: \"0e1ca10d-1813-41b1-9865-b2f79a49938b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:53.528601 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.528482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e1ca10d-1813-41b1-9865-b2f79a49938b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-l8hc5\" (UID: \"0e1ca10d-1813-41b1-9865-b2f79a49938b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:53.629207 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.629162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e1ca10d-1813-41b1-9865-b2f79a49938b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-l8hc5\" (UID: \"0e1ca10d-1813-41b1-9865-b2f79a49938b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:53.629464 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.629234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69pvz\" (UniqueName: \"kubernetes.io/projected/0e1ca10d-1813-41b1-9865-b2f79a49938b-kube-api-access-69pvz\") pod \"kuadrant-console-plugin-fbdd4f445-l8hc5\" (UID: \"0e1ca10d-1813-41b1-9865-b2f79a49938b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:53.629464 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.629293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e1ca10d-1813-41b1-9865-b2f79a49938b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-l8hc5\" (UID: \"0e1ca10d-1813-41b1-9865-b2f79a49938b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:53.629464 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:41:53.629392    2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 11 19:41:53.629464 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:41:53.629450    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e1ca10d-1813-41b1-9865-b2f79a49938b-plugin-serving-cert podName:0e1ca10d-1813-41b1-9865-b2f79a49938b nodeName:}" failed. No retries permitted until 2026-09-11 19:41:54.129433346 +0000 UTC m=+748.363506767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/0e1ca10d-1813-41b1-9865-b2f79a49938b-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-l8hc5" (UID: "0e1ca10d-1813-41b1-9865-b2f79a49938b") : secret "plugin-serving-cert" not found
Sep 11 19:41:53.629770 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.629752    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e1ca10d-1813-41b1-9865-b2f79a49938b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-l8hc5\" (UID: \"0e1ca10d-1813-41b1-9865-b2f79a49938b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:53.638728 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:53.638699    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69pvz\" (UniqueName: \"kubernetes.io/projected/0e1ca10d-1813-41b1-9865-b2f79a49938b-kube-api-access-69pvz\") pod \"kuadrant-console-plugin-fbdd4f445-l8hc5\" (UID: \"0e1ca10d-1813-41b1-9865-b2f79a49938b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:54.133539 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:54.133496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e1ca10d-1813-41b1-9865-b2f79a49938b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-l8hc5\" (UID: \"0e1ca10d-1813-41b1-9865-b2f79a49938b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:54.135998 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:54.135971    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e1ca10d-1813-41b1-9865-b2f79a49938b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-l8hc5\" (UID: \"0e1ca10d-1813-41b1-9865-b2f79a49938b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:54.338916 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:54.338882    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"
Sep 11 19:41:54.610575 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:54.610546    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5"]
Sep 11 19:41:54.613779 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:41:54.613753    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e1ca10d_1813_41b1_9865_b2f79a49938b.slice/crio-31ad85847c495d52b9749da444cdb67a015da45c37b6dce829ba53330772844e WatchSource:0}: Error finding container 31ad85847c495d52b9749da444cdb67a015da45c37b6dce829ba53330772844e: Status 404 returned error can't find the container with id 31ad85847c495d52b9749da444cdb67a015da45c37b6dce829ba53330772844e
Sep 11 19:41:55.264518 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:55.264482    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5" event={"ID":"0e1ca10d-1813-41b1-9865-b2f79a49938b","Type":"ContainerStarted","Data":"31ad85847c495d52b9749da444cdb67a015da45c37b6dce829ba53330772844e"}
Sep 11 19:41:57.277606 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:57.277568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-zcmvw" event={"ID":"d28f57b4-d701-4deb-9d1a-2fac325c8766","Type":"ContainerStarted","Data":"719fbca8253a30182af7f764043c0512d4c1344c0d853d24c93f6c95aba2dc8f"}
Sep 11 19:41:57.278078 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:57.277704    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-zcmvw"
Sep 11 19:41:57.296542 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:41:57.296493    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-zcmvw" podStartSLOduration=2.101272158 podStartE2EDuration="19.296474936s" totalImagesPullingTime="17.195202778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:41:57.296393725 +0000 UTC m=+751.530467147" watchObservedRunningTime="2026-09-11 19:41:57.296474936 +0000 UTC m=+751.530548381"
Sep 11 19:42:00.294357 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:00.294325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5" event={"ID":"0e1ca10d-1813-41b1-9865-b2f79a49938b","Type":"ContainerStarted","Data":"09d3299330943679930dfc4b6f2e8671719f9b1338bb3e9492fe0f2fc75aaaef"}
Sep 11 19:42:00.312077 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:00.312033    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-l8hc5" podStartSLOduration=2.652220522 podStartE2EDuration="7.312017894s" totalImagesPullingTime="4.659797372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:42:00.310638483 +0000 UTC m=+754.544711897" watchObservedRunningTime="2026-09-11 19:42:00.312017894 +0000 UTC m=+754.546091360"
Sep 11 19:42:02.248665 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:02.248635    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:02.249104 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:02.248844    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:04.260555 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.260530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rwwhq"
Sep 11 19:42:04.513164 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.513086    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"]
Sep 11 19:42:04.515600 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.515581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:04.535493 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.535471    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"]
Sep 11 19:42:04.586125 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.586096    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"]
Sep 11 19:42:04.586375 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.586357    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-mghj4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v" podUID="3f6842b0-4139-450c-9cbb-702b14c2a108"
Sep 11 19:42:04.593590 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.593570    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"]
Sep 11 19:42:04.604008 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.603985    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"]
Sep 11 19:42:04.604226 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.604201    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" containerName="manager" containerID="cri-o://cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964" gracePeriod=2
Sep 11 19:42:04.623407 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.623383    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"]
Sep 11 19:42:04.625250 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.625225    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"]
Sep 11 19:42:04.625786 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.625768    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" containerName="manager"
Sep 11 19:42:04.625874 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.625789    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" containerName="manager"
Sep 11 19:42:04.625874 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.625870    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" containerName="manager"
Sep 11 19:42:04.627915 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.627898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:42:04.630667 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.630646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f6842b0-4139-450c-9cbb-702b14c2a108-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dmm6v\" (UID: \"3f6842b0-4139-450c-9cbb-702b14c2a108\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:04.630771 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.630696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mghj4\" (UniqueName: \"kubernetes.io/projected/3f6842b0-4139-450c-9cbb-702b14c2a108-kube-api-access-mghj4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dmm6v\" (UID: \"3f6842b0-4139-450c-9cbb-702b14c2a108\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:04.641092 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.641055    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"31b918e3-a974-4cf1-a3dc-f577f4c8be80\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-fglbx\": pods \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:04.643381 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.643357    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:04.643757 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.643731    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"]
Sep 11 19:42:04.643971 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.643934    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" containerName="manager" containerID="cri-o://ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5" gracePeriod=2
Sep 11 19:42:04.645808 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.645785    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"]
Sep 11 19:42:04.648100 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.648084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:04.658364 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.658343    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"]
Sep 11 19:42:04.680450 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.680399    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"]
Sep 11 19:42:04.693123 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.693081    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fp4lc\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:04.699601 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.699572    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"]
Sep 11 19:42:04.716033 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.716010    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt"]
Sep 11 19:42:04.716444 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.716429    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" containerName="manager"
Sep 11 19:42:04.716444 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.716446    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" containerName="manager"
Sep 11 19:42:04.716548 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.716520    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" containerName="manager"
Sep 11 19:42:04.718286 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.718247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt"
Sep 11 19:42:04.732292 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.732239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mghj4\" (UniqueName: \"kubernetes.io/projected/3f6842b0-4139-450c-9cbb-702b14c2a108-kube-api-access-mghj4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dmm6v\" (UID: \"3f6842b0-4139-450c-9cbb-702b14c2a108\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:04.732413 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.732307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv7r8\" (UniqueName: \"kubernetes.io/projected/c5dccc1d-02cf-4490-99fb-8d53da95c80c-kube-api-access-wv7r8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-frqz4\" (UID: \"c5dccc1d-02cf-4490-99fb-8d53da95c80c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:42:04.732413 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.732338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5dccc1d-02cf-4490-99fb-8d53da95c80c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-frqz4\" (UID: \"c5dccc1d-02cf-4490-99fb-8d53da95c80c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:42:04.732574 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.732542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f6842b0-4139-450c-9cbb-702b14c2a108-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dmm6v\" (UID: \"3f6842b0-4139-450c-9cbb-702b14c2a108\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:04.732842 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.732824    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f6842b0-4139-450c-9cbb-702b14c2a108-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dmm6v\" (UID: \"3f6842b0-4139-450c-9cbb-702b14c2a108\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:04.737105 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.737091    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mghj4 for pod kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v: failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-dmm6v" not found
Sep 11 19:42:04.737178 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.737146    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f6842b0-4139-450c-9cbb-702b14c2a108-kube-api-access-mghj4 podName:3f6842b0-4139-450c-9cbb-702b14c2a108 nodeName:}" failed. No retries permitted until 2026-09-11 19:42:05.237130054 +0000 UTC m=+759.471203454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mghj4" (UniqueName: "kubernetes.io/projected/3f6842b0-4139-450c-9cbb-702b14c2a108-kube-api-access-mghj4") pod "kuadrant-operator-controller-manager-5769f99d9f-dmm6v" (UID: "3f6842b0-4139-450c-9cbb-702b14c2a108") : failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-dmm6v" not found
Sep 11 19:42:04.741771 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.741751    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt"]
Sep 11 19:42:04.758734 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.758578    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:04.796718 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.796680    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fp4lc\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:04.798710 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.798669    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:04.834037 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.833962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv7r8\" (UniqueName: \"kubernetes.io/projected/c5dccc1d-02cf-4490-99fb-8d53da95c80c-kube-api-access-wv7r8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-frqz4\" (UID: \"c5dccc1d-02cf-4490-99fb-8d53da95c80c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:42:04.834037 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.834007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5dccc1d-02cf-4490-99fb-8d53da95c80c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-frqz4\" (UID: \"c5dccc1d-02cf-4490-99fb-8d53da95c80c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:42:04.834222 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.834084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a28582c-4db9-456c-9128-7263748abd89-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d5gng\" (UID: \"2a28582c-4db9-456c-9128-7263748abd89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:04.834222 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.834138    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmxxr\" (UniqueName: \"kubernetes.io/projected/2a28582c-4db9-456c-9128-7263748abd89-kube-api-access-dmxxr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d5gng\" (UID: \"2a28582c-4db9-456c-9128-7263748abd89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:04.834222 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.834177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5t68\" (UniqueName: \"kubernetes.io/projected/ce362fb8-9592-4faf-b501-b6937f4c3c9a-kube-api-access-r5t68\") pod \"limitador-operator-controller-manager-74495c69f8-6j9nt\" (UID: \"ce362fb8-9592-4faf-b501-b6937f4c3c9a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt"
Sep 11 19:42:04.834504 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.834479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5dccc1d-02cf-4490-99fb-8d53da95c80c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-frqz4\" (UID: \"c5dccc1d-02cf-4490-99fb-8d53da95c80c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:42:04.848886 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.848857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv7r8\" (UniqueName: \"kubernetes.io/projected/c5dccc1d-02cf-4490-99fb-8d53da95c80c-kube-api-access-wv7r8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-frqz4\" (UID: \"c5dccc1d-02cf-4490-99fb-8d53da95c80c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:42:04.885117 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.885087    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:04.887208 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.887191    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:04.887549 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.887523    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fp4lc\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:04.892218 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.892197    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:04.894149 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.894128    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:04.896094 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:04.896071    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fp4lc\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:04.935178 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.935154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmxxr\" (UniqueName: \"kubernetes.io/projected/2a28582c-4db9-456c-9128-7263748abd89-kube-api-access-dmxxr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d5gng\" (UID: \"2a28582c-4db9-456c-9128-7263748abd89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:04.935292 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.935190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5t68\" (UniqueName: \"kubernetes.io/projected/ce362fb8-9592-4faf-b501-b6937f4c3c9a-kube-api-access-r5t68\") pod \"limitador-operator-controller-manager-74495c69f8-6j9nt\" (UID: \"ce362fb8-9592-4faf-b501-b6937f4c3c9a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt"
Sep 11 19:42:04.935332 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.935315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a28582c-4db9-456c-9128-7263748abd89-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d5gng\" (UID: \"2a28582c-4db9-456c-9128-7263748abd89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:04.935698 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.935682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a28582c-4db9-456c-9128-7263748abd89-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d5gng\" (UID: \"2a28582c-4db9-456c-9128-7263748abd89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:04.944725 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.944701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmxxr\" (UniqueName: \"kubernetes.io/projected/2a28582c-4db9-456c-9128-7263748abd89-kube-api-access-dmxxr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-d5gng\" (UID: \"2a28582c-4db9-456c-9128-7263748abd89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:04.945009 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:04.944992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5t68\" (UniqueName: \"kubernetes.io/projected/ce362fb8-9592-4faf-b501-b6937f4c3c9a-kube-api-access-r5t68\") pod \"limitador-operator-controller-manager-74495c69f8-6j9nt\" (UID: \"ce362fb8-9592-4faf-b501-b6937f4c3c9a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt"
Sep 11 19:42:05.036438 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.036361    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mm7m\" (UniqueName: \"kubernetes.io/projected/31b918e3-a974-4cf1-a3dc-f577f4c8be80-kube-api-access-7mm7m\") pod \"31b918e3-a974-4cf1-a3dc-f577f4c8be80\" (UID: \"31b918e3-a974-4cf1-a3dc-f577f4c8be80\") "
Sep 11 19:42:05.036438 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.036415    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31b918e3-a974-4cf1-a3dc-f577f4c8be80-extensions-socket-volume\") pod \"31b918e3-a974-4cf1-a3dc-f577f4c8be80\" (UID: \"31b918e3-a974-4cf1-a3dc-f577f4c8be80\") "
Sep 11 19:42:05.036638 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.036498    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvmjt\" (UniqueName: \"kubernetes.io/projected/6e7ada85-dd78-452d-8049-5fa1b83991c4-kube-api-access-jvmjt\") pod \"6e7ada85-dd78-452d-8049-5fa1b83991c4\" (UID: \"6e7ada85-dd78-452d-8049-5fa1b83991c4\") "
Sep 11 19:42:05.036929 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.036902    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31b918e3-a974-4cf1-a3dc-f577f4c8be80-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "31b918e3-a974-4cf1-a3dc-f577f4c8be80" (UID: "31b918e3-a974-4cf1-a3dc-f577f4c8be80"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:05.038785 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.038760    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e7ada85-dd78-452d-8049-5fa1b83991c4-kube-api-access-jvmjt" (OuterVolumeSpecName: "kube-api-access-jvmjt") pod "6e7ada85-dd78-452d-8049-5fa1b83991c4" (UID: "6e7ada85-dd78-452d-8049-5fa1b83991c4"). InnerVolumeSpecName "kube-api-access-jvmjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:05.038785 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.038775    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31b918e3-a974-4cf1-a3dc-f577f4c8be80-kube-api-access-7mm7m" (OuterVolumeSpecName: "kube-api-access-7mm7m") pod "31b918e3-a974-4cf1-a3dc-f577f4c8be80" (UID: "31b918e3-a974-4cf1-a3dc-f577f4c8be80"). InnerVolumeSpecName "kube-api-access-7mm7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:05.052041 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.052010    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:42:05.062716 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.062697    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:05.069163 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.069138    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt"
Sep 11 19:42:05.138845 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.138352    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvmjt\" (UniqueName: \"kubernetes.io/projected/6e7ada85-dd78-452d-8049-5fa1b83991c4-kube-api-access-jvmjt\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:42:05.138845 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.138390    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mm7m\" (UniqueName: \"kubernetes.io/projected/31b918e3-a974-4cf1-a3dc-f577f4c8be80-kube-api-access-7mm7m\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:42:05.138845 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.138408    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31b918e3-a974-4cf1-a3dc-f577f4c8be80-extensions-socket-volume\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:42:05.239835 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.239799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mghj4\" (UniqueName: \"kubernetes.io/projected/3f6842b0-4139-450c-9cbb-702b14c2a108-kube-api-access-mghj4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dmm6v\" (UID: \"3f6842b0-4139-450c-9cbb-702b14c2a108\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:05.243462 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.243443    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mghj4 for pod kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v: failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-dmm6v" not found
Sep 11 19:42:05.243529 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.243510    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f6842b0-4139-450c-9cbb-702b14c2a108-kube-api-access-mghj4 podName:3f6842b0-4139-450c-9cbb-702b14c2a108 nodeName:}" failed. No retries permitted until 2026-09-11 19:42:06.243491719 +0000 UTC m=+760.477565135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mghj4" (UniqueName: "kubernetes.io/projected/3f6842b0-4139-450c-9cbb-702b14c2a108-kube-api-access-mghj4") pod "kuadrant-operator-controller-manager-5769f99d9f-dmm6v" (UID: "3f6842b0-4139-450c-9cbb-702b14c2a108") : failed to fetch token: pod "kuadrant-operator-controller-manager-5769f99d9f-dmm6v" not found
Sep 11 19:42:05.319573 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.319546    2578 generic.go:356] "Generic (PLEG): container finished" podID="6e7ada85-dd78-452d-8049-5fa1b83991c4" containerID="ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5" exitCode=0
Sep 11 19:42:05.319962 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.319587    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:05.319962 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.319645    2578 scope.go:117] "RemoveContainer" containerID="ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5"
Sep 11 19:42:05.321329 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.321294    2578 generic.go:356] "Generic (PLEG): container finished" podID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" containerID="cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964" exitCode=0
Sep 11 19:42:05.321433 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.321331    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:05.321497 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.321489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:05.321991 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.321969    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:05.325172 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.325133    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fp4lc\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:05.327173 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.327143    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fp4lc\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:05.329038 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.329014    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:05.329596 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.329544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:05.330885 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.330868    2578 scope.go:117] "RemoveContainer" containerID="ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5"
Sep 11 19:42:05.331208 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.331188    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5\": container with ID starting with ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5 not found: ID does not exist" containerID="ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5"
Sep 11 19:42:05.331314 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.331214    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5"} err="failed to get container status \"ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5\": rpc error: code = NotFound desc = could not find container \"ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5\": container with ID starting with ab8142fcb2eee684298bc5bd1525d73781c5f688b9e55a15fbc6c310b00144e5 not found: ID does not exist"
Sep 11 19:42:05.331314 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.331230    2578 scope.go:117] "RemoveContainer" containerID="cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964"
Sep 11 19:42:05.331550 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.331519    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-dmm6v\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="3f6842b0-4139-450c-9cbb-702b14c2a108" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:05.333546 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.333518    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:05.335422 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.335319    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-dmm6v\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="3f6842b0-4139-450c-9cbb-702b14c2a108" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:05.335548 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.335529    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"]
Sep 11 19:42:05.337326 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.337294    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fp4lc\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:05.337849 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:42:05.337826    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5dccc1d_02cf_4490_99fb_8d53da95c80c.slice/crio-077609dc9517f8ba5e16e839d0aecbbf4edd136ad1ea5a9cc83d5283391e0132 WatchSource:0}: Error finding container 077609dc9517f8ba5e16e839d0aecbbf4edd136ad1ea5a9cc83d5283391e0132: Status 404 returned error can't find the container with id 077609dc9517f8ba5e16e839d0aecbbf4edd136ad1ea5a9cc83d5283391e0132
Sep 11 19:42:05.339212 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.339182    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fp4lc\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:05.340972 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.340945    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:05.341463 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.341442    2578 scope.go:117] "RemoveContainer" containerID="cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964"
Sep 11 19:42:05.341760 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.341733    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964\": container with ID starting with cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964 not found: ID does not exist" containerID="cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964"
Sep 11 19:42:05.341846 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.341770    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964"} err="failed to get container status \"cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964\": rpc error: code = NotFound desc = could not find container \"cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964\": container with ID starting with cee7d09c431bdbbab1f0bdaa6e010d7b6ee189314cb72378fd88d63584d48964 not found: ID does not exist"
Sep 11 19:42:05.342763 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:05.342736    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-dmm6v\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="3f6842b0-4139-450c-9cbb-702b14c2a108" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:05.356988 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.356965    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"]
Sep 11 19:42:05.359157 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.359137    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt"]
Sep 11 19:42:05.359616 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:42:05.359583    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a28582c_4db9_456c_9128_7263748abd89.slice/crio-d510ec0305f81b178a277b5a93597142af86d135fad1925ab13c183b403fed72 WatchSource:0}: Error finding container d510ec0305f81b178a277b5a93597142af86d135fad1925ab13c183b403fed72: Status 404 returned error can't find the container with id d510ec0305f81b178a277b5a93597142af86d135fad1925ab13c183b403fed72
Sep 11 19:42:05.370433 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:42:05.370409    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce362fb8_9592_4faf_b501_b6937f4c3c9a.slice/crio-5f1dfc215d5731e0b83d87d9b1889c30b32967ffd268ae090d22685830f44992 WatchSource:0}: Error finding container 5f1dfc215d5731e0b83d87d9b1889c30b32967ffd268ae090d22685830f44992: Status 404 returned error can't find the container with id 5f1dfc215d5731e0b83d87d9b1889c30b32967ffd268ae090d22685830f44992
Sep 11 19:42:05.440976 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.440954    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f6842b0-4139-450c-9cbb-702b14c2a108-extensions-socket-volume\") pod \"3f6842b0-4139-450c-9cbb-702b14c2a108\" (UID: \"3f6842b0-4139-450c-9cbb-702b14c2a108\") "
Sep 11 19:42:05.441176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.441160    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mghj4\" (UniqueName: \"kubernetes.io/projected/3f6842b0-4139-450c-9cbb-702b14c2a108-kube-api-access-mghj4\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:42:05.441235 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.441218    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f6842b0-4139-450c-9cbb-702b14c2a108-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3f6842b0-4139-450c-9cbb-702b14c2a108" (UID: "3f6842b0-4139-450c-9cbb-702b14c2a108"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:05.542107 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:05.542072    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f6842b0-4139-450c-9cbb-702b14c2a108-extensions-socket-volume\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:42:06.255557 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:06.255521    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fglbx\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fglbx"
Sep 11 19:42:06.258457 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.258435    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31b918e3-a974-4cf1-a3dc-f577f4c8be80" path="/var/lib/kubelet/pods/31b918e3-a974-4cf1-a3dc-f577f4c8be80/volumes"
Sep 11 19:42:06.258760 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.258748    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f6842b0-4139-450c-9cbb-702b14c2a108" path="/var/lib/kubelet/pods/3f6842b0-4139-450c-9cbb-702b14c2a108/volumes"
Sep 11 19:42:06.259006 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:06.258978    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-dmm6v\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="3f6842b0-4139-450c-9cbb-702b14c2a108" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:06.259059 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.259045    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" path="/var/lib/kubelet/pods/6e7ada85-dd78-452d-8049-5fa1b83991c4/volumes"
Sep 11 19:42:06.261020 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:06.260994    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fp4lc\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="6e7ada85-dd78-452d-8049-5fa1b83991c4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fp4lc"
Sep 11 19:42:06.329681 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.329642    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4" event={"ID":"c5dccc1d-02cf-4490-99fb-8d53da95c80c","Type":"ContainerStarted","Data":"9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf"}
Sep 11 19:42:06.330101 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.329703    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4" event={"ID":"c5dccc1d-02cf-4490-99fb-8d53da95c80c","Type":"ContainerStarted","Data":"077609dc9517f8ba5e16e839d0aecbbf4edd136ad1ea5a9cc83d5283391e0132"}
Sep 11 19:42:06.330101 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.329742    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:42:06.333288 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.333241    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt" event={"ID":"ce362fb8-9592-4faf-b501-b6937f4c3c9a","Type":"ContainerStarted","Data":"959c93d2272cf70bc349544e206eb27d2c57dc99b4a7a18e63a81e4ae51beab6"}
Sep 11 19:42:06.333405 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.333302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt" event={"ID":"ce362fb8-9592-4faf-b501-b6937f4c3c9a","Type":"ContainerStarted","Data":"5f1dfc215d5731e0b83d87d9b1889c30b32967ffd268ae090d22685830f44992"}
Sep 11 19:42:06.333405 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.333330    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt"
Sep 11 19:42:06.337774 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.337745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng" event={"ID":"2a28582c-4db9-456c-9128-7263748abd89","Type":"ContainerStarted","Data":"5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34"}
Sep 11 19:42:06.337774 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.337768    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:06.337940 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.337793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng" event={"ID":"2a28582c-4db9-456c-9128-7263748abd89","Type":"ContainerStarted","Data":"d510ec0305f81b178a277b5a93597142af86d135fad1925ab13c183b403fed72"}
Sep 11 19:42:06.354867 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:06.354836    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5769f99d9f-dmm6v\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="3f6842b0-4139-450c-9cbb-702b14c2a108" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dmm6v"
Sep 11 19:42:06.355024 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.354875    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4" podStartSLOduration=2.354861181 podStartE2EDuration="2.354861181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:42:06.352445635 +0000 UTC m=+760.586519056" watchObservedRunningTime="2026-09-11 19:42:06.354861181 +0000 UTC m=+760.588934602"
Sep 11 19:42:06.383270 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.383205    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt" podStartSLOduration=2.383183084 podStartE2EDuration="2.383183084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:42:06.380709181 +0000 UTC m=+760.614782604" watchObservedRunningTime="2026-09-11 19:42:06.383183084 +0000 UTC m=+760.617256508"
Sep 11 19:42:06.411461 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:06.411408    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng" podStartSLOduration=2.411392269 podStartE2EDuration="2.411392269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:42:06.40885408 +0000 UTC m=+760.642927501" watchObservedRunningTime="2026-09-11 19:42:06.411392269 +0000 UTC m=+760.645465689"
Sep 11 19:42:07.343826 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:07.343797    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:08.285086 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:08.285055    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-zcmvw"
Sep 11 19:42:17.346281 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.346222    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:42:17.346759 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.346357    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6j9nt"
Sep 11 19:42:17.406542 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.406510    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"]
Sep 11 19:42:17.406995 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.406872    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng" podUID="2a28582c-4db9-456c-9128-7263748abd89" containerName="manager" containerID="cri-o://5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34" gracePeriod=10
Sep 11 19:42:17.409209 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.409184    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:17.659424 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.659406    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:17.748596 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.748559    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmxxr\" (UniqueName: \"kubernetes.io/projected/2a28582c-4db9-456c-9128-7263748abd89-kube-api-access-dmxxr\") pod \"2a28582c-4db9-456c-9128-7263748abd89\" (UID: \"2a28582c-4db9-456c-9128-7263748abd89\") "
Sep 11 19:42:17.748782 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.748641    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a28582c-4db9-456c-9128-7263748abd89-extensions-socket-volume\") pod \"2a28582c-4db9-456c-9128-7263748abd89\" (UID: \"2a28582c-4db9-456c-9128-7263748abd89\") "
Sep 11 19:42:17.749030 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.749008    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a28582c-4db9-456c-9128-7263748abd89-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a28582c-4db9-456c-9128-7263748abd89" (UID: "2a28582c-4db9-456c-9128-7263748abd89"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:17.750754 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.750726    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a28582c-4db9-456c-9128-7263748abd89-kube-api-access-dmxxr" (OuterVolumeSpecName: "kube-api-access-dmxxr") pod "2a28582c-4db9-456c-9128-7263748abd89" (UID: "2a28582c-4db9-456c-9128-7263748abd89"). InnerVolumeSpecName "kube-api-access-dmxxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:17.849770 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.849740    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmxxr\" (UniqueName: \"kubernetes.io/projected/2a28582c-4db9-456c-9128-7263748abd89-kube-api-access-dmxxr\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:42:17.849770 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:17.849768    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a28582c-4db9-456c-9128-7263748abd89-extensions-socket-volume\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:42:18.410198 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:18.410162    2578 generic.go:356] "Generic (PLEG): container finished" podID="2a28582c-4db9-456c-9128-7263748abd89" containerID="5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34" exitCode=0
Sep 11 19:42:18.410689 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:18.410225    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"
Sep 11 19:42:18.410689 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:18.410239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng" event={"ID":"2a28582c-4db9-456c-9128-7263748abd89","Type":"ContainerDied","Data":"5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34"}
Sep 11 19:42:18.410689 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:18.410300    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng" event={"ID":"2a28582c-4db9-456c-9128-7263748abd89","Type":"ContainerDied","Data":"d510ec0305f81b178a277b5a93597142af86d135fad1925ab13c183b403fed72"}
Sep 11 19:42:18.410689 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:18.410322    2578 scope.go:117] "RemoveContainer" containerID="5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34"
Sep 11 19:42:18.419284 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:18.419249    2578 scope.go:117] "RemoveContainer" containerID="5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34"
Sep 11 19:42:18.419548 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:18.419532    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34\": container with ID starting with 5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34 not found: ID does not exist" containerID="5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34"
Sep 11 19:42:18.419593 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:18.419558    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34"} err="failed to get container status \"5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34\": rpc error: code = NotFound desc = could not find container \"5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34\": container with ID starting with 5e7fb3126f76ec73102597b085c8ef10fc94f62c8067cd7295f762f4c7247c34 not found: ID does not exist"
Sep 11 19:42:18.455648 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:18.455614    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"]
Sep 11 19:42:18.472969 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:18.472942    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-d5gng"]
Sep 11 19:42:20.258222 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:20.258189    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a28582c-4db9-456c-9128-7263748abd89" path="/var/lib/kubelet/pods/2a28582c-4db9-456c-9128-7263748abd89/volumes"
Sep 11 19:42:35.568539 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.568508    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kfppm"]
Sep 11 19:42:35.568943 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.568888    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a28582c-4db9-456c-9128-7263748abd89" containerName="manager"
Sep 11 19:42:35.568943 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.568899    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a28582c-4db9-456c-9128-7263748abd89" containerName="manager"
Sep 11 19:42:35.569018 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.568973    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a28582c-4db9-456c-9128-7263748abd89" containerName="manager"
Sep 11 19:42:35.571798 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.571782    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:35.574530 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.574513    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 19:42:35.580771 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.580750    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kfppm"]
Sep 11 19:42:35.656354 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.656320    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kfppm"]
Sep 11 19:42:35.709475 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.709441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jlw5\" (UniqueName: \"kubernetes.io/projected/58ad114c-80eb-4945-b01a-1ef79019a69c-kube-api-access-2jlw5\") pod \"limitador-limitador-8588749977-kfppm\" (UID: \"58ad114c-80eb-4945-b01a-1ef79019a69c\") " pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:35.709745 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.709536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58ad114c-80eb-4945-b01a-1ef79019a69c-config-file\") pod \"limitador-limitador-8588749977-kfppm\" (UID: \"58ad114c-80eb-4945-b01a-1ef79019a69c\") " pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:35.810877 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.810844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jlw5\" (UniqueName: \"kubernetes.io/projected/58ad114c-80eb-4945-b01a-1ef79019a69c-kube-api-access-2jlw5\") pod \"limitador-limitador-8588749977-kfppm\" (UID: \"58ad114c-80eb-4945-b01a-1ef79019a69c\") " pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:35.811054 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.810924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58ad114c-80eb-4945-b01a-1ef79019a69c-config-file\") pod \"limitador-limitador-8588749977-kfppm\" (UID: \"58ad114c-80eb-4945-b01a-1ef79019a69c\") " pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:35.811554 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.811536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58ad114c-80eb-4945-b01a-1ef79019a69c-config-file\") pod \"limitador-limitador-8588749977-kfppm\" (UID: \"58ad114c-80eb-4945-b01a-1ef79019a69c\") " pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:35.819240 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.819186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jlw5\" (UniqueName: \"kubernetes.io/projected/58ad114c-80eb-4945-b01a-1ef79019a69c-kube-api-access-2jlw5\") pod \"limitador-limitador-8588749977-kfppm\" (UID: \"58ad114c-80eb-4945-b01a-1ef79019a69c\") " pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:35.882819 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:35.882788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:36.154584 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.154528    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kfppm"]
Sep 11 19:42:36.157493 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:42:36.157468    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ad114c_80eb_4945_b01a_1ef79019a69c.slice/crio-1efa58227ba710a3e0ef7e9849bd1ea64f7ed552bda4be8cec2f98d9c1363e9a WatchSource:0}: Error finding container 1efa58227ba710a3e0ef7e9849bd1ea64f7ed552bda4be8cec2f98d9c1363e9a: Status 404 returned error can't find the container with id 1efa58227ba710a3e0ef7e9849bd1ea64f7ed552bda4be8cec2f98d9c1363e9a
Sep 11 19:42:36.366013 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.365977    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qlp4q"]
Sep 11 19:42:36.368961 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.368946    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q"
Sep 11 19:42:36.371637 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.371614    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bgbcb\""
Sep 11 19:42:36.384330 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.384303    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qlp4q"]
Sep 11 19:42:36.504555 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.504471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-kfppm" event={"ID":"58ad114c-80eb-4945-b01a-1ef79019a69c","Type":"ContainerStarted","Data":"1efa58227ba710a3e0ef7e9849bd1ea64f7ed552bda4be8cec2f98d9c1363e9a"}
Sep 11 19:42:36.516989 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.516959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qg88\" (UniqueName: \"kubernetes.io/projected/e3179c80-14d8-4f48-9bd4-e83fbccfa8c0-kube-api-access-9qg88\") pod \"authorino-7bcfd8f9cd-qlp4q\" (UID: \"e3179c80-14d8-4f48-9bd4-e83fbccfa8c0\") " pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q"
Sep 11 19:42:36.544611 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.544578    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-tqh2m"]
Sep 11 19:42:36.547030 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.547014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-tqh2m"
Sep 11 19:42:36.571622 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.571597    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-tqh2m"]
Sep 11 19:42:36.617887 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.617854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qg88\" (UniqueName: \"kubernetes.io/projected/e3179c80-14d8-4f48-9bd4-e83fbccfa8c0-kube-api-access-9qg88\") pod \"authorino-7bcfd8f9cd-qlp4q\" (UID: \"e3179c80-14d8-4f48-9bd4-e83fbccfa8c0\") " pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q"
Sep 11 19:42:36.618048 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.617919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl5kk\" (UniqueName: \"kubernetes.io/projected/f2150248-94a7-474c-96cf-f3e08c87a4fd-kube-api-access-cl5kk\") pod \"authorino-59c974bd48-tqh2m\" (UID: \"f2150248-94a7-474c-96cf-f3e08c87a4fd\") " pod="kuadrant-system/authorino-59c974bd48-tqh2m"
Sep 11 19:42:36.637075 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.637047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qg88\" (UniqueName: \"kubernetes.io/projected/e3179c80-14d8-4f48-9bd4-e83fbccfa8c0-kube-api-access-9qg88\") pod \"authorino-7bcfd8f9cd-qlp4q\" (UID: \"e3179c80-14d8-4f48-9bd4-e83fbccfa8c0\") " pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q"
Sep 11 19:42:36.679664 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.679630    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q"
Sep 11 19:42:36.718920 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.718886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl5kk\" (UniqueName: \"kubernetes.io/projected/f2150248-94a7-474c-96cf-f3e08c87a4fd-kube-api-access-cl5kk\") pod \"authorino-59c974bd48-tqh2m\" (UID: \"f2150248-94a7-474c-96cf-f3e08c87a4fd\") " pod="kuadrant-system/authorino-59c974bd48-tqh2m"
Sep 11 19:42:36.729510 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.729476    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl5kk\" (UniqueName: \"kubernetes.io/projected/f2150248-94a7-474c-96cf-f3e08c87a4fd-kube-api-access-cl5kk\") pod \"authorino-59c974bd48-tqh2m\" (UID: \"f2150248-94a7-474c-96cf-f3e08c87a4fd\") " pod="kuadrant-system/authorino-59c974bd48-tqh2m"
Sep 11 19:42:36.855987 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.855953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-tqh2m"
Sep 11 19:42:36.950671 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:36.950645    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qlp4q"]
Sep 11 19:42:36.952387 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:42:36.952360    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3179c80_14d8_4f48_9bd4_e83fbccfa8c0.slice/crio-ad6d24f0cf8c1dcfa2793cbf3c56e2aefe61aa7602226259d352559d20aa92ff WatchSource:0}: Error finding container ad6d24f0cf8c1dcfa2793cbf3c56e2aefe61aa7602226259d352559d20aa92ff: Status 404 returned error can't find the container with id ad6d24f0cf8c1dcfa2793cbf3c56e2aefe61aa7602226259d352559d20aa92ff
Sep 11 19:42:37.127977 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:37.127952    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-tqh2m"]
Sep 11 19:42:37.130534 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:42:37.130503    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2150248_94a7_474c_96cf_f3e08c87a4fd.slice/crio-f1ef58d9a1418e7b8d720c491b6ad39be7e9a3b37ba615af12947777bde434e3 WatchSource:0}: Error finding container f1ef58d9a1418e7b8d720c491b6ad39be7e9a3b37ba615af12947777bde434e3: Status 404 returned error can't find the container with id f1ef58d9a1418e7b8d720c491b6ad39be7e9a3b37ba615af12947777bde434e3
Sep 11 19:42:37.511301 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:37.511270    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q" event={"ID":"e3179c80-14d8-4f48-9bd4-e83fbccfa8c0","Type":"ContainerStarted","Data":"ad6d24f0cf8c1dcfa2793cbf3c56e2aefe61aa7602226259d352559d20aa92ff"}
Sep 11 19:42:37.513134 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:37.513107    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-kfppm" event={"ID":"58ad114c-80eb-4945-b01a-1ef79019a69c","Type":"ContainerStarted","Data":"65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670"}
Sep 11 19:42:37.513323 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:37.513301    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:37.514490 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:37.514459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-tqh2m" event={"ID":"f2150248-94a7-474c-96cf-f3e08c87a4fd","Type":"ContainerStarted","Data":"f1ef58d9a1418e7b8d720c491b6ad39be7e9a3b37ba615af12947777bde434e3"}
Sep 11 19:42:37.532651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:37.532602    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-kfppm" podStartSLOduration=1.324069989 podStartE2EDuration="2.532583957s" totalImagesPullingTime="1.208513968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:42:37.530500432 +0000 UTC m=+791.764573890" watchObservedRunningTime="2026-09-11 19:42:37.532583957 +0000 UTC m=+791.766657379"
Sep 11 19:42:39.528024 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:39.527990    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q" event={"ID":"e3179c80-14d8-4f48-9bd4-e83fbccfa8c0","Type":"ContainerStarted","Data":"cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d"}
Sep 11 19:42:39.545478 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:39.545430    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q" podStartSLOduration=1.659969905 podStartE2EDuration="3.5454144s" totalImagesPullingTime="1.885444495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:42:39.543698956 +0000 UTC m=+793.777772377" watchObservedRunningTime="2026-09-11 19:42:39.5454144 +0000 UTC m=+793.779487820"
Sep 11 19:42:41.540458 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:41.540418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-tqh2m" event={"ID":"f2150248-94a7-474c-96cf-f3e08c87a4fd","Type":"ContainerStarted","Data":"c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636"}
Sep 11 19:42:41.555990 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:41.555931    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-tqh2m" podStartSLOduration=1.221501753 podStartE2EDuration="5.555914098s" totalImagesPullingTime="4.334412345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:42:41.554594034 +0000 UTC m=+795.788667471" watchObservedRunningTime="2026-09-11 19:42:41.555914098 +0000 UTC m=+795.789987520"
Sep 11 19:42:41.585117 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:41.585075    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qlp4q"]
Sep 11 19:42:41.585474 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:41.585307    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q" podUID="e3179c80-14d8-4f48-9bd4-e83fbccfa8c0" containerName="authorino" containerID="cri-o://cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d" gracePeriod=30
Sep 11 19:42:41.843564 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:41.843543    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q"
Sep 11 19:42:41.968405 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:41.968370    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qg88\" (UniqueName: \"kubernetes.io/projected/e3179c80-14d8-4f48-9bd4-e83fbccfa8c0-kube-api-access-9qg88\") pod \"e3179c80-14d8-4f48-9bd4-e83fbccfa8c0\" (UID: \"e3179c80-14d8-4f48-9bd4-e83fbccfa8c0\") "
Sep 11 19:42:41.970610 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:41.970585    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3179c80-14d8-4f48-9bd4-e83fbccfa8c0-kube-api-access-9qg88" (OuterVolumeSpecName: "kube-api-access-9qg88") pod "e3179c80-14d8-4f48-9bd4-e83fbccfa8c0" (UID: "e3179c80-14d8-4f48-9bd4-e83fbccfa8c0"). InnerVolumeSpecName "kube-api-access-9qg88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:42.069838 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:42.069804    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qg88\" (UniqueName: \"kubernetes.io/projected/e3179c80-14d8-4f48-9bd4-e83fbccfa8c0-kube-api-access-9qg88\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:42:42.547066 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:42.546970    2578 generic.go:356] "Generic (PLEG): container finished" podID="e3179c80-14d8-4f48-9bd4-e83fbccfa8c0" containerID="cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d" exitCode=0
Sep 11 19:42:42.547066 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:42.547015    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q"
Sep 11 19:42:42.547066 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:42.547046    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q" event={"ID":"e3179c80-14d8-4f48-9bd4-e83fbccfa8c0","Type":"ContainerDied","Data":"cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d"}
Sep 11 19:42:42.547584 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:42.547087    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qlp4q" event={"ID":"e3179c80-14d8-4f48-9bd4-e83fbccfa8c0","Type":"ContainerDied","Data":"ad6d24f0cf8c1dcfa2793cbf3c56e2aefe61aa7602226259d352559d20aa92ff"}
Sep 11 19:42:42.547584 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:42.547106    2578 scope.go:117] "RemoveContainer" containerID="cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d"
Sep 11 19:42:42.555593 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:42.555575    2578 scope.go:117] "RemoveContainer" containerID="cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d"
Sep 11 19:42:42.555861 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:42.555843    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d\": container with ID starting with cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d not found: ID does not exist" containerID="cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d"
Sep 11 19:42:42.555919 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:42.555866    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d"} err="failed to get container status \"cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d\": rpc error: code = NotFound desc = could not find container \"cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d\": container with ID starting with cf643920815a4d72b2d264b259e50cd615c8219e37fbb430019ab3b8293e5e7d not found: ID does not exist"
Sep 11 19:42:42.569142 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:42.569109    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qlp4q"]
Sep 11 19:42:42.570030 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:42.570010    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qlp4q"]
Sep 11 19:42:44.257276 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:44.257230    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3179c80-14d8-4f48-9bd4-e83fbccfa8c0" path="/var/lib/kubelet/pods/e3179c80-14d8-4f48-9bd4-e83fbccfa8c0/volumes"
Sep 11 19:42:48.523114 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:48.523040    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:49.862294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:49.862248    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kfppm"]
Sep 11 19:42:49.862762 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:49.862523    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-kfppm" podUID="58ad114c-80eb-4945-b01a-1ef79019a69c" containerName="limitador" containerID="cri-o://65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670" gracePeriod=30
Sep 11 19:42:50.412816 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.412790    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:50.448975 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.448921    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jlw5\" (UniqueName: \"kubernetes.io/projected/58ad114c-80eb-4945-b01a-1ef79019a69c-kube-api-access-2jlw5\") pod \"58ad114c-80eb-4945-b01a-1ef79019a69c\" (UID: \"58ad114c-80eb-4945-b01a-1ef79019a69c\") "
Sep 11 19:42:50.448975 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.448974    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58ad114c-80eb-4945-b01a-1ef79019a69c-config-file\") pod \"58ad114c-80eb-4945-b01a-1ef79019a69c\" (UID: \"58ad114c-80eb-4945-b01a-1ef79019a69c\") "
Sep 11 19:42:50.449338 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.449316    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58ad114c-80eb-4945-b01a-1ef79019a69c-config-file" (OuterVolumeSpecName: "config-file") pod "58ad114c-80eb-4945-b01a-1ef79019a69c" (UID: "58ad114c-80eb-4945-b01a-1ef79019a69c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:42:50.451397 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.451370    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58ad114c-80eb-4945-b01a-1ef79019a69c-kube-api-access-2jlw5" (OuterVolumeSpecName: "kube-api-access-2jlw5") pod "58ad114c-80eb-4945-b01a-1ef79019a69c" (UID: "58ad114c-80eb-4945-b01a-1ef79019a69c"). InnerVolumeSpecName "kube-api-access-2jlw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:50.549788 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.549756    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jlw5\" (UniqueName: \"kubernetes.io/projected/58ad114c-80eb-4945-b01a-1ef79019a69c-kube-api-access-2jlw5\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:42:50.549788 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.549784    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58ad114c-80eb-4945-b01a-1ef79019a69c-config-file\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:42:50.589411 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.589384    2578 generic.go:356] "Generic (PLEG): container finished" podID="58ad114c-80eb-4945-b01a-1ef79019a69c" containerID="65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670" exitCode=0
Sep 11 19:42:50.589537 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.589432    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-kfppm"
Sep 11 19:42:50.589537 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.589445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-kfppm" event={"ID":"58ad114c-80eb-4945-b01a-1ef79019a69c","Type":"ContainerDied","Data":"65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670"}
Sep 11 19:42:50.589537 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.589488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-kfppm" event={"ID":"58ad114c-80eb-4945-b01a-1ef79019a69c","Type":"ContainerDied","Data":"1efa58227ba710a3e0ef7e9849bd1ea64f7ed552bda4be8cec2f98d9c1363e9a"}
Sep 11 19:42:50.589537 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.589511    2578 scope.go:117] "RemoveContainer" containerID="65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670"
Sep 11 19:42:50.598859 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.598842    2578 scope.go:117] "RemoveContainer" containerID="65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670"
Sep 11 19:42:50.599096 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:42:50.599081    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670\": container with ID starting with 65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670 not found: ID does not exist" containerID="65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670"
Sep 11 19:42:50.599144 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.599104    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670"} err="failed to get container status \"65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670\": rpc error: code = NotFound desc = could not find container \"65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670\": container with ID starting with 65932f38c16fb1a8d5bb57e72571489241acfd244dd467d6381b31a689822670 not found: ID does not exist"
Sep 11 19:42:50.611388 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.611368    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kfppm"]
Sep 11 19:42:50.615569 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:50.615549    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kfppm"]
Sep 11 19:42:52.040817 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.040785    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"]
Sep 11 19:42:52.041334 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.041163    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3179c80-14d8-4f48-9bd4-e83fbccfa8c0" containerName="authorino"
Sep 11 19:42:52.041334 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.041175    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3179c80-14d8-4f48-9bd4-e83fbccfa8c0" containerName="authorino"
Sep 11 19:42:52.041334 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.041189    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ad114c-80eb-4945-b01a-1ef79019a69c" containerName="limitador"
Sep 11 19:42:52.041334 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.041195    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ad114c-80eb-4945-b01a-1ef79019a69c" containerName="limitador"
Sep 11 19:42:52.041334 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.041278    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3179c80-14d8-4f48-9bd4-e83fbccfa8c0" containerName="authorino"
Sep 11 19:42:52.041334 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.041294    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="58ad114c-80eb-4945-b01a-1ef79019a69c" containerName="limitador"
Sep 11 19:42:52.043385 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.043370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"
Sep 11 19:42:52.046148 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.046128    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 19:42:52.046310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.046212    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-z7mkv\""
Sep 11 19:42:52.047154 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.047139    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 19:42:52.047244 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.047161    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:42:52.052438 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.052082    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"]
Sep 11 19:42:52.060108 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.060070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/57149d4e-110c-4128-a7b4-52f0a4784274-data\") pod \"postgres-69fb4594cf-wcfnq\" (UID: \"57149d4e-110c-4128-a7b4-52f0a4784274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"
Sep 11 19:42:52.060246 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.060211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8r4w\" (UniqueName: \"kubernetes.io/projected/57149d4e-110c-4128-a7b4-52f0a4784274-kube-api-access-r8r4w\") pod \"postgres-69fb4594cf-wcfnq\" (UID: \"57149d4e-110c-4128-a7b4-52f0a4784274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"
Sep 11 19:42:52.161598 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.161552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8r4w\" (UniqueName: \"kubernetes.io/projected/57149d4e-110c-4128-a7b4-52f0a4784274-kube-api-access-r8r4w\") pod \"postgres-69fb4594cf-wcfnq\" (UID: \"57149d4e-110c-4128-a7b4-52f0a4784274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"
Sep 11 19:42:52.161769 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.161612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/57149d4e-110c-4128-a7b4-52f0a4784274-data\") pod \"postgres-69fb4594cf-wcfnq\" (UID: \"57149d4e-110c-4128-a7b4-52f0a4784274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"
Sep 11 19:42:52.161993 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.161976    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/57149d4e-110c-4128-a7b4-52f0a4784274-data\") pod \"postgres-69fb4594cf-wcfnq\" (UID: \"57149d4e-110c-4128-a7b4-52f0a4784274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"
Sep 11 19:42:52.180921 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.180896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8r4w\" (UniqueName: \"kubernetes.io/projected/57149d4e-110c-4128-a7b4-52f0a4784274-kube-api-access-r8r4w\") pod \"postgres-69fb4594cf-wcfnq\" (UID: \"57149d4e-110c-4128-a7b4-52f0a4784274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"
Sep 11 19:42:52.258018 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.257985    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58ad114c-80eb-4945-b01a-1ef79019a69c" path="/var/lib/kubelet/pods/58ad114c-80eb-4945-b01a-1ef79019a69c/volumes"
Sep 11 19:42:52.356751 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.356708    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"
Sep 11 19:42:52.630079 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:52.629996    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"]
Sep 11 19:42:52.632978 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:42:52.632950    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57149d4e_110c_4128_a7b4_52f0a4784274.slice/crio-8018b9f83175c1878dca8034b61fcce98d0316e6157c9c9db1b33b6a3ef1f971 WatchSource:0}: Error finding container 8018b9f83175c1878dca8034b61fcce98d0316e6157c9c9db1b33b6a3ef1f971: Status 404 returned error can't find the container with id 8018b9f83175c1878dca8034b61fcce98d0316e6157c9c9db1b33b6a3ef1f971
Sep 11 19:42:53.610913 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:53.610881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq" event={"ID":"57149d4e-110c-4128-a7b4-52f0a4784274","Type":"ContainerStarted","Data":"8018b9f83175c1878dca8034b61fcce98d0316e6157c9c9db1b33b6a3ef1f971"}
Sep 11 19:42:55.625003 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:55.624970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq" event={"ID":"57149d4e-110c-4128-a7b4-52f0a4784274","Type":"ContainerStarted","Data":"a8163f14752c73b4e27c2334d7a5234d55af65266196518f20599fcc2467f97c"}
Sep 11 19:42:55.625412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:55.625070    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"
Sep 11 19:42:55.641924 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:42:55.641864    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq" podStartSLOduration=1.49971545 podStartE2EDuration="3.641842621s" totalImagesPullingTime="2.142127171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:42:55.641784019 +0000 UTC m=+809.875857440" watchObservedRunningTime="2026-09-11 19:42:55.641842621 +0000 UTC m=+809.875916042"
Sep 11 19:43:01.660185 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:01.660150    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wcfnq"
Sep 11 19:43:02.175485 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.175450    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-7zrvs"]
Sep 11 19:43:02.178513 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.178493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7zrvs"
Sep 11 19:43:02.191360 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.191334    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-7zrvs"]
Sep 11 19:43:02.255924 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.255895    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgtvf\" (UniqueName: \"kubernetes.io/projected/9576c9c1-8cb8-49e2-81ff-7f3acb303f00-kube-api-access-sgtvf\") pod \"authorino-557f876f69-7zrvs\" (UID: \"9576c9c1-8cb8-49e2-81ff-7f3acb303f00\") " pod="kuadrant-system/authorino-557f876f69-7zrvs"
Sep 11 19:43:02.277481 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.277444    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-7zrvs"]
Sep 11 19:43:02.277753 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:43:02.277731    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-sgtvf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-7zrvs" podUID="9576c9c1-8cb8-49e2-81ff-7f3acb303f00"
Sep 11 19:43:02.316875 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.316842    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-74lnz"]
Sep 11 19:43:02.319550 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.319533    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-74lnz"
Sep 11 19:43:02.322463 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.322445    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 19:43:02.334217 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.334193    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-74lnz"]
Sep 11 19:43:02.356708 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.356655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8719dc3d-3071-436a-aa76-a935db5ec12f-tls-cert\") pod \"authorino-6d4dfc649f-74lnz\" (UID: \"8719dc3d-3071-436a-aa76-a935db5ec12f\") " pod="kuadrant-system/authorino-6d4dfc649f-74lnz"
Sep 11 19:43:02.356708 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.356711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmcjw\" (UniqueName: \"kubernetes.io/projected/8719dc3d-3071-436a-aa76-a935db5ec12f-kube-api-access-kmcjw\") pod \"authorino-6d4dfc649f-74lnz\" (UID: \"8719dc3d-3071-436a-aa76-a935db5ec12f\") " pod="kuadrant-system/authorino-6d4dfc649f-74lnz"
Sep 11 19:43:02.356963 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.356864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgtvf\" (UniqueName: \"kubernetes.io/projected/9576c9c1-8cb8-49e2-81ff-7f3acb303f00-kube-api-access-sgtvf\") pod \"authorino-557f876f69-7zrvs\" (UID: \"9576c9c1-8cb8-49e2-81ff-7f3acb303f00\") " pod="kuadrant-system/authorino-557f876f69-7zrvs"
Sep 11 19:43:02.367050 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.367023    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgtvf\" (UniqueName: \"kubernetes.io/projected/9576c9c1-8cb8-49e2-81ff-7f3acb303f00-kube-api-access-sgtvf\") pod \"authorino-557f876f69-7zrvs\" (UID: \"9576c9c1-8cb8-49e2-81ff-7f3acb303f00\") " pod="kuadrant-system/authorino-557f876f69-7zrvs"
Sep 11 19:43:02.423396 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.423359    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-74lnz"]
Sep 11 19:43:02.423695 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:43:02.423673    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kmcjw tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-74lnz" podUID="8719dc3d-3071-436a-aa76-a935db5ec12f"
Sep 11 19:43:02.453536 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.453444    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bcd64d7fb-xbhbn"]
Sep 11 19:43:02.456377 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.456358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn"
Sep 11 19:43:02.457643 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.457624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8719dc3d-3071-436a-aa76-a935db5ec12f-tls-cert\") pod \"authorino-6d4dfc649f-74lnz\" (UID: \"8719dc3d-3071-436a-aa76-a935db5ec12f\") " pod="kuadrant-system/authorino-6d4dfc649f-74lnz"
Sep 11 19:43:02.457744 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.457652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmcjw\" (UniqueName: \"kubernetes.io/projected/8719dc3d-3071-436a-aa76-a935db5ec12f-kube-api-access-kmcjw\") pod \"authorino-6d4dfc649f-74lnz\" (UID: \"8719dc3d-3071-436a-aa76-a935db5ec12f\") " pod="kuadrant-system/authorino-6d4dfc649f-74lnz"
Sep 11 19:43:02.460561 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.460536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8719dc3d-3071-436a-aa76-a935db5ec12f-tls-cert\") pod \"authorino-6d4dfc649f-74lnz\" (UID: \"8719dc3d-3071-436a-aa76-a935db5ec12f\") " pod="kuadrant-system/authorino-6d4dfc649f-74lnz"
Sep 11 19:43:02.466051 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.466031    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bcd64d7fb-xbhbn"]
Sep 11 19:43:02.467927 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.467904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmcjw\" (UniqueName: \"kubernetes.io/projected/8719dc3d-3071-436a-aa76-a935db5ec12f-kube-api-access-kmcjw\") pod \"authorino-6d4dfc649f-74lnz\" (UID: \"8719dc3d-3071-436a-aa76-a935db5ec12f\") " pod="kuadrant-system/authorino-6d4dfc649f-74lnz"
Sep 11 19:43:02.558440 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.558405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mhpf\" (UniqueName: \"kubernetes.io/projected/b79196d2-499d-4877-94b1-6994691622c7-kube-api-access-6mhpf\") pod \"authorino-5bcd64d7fb-xbhbn\" (UID: \"b79196d2-499d-4877-94b1-6994691622c7\") " pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn"
Sep 11 19:43:02.558440 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.558446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b79196d2-499d-4877-94b1-6994691622c7-tls-cert\") pod \"authorino-5bcd64d7fb-xbhbn\" (UID: \"b79196d2-499d-4877-94b1-6994691622c7\") " pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn"
Sep 11 19:43:02.659807 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.659775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mhpf\" (UniqueName: \"kubernetes.io/projected/b79196d2-499d-4877-94b1-6994691622c7-kube-api-access-6mhpf\") pod \"authorino-5bcd64d7fb-xbhbn\" (UID: \"b79196d2-499d-4877-94b1-6994691622c7\") " pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn"
Sep 11 19:43:02.659807 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.659809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b79196d2-499d-4877-94b1-6994691622c7-tls-cert\") pod \"authorino-5bcd64d7fb-xbhbn\" (UID: \"b79196d2-499d-4877-94b1-6994691622c7\") " pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn"
Sep 11 19:43:02.660695 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.660676    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7zrvs"
Sep 11 19:43:02.661011 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.660784    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-74lnz"
Sep 11 19:43:02.662527 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.662510    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b79196d2-499d-4877-94b1-6994691622c7-tls-cert\") pod \"authorino-5bcd64d7fb-xbhbn\" (UID: \"b79196d2-499d-4877-94b1-6994691622c7\") " pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn"
Sep 11 19:43:02.668184 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.668165    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mhpf\" (UniqueName: \"kubernetes.io/projected/b79196d2-499d-4877-94b1-6994691622c7-kube-api-access-6mhpf\") pod \"authorino-5bcd64d7fb-xbhbn\" (UID: \"b79196d2-499d-4877-94b1-6994691622c7\") " pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn"
Sep 11 19:43:02.682342 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.682318    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7zrvs"
Sep 11 19:43:02.685297 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.685279    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-74lnz"
Sep 11 19:43:02.760658 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.760563    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8719dc3d-3071-436a-aa76-a935db5ec12f-tls-cert\") pod \"8719dc3d-3071-436a-aa76-a935db5ec12f\" (UID: \"8719dc3d-3071-436a-aa76-a935db5ec12f\") "
Sep 11 19:43:02.760658 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.760613    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgtvf\" (UniqueName: \"kubernetes.io/projected/9576c9c1-8cb8-49e2-81ff-7f3acb303f00-kube-api-access-sgtvf\") pod \"9576c9c1-8cb8-49e2-81ff-7f3acb303f00\" (UID: \"9576c9c1-8cb8-49e2-81ff-7f3acb303f00\") "
Sep 11 19:43:02.760658 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.760632    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmcjw\" (UniqueName: \"kubernetes.io/projected/8719dc3d-3071-436a-aa76-a935db5ec12f-kube-api-access-kmcjw\") pod \"8719dc3d-3071-436a-aa76-a935db5ec12f\" (UID: \"8719dc3d-3071-436a-aa76-a935db5ec12f\") "
Sep 11 19:43:02.762796 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.762764    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8719dc3d-3071-436a-aa76-a935db5ec12f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8719dc3d-3071-436a-aa76-a935db5ec12f" (UID: "8719dc3d-3071-436a-aa76-a935db5ec12f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:43:02.762929 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.762885    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9576c9c1-8cb8-49e2-81ff-7f3acb303f00-kube-api-access-sgtvf" (OuterVolumeSpecName: "kube-api-access-sgtvf") pod "9576c9c1-8cb8-49e2-81ff-7f3acb303f00" (UID: "9576c9c1-8cb8-49e2-81ff-7f3acb303f00"). InnerVolumeSpecName "kube-api-access-sgtvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:02.762929 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.762894    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8719dc3d-3071-436a-aa76-a935db5ec12f-kube-api-access-kmcjw" (OuterVolumeSpecName: "kube-api-access-kmcjw") pod "8719dc3d-3071-436a-aa76-a935db5ec12f" (UID: "8719dc3d-3071-436a-aa76-a935db5ec12f"). InnerVolumeSpecName "kube-api-access-kmcjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:02.783971 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.783950    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn"
Sep 11 19:43:02.861843 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.861810    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8719dc3d-3071-436a-aa76-a935db5ec12f-tls-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:43:02.861843 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.861838    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgtvf\" (UniqueName: \"kubernetes.io/projected/9576c9c1-8cb8-49e2-81ff-7f3acb303f00-kube-api-access-sgtvf\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:43:02.861843 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:02.861849    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmcjw\" (UniqueName: \"kubernetes.io/projected/8719dc3d-3071-436a-aa76-a935db5ec12f-kube-api-access-kmcjw\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:43:03.054981 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.054958    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bcd64d7fb-xbhbn"]
Sep 11 19:43:03.057027 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:43:03.057004    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb79196d2_499d_4877_94b1_6994691622c7.slice/crio-3e71f60c7e8e20e17cd1058298013f74d3e128ff85153cdfe5610e8a5e54b690 WatchSource:0}: Error finding container 3e71f60c7e8e20e17cd1058298013f74d3e128ff85153cdfe5610e8a5e54b690: Status 404 returned error can't find the container with id 3e71f60c7e8e20e17cd1058298013f74d3e128ff85153cdfe5610e8a5e54b690
Sep 11 19:43:03.667742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.667651    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-74lnz"
Sep 11 19:43:03.667742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.667684    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn" event={"ID":"b79196d2-499d-4877-94b1-6994691622c7","Type":"ContainerStarted","Data":"1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0"}
Sep 11 19:43:03.667742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.667723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn" event={"ID":"b79196d2-499d-4877-94b1-6994691622c7","Type":"ContainerStarted","Data":"3e71f60c7e8e20e17cd1058298013f74d3e128ff85153cdfe5610e8a5e54b690"}
Sep 11 19:43:03.668234 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.667920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7zrvs"
Sep 11 19:43:03.685623 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.685575    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn" podStartSLOduration=1.357749858 podStartE2EDuration="1.685558983s" totalImagesPullingTime="327.809125ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:43:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:43:03.683673389 +0000 UTC m=+817.917746811" watchObservedRunningTime="2026-09-11 19:43:03.685558983 +0000 UTC m=+817.919632404"
Sep 11 19:43:03.715482 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.715446    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-tqh2m"]
Sep 11 19:43:03.715692 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.715667    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-tqh2m" podUID="f2150248-94a7-474c-96cf-f3e08c87a4fd" containerName="authorino" containerID="cri-o://c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636" gracePeriod=30
Sep 11 19:43:03.718067 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.718028    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-7zrvs"]
Sep 11 19:43:03.719999 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.719977    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-7zrvs"]
Sep 11 19:43:03.746344 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.746296    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-74lnz"]
Sep 11 19:43:03.748303 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.748249    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-74lnz"]
Sep 11 19:43:03.958077 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:03.958053    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-tqh2m"
Sep 11 19:43:04.072991 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.072962    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl5kk\" (UniqueName: \"kubernetes.io/projected/f2150248-94a7-474c-96cf-f3e08c87a4fd-kube-api-access-cl5kk\") pod \"f2150248-94a7-474c-96cf-f3e08c87a4fd\" (UID: \"f2150248-94a7-474c-96cf-f3e08c87a4fd\") "
Sep 11 19:43:04.075155 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.075129    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2150248-94a7-474c-96cf-f3e08c87a4fd-kube-api-access-cl5kk" (OuterVolumeSpecName: "kube-api-access-cl5kk") pod "f2150248-94a7-474c-96cf-f3e08c87a4fd" (UID: "f2150248-94a7-474c-96cf-f3e08c87a4fd"). InnerVolumeSpecName "kube-api-access-cl5kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:04.174180 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.174149    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl5kk\" (UniqueName: \"kubernetes.io/projected/f2150248-94a7-474c-96cf-f3e08c87a4fd-kube-api-access-cl5kk\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:43:04.257842 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.257768    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8719dc3d-3071-436a-aa76-a935db5ec12f" path="/var/lib/kubelet/pods/8719dc3d-3071-436a-aa76-a935db5ec12f/volumes"
Sep 11 19:43:04.257995 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.257983    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9576c9c1-8cb8-49e2-81ff-7f3acb303f00" path="/var/lib/kubelet/pods/9576c9c1-8cb8-49e2-81ff-7f3acb303f00/volumes"
Sep 11 19:43:04.675305 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.675247    2578 generic.go:356] "Generic (PLEG): container finished" podID="f2150248-94a7-474c-96cf-f3e08c87a4fd" containerID="c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636" exitCode=0
Sep 11 19:43:04.675744 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.675311    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-tqh2m"
Sep 11 19:43:04.675744 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.675342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-tqh2m" event={"ID":"f2150248-94a7-474c-96cf-f3e08c87a4fd","Type":"ContainerDied","Data":"c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636"}
Sep 11 19:43:04.675744 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.675388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-tqh2m" event={"ID":"f2150248-94a7-474c-96cf-f3e08c87a4fd","Type":"ContainerDied","Data":"f1ef58d9a1418e7b8d720c491b6ad39be7e9a3b37ba615af12947777bde434e3"}
Sep 11 19:43:04.675744 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.675407    2578 scope.go:117] "RemoveContainer" containerID="c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636"
Sep 11 19:43:04.684068 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.684051    2578 scope.go:117] "RemoveContainer" containerID="c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636"
Sep 11 19:43:04.684350 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:43:04.684330    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636\": container with ID starting with c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636 not found: ID does not exist" containerID="c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636"
Sep 11 19:43:04.684448 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.684354    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636"} err="failed to get container status \"c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636\": rpc error: code = NotFound desc = could not find container \"c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636\": container with ID starting with c9211818ff9d1879250a41d9bec50eb35773455b05935507512413c856ceb636 not found: ID does not exist"
Sep 11 19:43:04.692789 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.692765    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-tqh2m"]
Sep 11 19:43:04.697501 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:04.697482    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-tqh2m"]
Sep 11 19:43:06.257375 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:06.257343    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2150248-94a7-474c-96cf-f3e08c87a4fd" path="/var/lib/kubelet/pods/f2150248-94a7-474c-96cf-f3e08c87a4fd/volumes"
Sep 11 19:43:08.497372 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.497331    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c9dd94fc9-q5gkj"]
Sep 11 19:43:08.497925 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.497904    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2150248-94a7-474c-96cf-f3e08c87a4fd" containerName="authorino"
Sep 11 19:43:08.498012 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.497928    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2150248-94a7-474c-96cf-f3e08c87a4fd" containerName="authorino"
Sep 11 19:43:08.498068 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.498061    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2150248-94a7-474c-96cf-f3e08c87a4fd" containerName="authorino"
Sep 11 19:43:08.503867 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.503838    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:08.506422 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.506398    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 19:43:08.506422 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.506413    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 19:43:08.506594 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.506417    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 19:43:08.506594 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.506518    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-msw5f\""
Sep 11 19:43:08.511164 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.511142    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c9dd94fc9-q5gkj"]
Sep 11 19:43:08.613423 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.613387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-webhook-cert\") pod \"maas-controller-c9dd94fc9-q5gkj\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") " pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:08.613602 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.613443    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62x9n\" (UniqueName: \"kubernetes.io/projected/736a24b0-775f-4b51-a54a-23181d7953af-kube-api-access-62x9n\") pod \"maas-controller-c9dd94fc9-q5gkj\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") " pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:08.613602 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.613469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-metrics-certs\") pod \"maas-controller-c9dd94fc9-q5gkj\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") " pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:08.679409 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.679374    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77545c6848-qfcm2"]
Sep 11 19:43:08.681758 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.681743    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:08.695228 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.695202    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77545c6848-qfcm2"]
Sep 11 19:43:08.714208 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.714182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-webhook-cert\") pod \"maas-controller-c9dd94fc9-q5gkj\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") " pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:08.714402 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.714240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62x9n\" (UniqueName: \"kubernetes.io/projected/736a24b0-775f-4b51-a54a-23181d7953af-kube-api-access-62x9n\") pod \"maas-controller-c9dd94fc9-q5gkj\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") " pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:08.714402 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.714309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-metrics-certs\") pod \"maas-controller-c9dd94fc9-q5gkj\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") " pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:08.714476 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:43:08.714446    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 11 19:43:08.714529 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:43:08.714519    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-metrics-certs podName:736a24b0-775f-4b51-a54a-23181d7953af nodeName:}" failed. No retries permitted until 2026-09-11 19:43:09.214501298 +0000 UTC m=+823.448574701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-metrics-certs") pod "maas-controller-c9dd94fc9-q5gkj" (UID: "736a24b0-775f-4b51-a54a-23181d7953af") : secret "maas-controller-metrics-tls" not found
Sep 11 19:43:08.716822 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.716803    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-webhook-cert\") pod \"maas-controller-c9dd94fc9-q5gkj\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") " pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:08.722949 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.722931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62x9n\" (UniqueName: \"kubernetes.io/projected/736a24b0-775f-4b51-a54a-23181d7953af-kube-api-access-62x9n\") pod \"maas-controller-c9dd94fc9-q5gkj\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") " pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:08.815794 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.815765    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-webhook-cert\") pod \"maas-controller-77545c6848-qfcm2\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") " pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:08.815971 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.815832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-metrics-certs\") pod \"maas-controller-77545c6848-qfcm2\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") " pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:08.816020 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.815978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsb6c\" (UniqueName: \"kubernetes.io/projected/a613fa4a-f550-490f-abc9-318be05f8f29-kube-api-access-zsb6c\") pod \"maas-controller-77545c6848-qfcm2\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") " pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:08.916628 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.916595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsb6c\" (UniqueName: \"kubernetes.io/projected/a613fa4a-f550-490f-abc9-318be05f8f29-kube-api-access-zsb6c\") pod \"maas-controller-77545c6848-qfcm2\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") " pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:08.916799 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.916660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-webhook-cert\") pod \"maas-controller-77545c6848-qfcm2\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") " pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:08.916799 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.916695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-metrics-certs\") pod \"maas-controller-77545c6848-qfcm2\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") " pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:08.919372 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.919350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-metrics-certs\") pod \"maas-controller-77545c6848-qfcm2\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") " pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:08.919464 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.919350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-webhook-cert\") pod \"maas-controller-77545c6848-qfcm2\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") " pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:08.925889 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.925870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsb6c\" (UniqueName: \"kubernetes.io/projected/a613fa4a-f550-490f-abc9-318be05f8f29-kube-api-access-zsb6c\") pod \"maas-controller-77545c6848-qfcm2\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") " pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:08.993083 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:08.993048    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:09.219486 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:09.219366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-metrics-certs\") pod \"maas-controller-c9dd94fc9-q5gkj\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") " pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:09.221901 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:09.221871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-metrics-certs\") pod \"maas-controller-c9dd94fc9-q5gkj\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") " pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:09.269126 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:09.269091    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77545c6848-qfcm2"]
Sep 11 19:43:09.272202 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:43:09.272177    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda613fa4a_f550_490f_abc9_318be05f8f29.slice/crio-710df428acee74b78ad5c3dc319f5681edd29fff85ca86acf93dab05703772e1 WatchSource:0}: Error finding container 710df428acee74b78ad5c3dc319f5681edd29fff85ca86acf93dab05703772e1: Status 404 returned error can't find the container with id 710df428acee74b78ad5c3dc319f5681edd29fff85ca86acf93dab05703772e1
Sep 11 19:43:09.416180 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:09.416151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:09.690962 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:09.690932    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c9dd94fc9-q5gkj"]
Sep 11 19:43:09.692350 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:43:09.692323    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736a24b0_775f_4b51_a54a_23181d7953af.slice/crio-aec29b7d18ad2a89ba8d0df074ab589ea8e1e18e17e6d7ebe449b87a35acc82b WatchSource:0}: Error finding container aec29b7d18ad2a89ba8d0df074ab589ea8e1e18e17e6d7ebe449b87a35acc82b: Status 404 returned error can't find the container with id aec29b7d18ad2a89ba8d0df074ab589ea8e1e18e17e6d7ebe449b87a35acc82b
Sep 11 19:43:09.704301 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:09.704279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj" event={"ID":"736a24b0-775f-4b51-a54a-23181d7953af","Type":"ContainerStarted","Data":"aec29b7d18ad2a89ba8d0df074ab589ea8e1e18e17e6d7ebe449b87a35acc82b"}
Sep 11 19:43:09.705311 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:09.705288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77545c6848-qfcm2" event={"ID":"a613fa4a-f550-490f-abc9-318be05f8f29","Type":"ContainerStarted","Data":"710df428acee74b78ad5c3dc319f5681edd29fff85ca86acf93dab05703772e1"}
Sep 11 19:43:12.733317 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:12.733250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj" event={"ID":"736a24b0-775f-4b51-a54a-23181d7953af","Type":"ContainerStarted","Data":"1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278"}
Sep 11 19:43:12.733745 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:12.733389    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:12.734856 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:12.734835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77545c6848-qfcm2" event={"ID":"a613fa4a-f550-490f-abc9-318be05f8f29","Type":"ContainerStarted","Data":"070a04ef9caceac63329699617a0f8b82ee18d6d4629e6820b187dd2a11b15c9"}
Sep 11 19:43:12.734978 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:12.734966    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:12.754039 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:12.753993    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj" podStartSLOduration=2.55092634 podStartE2EDuration="4.75397742s" totalImagesPullingTime="2.20305108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:43:12.753345988 +0000 UTC m=+826.987419409" watchObservedRunningTime="2026-09-11 19:43:12.75397742 +0000 UTC m=+826.988050841"
Sep 11 19:43:12.773747 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:12.773702    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77545c6848-qfcm2" podStartSLOduration=2.159617224 podStartE2EDuration="4.773687381s" totalImagesPullingTime="2.614070157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:43:12.772016043 +0000 UTC m=+827.006089468" watchObservedRunningTime="2026-09-11 19:43:12.773687381 +0000 UTC m=+827.007760801"
Sep 11 19:43:23.742116 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:23.742088    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:23.742532 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:23.742162    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 19:43:23.809417 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:23.809386    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c9dd94fc9-q5gkj"]
Sep 11 19:43:23.809594 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:23.809569    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj" podUID="736a24b0-775f-4b51-a54a-23181d7953af" containerName="manager" containerID="cri-o://1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278" gracePeriod=30
Sep 11 19:43:24.069225 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.069195    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:24.159469 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.159436    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-webhook-cert\") pod \"736a24b0-775f-4b51-a54a-23181d7953af\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") "
Sep 11 19:43:24.159651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.159556    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-metrics-certs\") pod \"736a24b0-775f-4b51-a54a-23181d7953af\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") "
Sep 11 19:43:24.159651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.159592    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62x9n\" (UniqueName: \"kubernetes.io/projected/736a24b0-775f-4b51-a54a-23181d7953af-kube-api-access-62x9n\") pod \"736a24b0-775f-4b51-a54a-23181d7953af\" (UID: \"736a24b0-775f-4b51-a54a-23181d7953af\") "
Sep 11 19:43:24.161806 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.161773    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "736a24b0-775f-4b51-a54a-23181d7953af" (UID: "736a24b0-775f-4b51-a54a-23181d7953af"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:43:24.161806 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.161797    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "736a24b0-775f-4b51-a54a-23181d7953af" (UID: "736a24b0-775f-4b51-a54a-23181d7953af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:43:24.161948 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.161815    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/736a24b0-775f-4b51-a54a-23181d7953af-kube-api-access-62x9n" (OuterVolumeSpecName: "kube-api-access-62x9n") pod "736a24b0-775f-4b51-a54a-23181d7953af" (UID: "736a24b0-775f-4b51-a54a-23181d7953af"). InnerVolumeSpecName "kube-api-access-62x9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:24.260490 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.260463    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:43:24.260490 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.260487    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62x9n\" (UniqueName: \"kubernetes.io/projected/736a24b0-775f-4b51-a54a-23181d7953af-kube-api-access-62x9n\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:43:24.260490 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.260497    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/736a24b0-775f-4b51-a54a-23181d7953af-webhook-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:43:24.800362 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.800328    2578 generic.go:356] "Generic (PLEG): container finished" podID="736a24b0-775f-4b51-a54a-23181d7953af" containerID="1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278" exitCode=0
Sep 11 19:43:24.800819 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.800373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj" event={"ID":"736a24b0-775f-4b51-a54a-23181d7953af","Type":"ContainerDied","Data":"1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278"}
Sep 11 19:43:24.800819 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.800382    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj"
Sep 11 19:43:24.800819 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.800413    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9dd94fc9-q5gkj" event={"ID":"736a24b0-775f-4b51-a54a-23181d7953af","Type":"ContainerDied","Data":"aec29b7d18ad2a89ba8d0df074ab589ea8e1e18e17e6d7ebe449b87a35acc82b"}
Sep 11 19:43:24.800819 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.800434    2578 scope.go:117] "RemoveContainer" containerID="1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278"
Sep 11 19:43:24.809020 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.809005    2578 scope.go:117] "RemoveContainer" containerID="1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278"
Sep 11 19:43:24.809336 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:43:24.809312    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278\": container with ID starting with 1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278 not found: ID does not exist" containerID="1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278"
Sep 11 19:43:24.809406 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.809348    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278"} err="failed to get container status \"1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278\": rpc error: code = NotFound desc = could not find container \"1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278\": container with ID starting with 1a97fa7998cccef352d1c0447645772eba634057a6ad13ee5365e89bc02c3278 not found: ID does not exist"
Sep 11 19:43:24.818433 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.818412    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c9dd94fc9-q5gkj"]
Sep 11 19:43:24.822709 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:24.822691    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c9dd94fc9-q5gkj"]
Sep 11 19:43:26.258214 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:26.258191    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="736a24b0-775f-4b51-a54a-23181d7953af" path="/var/lib/kubelet/pods/736a24b0-775f-4b51-a54a-23181d7953af/volumes"
Sep 11 19:43:42.999510 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:42.999471    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"]
Sep 11 19:43:42.999970 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:42.999868    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736a24b0-775f-4b51-a54a-23181d7953af" containerName="manager"
Sep 11 19:43:42.999970 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:42.999879    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="736a24b0-775f-4b51-a54a-23181d7953af" containerName="manager"
Sep 11 19:43:42.999970 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:42.999943    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="736a24b0-775f-4b51-a54a-23181d7953af" containerName="manager"
Sep 11 19:43:43.005109 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.005090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.007749 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.007733    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 19:43:43.008576 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.008559    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9bkww\""
Sep 11 19:43:43.008576 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.008569    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 19:43:43.012975 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.012950    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"]
Sep 11 19:43:43.026979 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.026955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-maas-api-tls\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.027093 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.026986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-metrics-certs\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.027093 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.027017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cr6q\" (UniqueName: \"kubernetes.io/projected/b50ded27-e876-4d24-8286-8cc6e3f96989-kube-api-access-7cr6q\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.027187 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.027101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b50ded27-e876-4d24-8286-8cc6e3f96989-openshift-service-ca\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.128017 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.127980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-maas-api-tls\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.128017 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.128021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-metrics-certs\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.128297 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.128048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cr6q\" (UniqueName: \"kubernetes.io/projected/b50ded27-e876-4d24-8286-8cc6e3f96989-kube-api-access-7cr6q\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.128297 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.128078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b50ded27-e876-4d24-8286-8cc6e3f96989-openshift-service-ca\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.128297 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:43:43.128144    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 11 19:43:43.128297 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:43:43.128218    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-metrics-certs podName:b50ded27-e876-4d24-8286-8cc6e3f96989 nodeName:}" failed. No retries permitted until 2026-09-11 19:43:43.628202131 +0000 UTC m=+857.862275531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-metrics-certs") pod "maas-api-5787449d97-bvkzs" (UID: "b50ded27-e876-4d24-8286-8cc6e3f96989") : secret "maas-api-metrics-tls" not found
Sep 11 19:43:43.128793 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.128776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b50ded27-e876-4d24-8286-8cc6e3f96989-openshift-service-ca\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.130650 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.130630    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-maas-api-tls\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.137205 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.137174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cr6q\" (UniqueName: \"kubernetes.io/projected/b50ded27-e876-4d24-8286-8cc6e3f96989-kube-api-access-7cr6q\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.527289 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.527238    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"]
Sep 11 19:43:43.530552 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.530533    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"
Sep 11 19:43:43.533348 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.533325    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 19:43:43.533506 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.533488    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-68flw\""
Sep 11 19:43:43.544118 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.543965    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"]
Sep 11 19:43:43.632964 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.632930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhd5r\" (UniqueName: \"kubernetes.io/projected/c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e-kube-api-access-vhd5r\") pod \"payload-pre-processing-59fbc47bf8-c6zmp\" (UID: \"c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"
Sep 11 19:43:43.633160 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.632979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-metrics-certs\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.633160 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.632998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-c6zmp\" (UID: \"c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"
Sep 11 19:43:43.635587 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.635565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-metrics-certs\") pod \"maas-api-5787449d97-bvkzs\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") " pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:43.733833 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.733800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhd5r\" (UniqueName: \"kubernetes.io/projected/c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e-kube-api-access-vhd5r\") pod \"payload-pre-processing-59fbc47bf8-c6zmp\" (UID: \"c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"
Sep 11 19:43:43.734034 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.733848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-c6zmp\" (UID: \"c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"
Sep 11 19:43:43.734946 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.734907    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-c6zmp\" (UID: \"c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"
Sep 11 19:43:43.742117 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.742087    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhd5r\" (UniqueName: \"kubernetes.io/projected/c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e-kube-api-access-vhd5r\") pod \"payload-pre-processing-59fbc47bf8-c6zmp\" (UID: \"c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"
Sep 11 19:43:43.843524 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.843482    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"
Sep 11 19:43:43.917251 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:43.916961    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:44.123898 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:44.123877    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"]
Sep 11 19:43:44.125970 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:43:44.125946    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ac95a9_d377_4ebc_a8ba_6e1ce653c04e.slice/crio-b3652d0ee171afb3695dc124a0d80211f9706e38085d7c663bd76ca52a164f5a WatchSource:0}: Error finding container b3652d0ee171afb3695dc124a0d80211f9706e38085d7c663bd76ca52a164f5a: Status 404 returned error can't find the container with id b3652d0ee171afb3695dc124a0d80211f9706e38085d7c663bd76ca52a164f5a
Sep 11 19:43:44.201950 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:44.201929    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"]
Sep 11 19:43:44.204814 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:43:44.204783    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50ded27_e876_4d24_8286_8cc6e3f96989.slice/crio-a4a9f280652baeeecbb0ea0e890a58cd6c74d4a72eda976f0fe50efccd172a0c WatchSource:0}: Error finding container a4a9f280652baeeecbb0ea0e890a58cd6c74d4a72eda976f0fe50efccd172a0c: Status 404 returned error can't find the container with id a4a9f280652baeeecbb0ea0e890a58cd6c74d4a72eda976f0fe50efccd172a0c
Sep 11 19:43:44.910835 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:44.910799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp" event={"ID":"c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e","Type":"ContainerStarted","Data":"b3652d0ee171afb3695dc124a0d80211f9706e38085d7c663bd76ca52a164f5a"}
Sep 11 19:43:44.912439 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:44.912372    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs" event={"ID":"b50ded27-e876-4d24-8286-8cc6e3f96989","Type":"ContainerStarted","Data":"a4a9f280652baeeecbb0ea0e890a58cd6c74d4a72eda976f0fe50efccd172a0c"}
Sep 11 19:43:46.924551 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:46.924503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp" event={"ID":"c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e","Type":"ContainerStarted","Data":"7200b99f4497fd99a9ac01494e73e27a29a2cef3a367c5a53f5f5e7e65d7d23f"}
Sep 11 19:43:46.924979 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:46.924600    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"
Sep 11 19:43:46.926224 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:46.926196    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs" event={"ID":"b50ded27-e876-4d24-8286-8cc6e3f96989","Type":"ContainerStarted","Data":"a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b"}
Sep 11 19:43:46.926387 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:46.926369    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:46.942452 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:46.942408    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp" podStartSLOduration=2.085943025 podStartE2EDuration="3.942363802s" totalImagesPullingTime="1.856420777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:43:46.941939745 +0000 UTC m=+861.176013171" watchObservedRunningTime="2026-09-11 19:43:46.942363802 +0000 UTC m=+861.176437222"
Sep 11 19:43:46.961777 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:46.961733    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs" podStartSLOduration=3.180706868 podStartE2EDuration="4.961718776s" totalImagesPullingTime="1.781011908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:43:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:43:46.960098033 +0000 UTC m=+861.194171448" watchObservedRunningTime="2026-09-11 19:43:46.961718776 +0000 UTC m=+861.195792196"
Sep 11 19:43:52.937140 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:52.937114    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 19:43:57.933880 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:57.933847    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp"
Sep 11 19:43:59.259006 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.258974    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"]
Sep 11 19:43:59.264971 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.264937    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.270122 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.270097    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 19:43:59.270331 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.270310    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 19:43:59.270434 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.270159    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 19:43:59.271718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.271480    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vwxjz\""
Sep 11 19:43:59.273661 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.273644    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"]
Sep 11 19:43:59.389154 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.389125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn79w\" (UniqueName: \"kubernetes.io/projected/69c019cb-b0b3-4fec-939e-8a77072cd0c9-kube-api-access-wn79w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.389364 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.389182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.389364 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.389217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69c019cb-b0b3-4fec-939e-8a77072cd0c9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.389364 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.389329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.389521 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.389376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.389521 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.389423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.490334 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.490305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn79w\" (UniqueName: \"kubernetes.io/projected/69c019cb-b0b3-4fec-939e-8a77072cd0c9-kube-api-access-wn79w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.490490 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.490350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.490490 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.490373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69c019cb-b0b3-4fec-939e-8a77072cd0c9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.490600 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.490584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.490670 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.490641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.490744 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.490675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.490811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.490789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.491002 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.490984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.491100 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.491022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.493007 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.492978    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69c019cb-b0b3-4fec-939e-8a77072cd0c9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.493502 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.493486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69c019cb-b0b3-4fec-939e-8a77072cd0c9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.499067 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.499047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn79w\" (UniqueName: \"kubernetes.io/projected/69c019cb-b0b3-4fec-939e-8a77072cd0c9-kube-api-access-wn79w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2\" (UID: \"69c019cb-b0b3-4fec-939e-8a77072cd0c9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.580193 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.580164    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:43:59.859514 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.859482    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"]
Sep 11 19:43:59.861629 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:43:59.861597    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c019cb_b0b3_4fec_939e_8a77072cd0c9.slice/crio-bfc82f58c2d67925e82d31cd996f07637742c3e5ad3456820eb1a965d5a761e7 WatchSource:0}: Error finding container bfc82f58c2d67925e82d31cd996f07637742c3e5ad3456820eb1a965d5a761e7: Status 404 returned error can't find the container with id bfc82f58c2d67925e82d31cd996f07637742c3e5ad3456820eb1a965d5a761e7
Sep 11 19:43:59.995606 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:43:59.995565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2" event={"ID":"69c019cb-b0b3-4fec-939e-8a77072cd0c9","Type":"ContainerStarted","Data":"bfc82f58c2d67925e82d31cd996f07637742c3e5ad3456820eb1a965d5a761e7"}
Sep 11 19:44:01.006395 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:01.006363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2" event={"ID":"69c019cb-b0b3-4fec-939e-8a77072cd0c9","Type":"ContainerStarted","Data":"0a48a7b8f64804d805eeda7060d2cd0c476983063b9e186cb8411f3389c831c1"}
Sep 11 19:44:01.029424 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:01.029372    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2" podStartSLOduration=1.026503584 podStartE2EDuration="2.029356509s" totalImagesPullingTime="1.002852925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:44:01.027413964 +0000 UTC m=+875.261487376" watchObservedRunningTime="2026-09-11 19:44:01.029356509 +0000 UTC m=+875.263429929"
Sep 11 19:44:09.580578 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:09.580539    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:44:09.580958 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:09.580618    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:44:09.593574 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:09.593549    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:44:10.072827 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:10.072801    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2"
Sep 11 19:44:26.540174 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:26.540063    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:44:26.545399 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:26.540319    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:44:27.650010 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.649976    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"]
Sep 11 19:44:27.653824 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.653804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.656551 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.656533    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 11 19:44:27.664441 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.664420    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"]
Sep 11 19:44:27.750866 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.750836    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsjp6\" (UniqueName: \"kubernetes.io/projected/f8e5e06f-3402-44d8-aec8-5932f20d6c60-kube-api-access-wsjp6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.751037 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.750901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e5e06f-3402-44d8-aec8-5932f20d6c60-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.751037 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.750971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.751037 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.750995    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.751037 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.751009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.751190 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.751055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.851963 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.851932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsjp6\" (UniqueName: \"kubernetes.io/projected/f8e5e06f-3402-44d8-aec8-5932f20d6c60-kube-api-access-wsjp6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.852162 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.851995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e5e06f-3402-44d8-aec8-5932f20d6c60-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.852162 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.852030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.852162 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.852046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.852162 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.852061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.852162 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.852076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.852519 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.852498    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.852595 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.852570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.852640 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.852603    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.854732 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.854707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8e5e06f-3402-44d8-aec8-5932f20d6c60-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.854825 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.854811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e5e06f-3402-44d8-aec8-5932f20d6c60-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.861043 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.861021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsjp6\" (UniqueName: \"kubernetes.io/projected/f8e5e06f-3402-44d8-aec8-5932f20d6c60-kube-api-access-wsjp6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s4dtm\" (UID: \"f8e5e06f-3402-44d8-aec8-5932f20d6c60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:27.964381 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:27.964296    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:28.253910 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:44:28.253879    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e5e06f_3402_44d8_aec8_5932f20d6c60.slice/crio-be60086f0e0f5bcfb15590502ae40bda5418f703e449c62457ee200d517e3444 WatchSource:0}: Error finding container be60086f0e0f5bcfb15590502ae40bda5418f703e449c62457ee200d517e3444: Status 404 returned error can't find the container with id be60086f0e0f5bcfb15590502ae40bda5418f703e449c62457ee200d517e3444
Sep 11 19:44:28.258884 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:28.258863    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"]
Sep 11 19:44:29.156313 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:29.156273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm" event={"ID":"f8e5e06f-3402-44d8-aec8-5932f20d6c60","Type":"ContainerStarted","Data":"e314ccb3295c75b6c64ef5ab22f83c11e7e72377263d98e2e6d4dd426d98b5ba"}
Sep 11 19:44:29.156693 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:29.156322    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm" event={"ID":"f8e5e06f-3402-44d8-aec8-5932f20d6c60","Type":"ContainerStarted","Data":"be60086f0e0f5bcfb15590502ae40bda5418f703e449c62457ee200d517e3444"}
Sep 11 19:44:29.180466 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:29.180405    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm" podStartSLOduration=2.005131883 podStartE2EDuration="2.18038893s" totalImagesPullingTime="175.257047ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:44:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:44:29.179396876 +0000 UTC m=+903.413470297" watchObservedRunningTime="2026-09-11 19:44:29.18038893 +0000 UTC m=+903.414462350"
Sep 11 19:44:37.964768 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:37.964728    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:37.965185 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:37.964813    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:37.977275 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:37.977232    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:44:38.215587 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:44:38.215508    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s4dtm"
Sep 11 19:46:27.421541 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:27.421504    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5db8864bb9-tffkl"]
Sep 11 19:46:27.424791 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:27.424770    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db8864bb9-tffkl"
Sep 11 19:46:27.434897 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:27.434877    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5db8864bb9-tffkl"]
Sep 11 19:46:27.468421 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:27.468393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd-tls-cert\") pod \"authorino-5db8864bb9-tffkl\" (UID: \"a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd\") " pod="kuadrant-system/authorino-5db8864bb9-tffkl"
Sep 11 19:46:27.468591 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:27.468444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcs4k\" (UniqueName: \"kubernetes.io/projected/a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd-kube-api-access-zcs4k\") pod \"authorino-5db8864bb9-tffkl\" (UID: \"a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd\") " pod="kuadrant-system/authorino-5db8864bb9-tffkl"
Sep 11 19:46:27.569973 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:27.569941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd-tls-cert\") pod \"authorino-5db8864bb9-tffkl\" (UID: \"a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd\") " pod="kuadrant-system/authorino-5db8864bb9-tffkl"
Sep 11 19:46:27.570150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:27.570001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcs4k\" (UniqueName: \"kubernetes.io/projected/a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd-kube-api-access-zcs4k\") pod \"authorino-5db8864bb9-tffkl\" (UID: \"a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd\") " pod="kuadrant-system/authorino-5db8864bb9-tffkl"
Sep 11 19:46:27.572501 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:27.572478    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd-tls-cert\") pod \"authorino-5db8864bb9-tffkl\" (UID: \"a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd\") " pod="kuadrant-system/authorino-5db8864bb9-tffkl"
Sep 11 19:46:27.578582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:27.578560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcs4k\" (UniqueName: \"kubernetes.io/projected/a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd-kube-api-access-zcs4k\") pod \"authorino-5db8864bb9-tffkl\" (UID: \"a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd\") " pod="kuadrant-system/authorino-5db8864bb9-tffkl"
Sep 11 19:46:27.734477 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:27.734401    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db8864bb9-tffkl"
Sep 11 19:46:28.004940 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:28.004918    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5db8864bb9-tffkl"]
Sep 11 19:46:28.007436 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:46:28.007410    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda66dd4e5_6b02_4e7c_9d07_db540a5dd0dd.slice/crio-f315f73ac02f3ae52a26866e0c608f24fbadaf061a3156b72a26e9507e538c98 WatchSource:0}: Error finding container f315f73ac02f3ae52a26866e0c608f24fbadaf061a3156b72a26e9507e538c98: Status 404 returned error can't find the container with id f315f73ac02f3ae52a26866e0c608f24fbadaf061a3156b72a26e9507e538c98
Sep 11 19:46:28.008965 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:28.008947    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:46:28.784671 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:28.784632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db8864bb9-tffkl" event={"ID":"a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd","Type":"ContainerStarted","Data":"d562a444a39192930c0437bd11490f3e2c920d09e8f005e5983daf53da9d2d80"}
Sep 11 19:46:28.785212 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:28.784681    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db8864bb9-tffkl" event={"ID":"a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd","Type":"ContainerStarted","Data":"f315f73ac02f3ae52a26866e0c608f24fbadaf061a3156b72a26e9507e538c98"}
Sep 11 19:46:28.801212 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:28.801158    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5db8864bb9-tffkl" podStartSLOduration=1.17616163 podStartE2EDuration="1.801137869s" totalImagesPullingTime="624.976239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:46:28.800634773 +0000 UTC m=+1023.034708221" watchObservedRunningTime="2026-09-11 19:46:28.801137869 +0000 UTC m=+1023.035211291"
Sep 11 19:46:28.829078 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:28.829045    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bcd64d7fb-xbhbn"]
Sep 11 19:46:28.829677 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:28.829637    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn" podUID="b79196d2-499d-4877-94b1-6994691622c7" containerName="authorino" containerID="cri-o://1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0" gracePeriod=30
Sep 11 19:46:29.102096 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.102069    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn"
Sep 11 19:46:29.184748 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.184706    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b79196d2-499d-4877-94b1-6994691622c7-tls-cert\") pod \"b79196d2-499d-4877-94b1-6994691622c7\" (UID: \"b79196d2-499d-4877-94b1-6994691622c7\") "
Sep 11 19:46:29.184947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.184765    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mhpf\" (UniqueName: \"kubernetes.io/projected/b79196d2-499d-4877-94b1-6994691622c7-kube-api-access-6mhpf\") pod \"b79196d2-499d-4877-94b1-6994691622c7\" (UID: \"b79196d2-499d-4877-94b1-6994691622c7\") "
Sep 11 19:46:29.186934 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.186906    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b79196d2-499d-4877-94b1-6994691622c7-kube-api-access-6mhpf" (OuterVolumeSpecName: "kube-api-access-6mhpf") pod "b79196d2-499d-4877-94b1-6994691622c7" (UID: "b79196d2-499d-4877-94b1-6994691622c7"). InnerVolumeSpecName "kube-api-access-6mhpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:46:29.196142 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.196082    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b79196d2-499d-4877-94b1-6994691622c7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b79196d2-499d-4877-94b1-6994691622c7" (UID: "b79196d2-499d-4877-94b1-6994691622c7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:46:29.285898 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.285864    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b79196d2-499d-4877-94b1-6994691622c7-tls-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:46:29.285898 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.285895    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mhpf\" (UniqueName: \"kubernetes.io/projected/b79196d2-499d-4877-94b1-6994691622c7-kube-api-access-6mhpf\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:46:29.793332 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.793297    2578 generic.go:356] "Generic (PLEG): container finished" podID="b79196d2-499d-4877-94b1-6994691622c7" containerID="1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0" exitCode=0
Sep 11 19:46:29.793804 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.793364    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn"
Sep 11 19:46:29.793804 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.793377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn" event={"ID":"b79196d2-499d-4877-94b1-6994691622c7","Type":"ContainerDied","Data":"1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0"}
Sep 11 19:46:29.793804 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.793422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bcd64d7fb-xbhbn" event={"ID":"b79196d2-499d-4877-94b1-6994691622c7","Type":"ContainerDied","Data":"3e71f60c7e8e20e17cd1058298013f74d3e128ff85153cdfe5610e8a5e54b690"}
Sep 11 19:46:29.793804 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.793454    2578 scope.go:117] "RemoveContainer" containerID="1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0"
Sep 11 19:46:29.805411 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.805346    2578 scope.go:117] "RemoveContainer" containerID="1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0"
Sep 11 19:46:29.805668 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:46:29.805648    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0\": container with ID starting with 1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0 not found: ID does not exist" containerID="1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0"
Sep 11 19:46:29.805745 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.805681    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0"} err="failed to get container status \"1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0\": rpc error: code = NotFound desc = could not find container \"1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0\": container with ID starting with 1351c50001acbf23c9aae03bdcee38fe703137bece64246ec3eedd8861052cd0 not found: ID does not exist"
Sep 11 19:46:29.824542 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.824516    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bcd64d7fb-xbhbn"]
Sep 11 19:46:29.827962 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:29.827931    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bcd64d7fb-xbhbn"]
Sep 11 19:46:30.258890 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:30.258859    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b79196d2-499d-4877-94b1-6994691622c7" path="/var/lib/kubelet/pods/b79196d2-499d-4877-94b1-6994691622c7/volumes"
Sep 11 19:46:46.281253 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.281223    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"]
Sep 11 19:46:46.281675 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.281650    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b79196d2-499d-4877-94b1-6994691622c7" containerName="authorino"
Sep 11 19:46:46.281675 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.281663    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b79196d2-499d-4877-94b1-6994691622c7" containerName="authorino"
Sep 11 19:46:46.281783 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.281742    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b79196d2-499d-4877-94b1-6994691622c7" containerName="authorino"
Sep 11 19:46:46.286487 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.286466    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.290500 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.290468    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 19:46:46.290633 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.290570    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-4b032e-openshift-default-dockercfg-6d9hc\""
Sep 11 19:46:46.314047 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.314027    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"]
Sep 11 19:46:46.443446 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.443412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-certs\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.443615 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.443495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-socket\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.443615 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.443519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-envoy\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.443615 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.443581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-data\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.443615 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.443603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-podinfo\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.443773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.443636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istiod-ca-cert\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.443773 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.443763    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-credential-socket\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.443853 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.443801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flqsj\" (UniqueName: \"kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-kube-api-access-flqsj\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.443892 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.443855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-token\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.544622 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.544541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-socket\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.544622 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.544573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-envoy\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.544622 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.544605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-data\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.544870 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.544626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-podinfo\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.544870 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.544654    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istiod-ca-cert\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.544870 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.544691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-credential-socket\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.545028 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.544857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flqsj\" (UniqueName: \"kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-kube-api-access-flqsj\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.545028 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.544937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-token\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.545028 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.544989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-socket\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.545028 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.545016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-certs\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.545305 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.545195    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-credential-socket\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.545393 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.545370    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-data\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.545393 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.545381    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istiod-ca-cert\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.545495 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.545424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-certs\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.547117 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.547098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-envoy\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.547250 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.547233    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-podinfo\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.554252 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.554227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flqsj\" (UniqueName: \"kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-kube-api-access-flqsj\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.555470 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.555454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-token\") pod \"e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") " pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.598483 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.598459    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:46.894986 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:46.894959    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"]
Sep 11 19:46:46.896887 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:46:46.896852    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273e9337_5ab2_42c3_b053_033dcc6e4ac5.slice/crio-f45934a712b080d123df005714b54ea516d88546deee4d2f603bbc0a1a281fa3 WatchSource:0}: Error finding container f45934a712b080d123df005714b54ea516d88546deee4d2f603bbc0a1a281fa3: Status 404 returned error can't find the container with id f45934a712b080d123df005714b54ea516d88546deee4d2f603bbc0a1a281fa3
Sep 11 19:46:47.890396 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:47.890238    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" event={"ID":"273e9337-5ab2-42c3-b053-033dcc6e4ac5","Type":"ContainerStarted","Data":"f45934a712b080d123df005714b54ea516d88546deee4d2f603bbc0a1a281fa3"}
Sep 11 19:46:49.701862 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:49.701820    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:46:49.702150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:49.701894    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:46:49.702150 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:49.701923    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:46:49.909016 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:49.908975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" event={"ID":"273e9337-5ab2-42c3-b053-033dcc6e4ac5","Type":"ContainerStarted","Data":"914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac"}
Sep 11 19:46:49.933403 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:49.933342    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" podStartSLOduration=1.1310608580000001 podStartE2EDuration="3.933321462s" totalImagesPullingTime="2.802260604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:46:49.930484716 +0000 UTC m=+1044.164558138" watchObservedRunningTime="2026-09-11 19:46:49.933321462 +0000 UTC m=+1044.167394884"
Sep 11 19:46:50.386159 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.386131    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"]
Sep 11 19:46:50.390188 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.390165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.393191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.393166    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-a8ee95-serving-cert\""
Sep 11 19:46:50.408975 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.408949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"]
Sep 11 19:46:50.486576 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.486538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-maas-api-tls\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.486741 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.486639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5qb\" (UniqueName: \"kubernetes.io/projected/1e04a092-67d4-4574-bfb0-0e43b603d396-kube-api-access-vq5qb\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.486741 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.486695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-metrics-certs\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.486741 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.486715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e04a092-67d4-4574-bfb0-0e43b603d396-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.587739 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.587708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-maas-api-tls\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.587922 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.587755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5qb\" (UniqueName: \"kubernetes.io/projected/1e04a092-67d4-4574-bfb0-0e43b603d396-kube-api-access-vq5qb\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.587922 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.587790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-metrics-certs\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.587922 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.587807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e04a092-67d4-4574-bfb0-0e43b603d396-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.588632 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.588607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e04a092-67d4-4574-bfb0-0e43b603d396-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.592030 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.592006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-metrics-certs\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.592155 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.592033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-maas-api-tls\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.598762 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.598732    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:50.605051 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.605031    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:50.609152 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.609125    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5qb\" (UniqueName: \"kubernetes.io/projected/1e04a092-67d4-4574-bfb0-0e43b603d396-kube-api-access-vq5qb\") pod \"maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.703786 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.703709    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:50.925325 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.922396    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:50.930220 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.926706    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:46:50.992289 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:50.992178    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"]
Sep 11 19:46:50.997770 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:46:50.997719    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e04a092_67d4_4574_bfb0_0e43b603d396.slice/crio-88f655bbdc39e0f2c3dad6974b271c895476f7f907818cab350143f886c1eb19 WatchSource:0}: Error finding container 88f655bbdc39e0f2c3dad6974b271c895476f7f907818cab350143f886c1eb19: Status 404 returned error can't find the container with id 88f655bbdc39e0f2c3dad6974b271c895476f7f907818cab350143f886c1eb19
Sep 11 19:46:51.927603 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:51.927570    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b" event={"ID":"1e04a092-67d4-4574-bfb0-0e43b603d396","Type":"ContainerStarted","Data":"433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d"}
Sep 11 19:46:51.928027 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:51.927632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b" event={"ID":"1e04a092-67d4-4574-bfb0-0e43b603d396","Type":"ContainerStarted","Data":"88f655bbdc39e0f2c3dad6974b271c895476f7f907818cab350143f886c1eb19"}
Sep 11 19:46:51.928027 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:51.927903    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:51.950197 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:51.950171    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"]
Sep 11 19:46:51.953936 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:51.953914    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:51.955567 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:51.955370    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b" podStartSLOduration=1.5322976019999999 podStartE2EDuration="1.955352735s" totalImagesPullingTime="423.055133ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:46:51.95342111 +0000 UTC m=+1046.187494555" watchObservedRunningTime="2026-09-11 19:46:51.955352735 +0000 UTC m=+1046.189426156"
Sep 11 19:46:51.960056 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:51.960037    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a58a49-serving-cert\""
Sep 11 19:46:51.974085 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:51.974060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"]
Sep 11 19:46:52.116082 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.116052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwndk\" (UniqueName: \"kubernetes.io/projected/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-kube-api-access-lwndk\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.116293 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.116247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-metrics-certs\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.116386 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.116365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-maas-api-tls\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.116541 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.116462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.217277 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.217171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwndk\" (UniqueName: \"kubernetes.io/projected/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-kube-api-access-lwndk\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.217277 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.217235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-metrics-certs\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.217506 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.217297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-maas-api-tls\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.217506 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:46:52.217383    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-serving-cert: secret "maas-api-e2e-inf-a-a58a49-serving-cert" not found
Sep 11 19:46:52.217506 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:46:52.217439    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-maas-api-tls podName:6821b98d-adca-4cc5-9f2b-c3ea1b702f63 nodeName:}" failed. No retries permitted until 2026-09-11 19:46:52.717423362 +0000 UTC m=+1046.951496761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-maas-api-tls") pod "maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h" (UID: "6821b98d-adca-4cc5-9f2b-c3ea1b702f63") : secret "maas-api-e2e-inf-a-a58a49-serving-cert" not found
Sep 11 19:46:52.217506 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.217437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.218023 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.218004    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.219861 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.219838    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-metrics-certs\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.227981 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.227962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwndk\" (UniqueName: \"kubernetes.io/projected/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-kube-api-access-lwndk\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.722929 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.722898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-maas-api-tls\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.725540 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.725514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-maas-api-tls\") pod \"maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:52.866644 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:52.866618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:53.052591 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.052510    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"]
Sep 11 19:46:53.057145 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.057123    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:46:53.060120 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.060097    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-a58a49-dockercfg-555cb\""
Sep 11 19:46:53.060249 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.060140    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-a58a49\""
Sep 11 19:46:53.083650 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.083631    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"]
Sep 11 19:46:53.157901 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.157852    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"]
Sep 11 19:46:53.159702 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:46:53.159677    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6821b98d_adca_4cc5_9f2b_c3ea1b702f63.slice/crio-7270ea08e59c219b66acaf0cddd8fb4c9c4019577d87fd26484955abd08cc6f9 WatchSource:0}: Error finding container 7270ea08e59c219b66acaf0cddd8fb4c9c4019577d87fd26484955abd08cc6f9: Status 404 returned error can't find the container with id 7270ea08e59c219b66acaf0cddd8fb4c9c4019577d87fd26484955abd08cc6f9
Sep 11 19:46:53.228483 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.228453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bed74668-7637-4c85-afe5-c36d4b13f0ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr\" (UID: \"bed74668-7637-4c85-afe5-c36d4b13f0ba\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:46:53.228618 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.228526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8rfm\" (UniqueName: \"kubernetes.io/projected/bed74668-7637-4c85-afe5-c36d4b13f0ba-kube-api-access-r8rfm\") pod \"payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr\" (UID: \"bed74668-7637-4c85-afe5-c36d4b13f0ba\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:46:53.329400 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.329367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bed74668-7637-4c85-afe5-c36d4b13f0ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr\" (UID: \"bed74668-7637-4c85-afe5-c36d4b13f0ba\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:46:53.329579 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.329432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8rfm\" (UniqueName: \"kubernetes.io/projected/bed74668-7637-4c85-afe5-c36d4b13f0ba-kube-api-access-r8rfm\") pod \"payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr\" (UID: \"bed74668-7637-4c85-afe5-c36d4b13f0ba\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:46:53.330109 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.330086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bed74668-7637-4c85-afe5-c36d4b13f0ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr\" (UID: \"bed74668-7637-4c85-afe5-c36d4b13f0ba\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:46:53.340684 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.340658    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8rfm\" (UniqueName: \"kubernetes.io/projected/bed74668-7637-4c85-afe5-c36d4b13f0ba-kube-api-access-r8rfm\") pod \"payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr\" (UID: \"bed74668-7637-4c85-afe5-c36d4b13f0ba\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:46:53.368475 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.368450    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:46:53.649338 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.649313    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"]
Sep 11 19:46:53.650019 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:46:53.649996    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed74668_7637_4c85_afe5_c36d4b13f0ba.slice/crio-4d417fab1f47257d0168e076d3bcce6fd238eec4c0ba8cb3f404ea9a6d154ca3 WatchSource:0}: Error finding container 4d417fab1f47257d0168e076d3bcce6fd238eec4c0ba8cb3f404ea9a6d154ca3: Status 404 returned error can't find the container with id 4d417fab1f47257d0168e076d3bcce6fd238eec4c0ba8cb3f404ea9a6d154ca3
Sep 11 19:46:53.943639 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.943553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr" event={"ID":"bed74668-7637-4c85-afe5-c36d4b13f0ba","Type":"ContainerStarted","Data":"cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187"}
Sep 11 19:46:53.943639 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.943614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr" event={"ID":"bed74668-7637-4c85-afe5-c36d4b13f0ba","Type":"ContainerStarted","Data":"4d417fab1f47257d0168e076d3bcce6fd238eec4c0ba8cb3f404ea9a6d154ca3"}
Sep 11 19:46:53.943872 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.943658    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:46:53.945478 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.945457    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h" event={"ID":"6821b98d-adca-4cc5-9f2b-c3ea1b702f63","Type":"ContainerStarted","Data":"76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c"}
Sep 11 19:46:53.945574 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.945500    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h" event={"ID":"6821b98d-adca-4cc5-9f2b-c3ea1b702f63","Type":"ContainerStarted","Data":"7270ea08e59c219b66acaf0cddd8fb4c9c4019577d87fd26484955abd08cc6f9"}
Sep 11 19:46:53.945574 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.945529    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:46:53.973737 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:53.973691    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr" podStartSLOduration=1.973677925 podStartE2EDuration="1.973677925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:46:53.971843054 +0000 UTC m=+1048.205916478" watchObservedRunningTime="2026-09-11 19:46:53.973677925 +0000 UTC m=+1048.207751347"
Sep 11 19:46:54.000612 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:54.000564    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h" podStartSLOduration=2.557347738 podStartE2EDuration="3.000549665s" totalImagesPullingTime="443.201927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:46:53.999366251 +0000 UTC m=+1048.233439673" watchObservedRunningTime="2026-09-11 19:46:54.000549665 +0000 UTC m=+1048.234623091"
Sep 11 19:46:55.671195 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.671144    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"]
Sep 11 19:46:55.675813 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.675795    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.678733 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.678711    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-4b032e-serving-cert\""
Sep 11 19:46:55.690910 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.690884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"]
Sep 11 19:46:55.753351 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.753313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a88aa6ff-907e-4be6-ae60-729733aef025-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.753351 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.753355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-metrics-certs\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.753567 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.753411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bggp5\" (UniqueName: \"kubernetes.io/projected/a88aa6ff-907e-4be6-ae60-729733aef025-kube-api-access-bggp5\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.753567 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.753463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-maas-api-tls\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.854568 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.854534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-maas-api-tls\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.854737 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.854606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a88aa6ff-907e-4be6-ae60-729733aef025-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.854737 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.854633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-metrics-certs\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.854737 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.854678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bggp5\" (UniqueName: \"kubernetes.io/projected/a88aa6ff-907e-4be6-ae60-729733aef025-kube-api-access-bggp5\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.855458 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.855342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a88aa6ff-907e-4be6-ae60-729733aef025-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.857305 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.857284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-metrics-certs\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.857413 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.857310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-maas-api-tls\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.872550 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.872529    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bggp5\" (UniqueName: \"kubernetes.io/projected/a88aa6ff-907e-4be6-ae60-729733aef025-kube-api-access-bggp5\") pod \"maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:55.989742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:55.989643    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:56.308635 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:56.308594    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"]
Sep 11 19:46:56.310762 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:46:56.310731    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88aa6ff_907e_4be6_ae60_729733aef025.slice/crio-ee7cefe7fa3e7f725448d32ea48f861115a18025348e75ab03ce67b02537ca8d WatchSource:0}: Error finding container ee7cefe7fa3e7f725448d32ea48f861115a18025348e75ab03ce67b02537ca8d: Status 404 returned error can't find the container with id ee7cefe7fa3e7f725448d32ea48f861115a18025348e75ab03ce67b02537ca8d
Sep 11 19:46:56.965456 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:56.965358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh" event={"ID":"a88aa6ff-907e-4be6-ae60-729733aef025","Type":"ContainerStarted","Data":"0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87"}
Sep 11 19:46:56.965456 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:56.965421    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh" event={"ID":"a88aa6ff-907e-4be6-ae60-729733aef025","Type":"ContainerStarted","Data":"ee7cefe7fa3e7f725448d32ea48f861115a18025348e75ab03ce67b02537ca8d"}
Sep 11 19:46:56.965910 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:56.965578    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:46:56.991281 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:56.990697    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh" podStartSLOduration=1.6358747569999998 podStartE2EDuration="1.990675237s" totalImagesPullingTime="354.80048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:46:56.987155438 +0000 UTC m=+1051.221228861" watchObservedRunningTime="2026-09-11 19:46:56.990675237 +0000 UTC m=+1051.224748660"
Sep 11 19:46:57.940376 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:57.940345    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 19:46:59.956288 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:46:59.956247    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:47:02.978066 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:02.978040    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 19:47:04.952399 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:04.952370    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:47:05.087538 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.087507    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"]
Sep 11 19:47:05.093309 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.093285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.097876 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.097801    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-04331c-openshift-default-dockercfg-wpgpr\""
Sep 11 19:47:05.109601 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.109577    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"]
Sep 11 19:47:05.149880 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.149852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42q42\" (UniqueName: \"kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-kube-api-access-42q42\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.150026 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.149909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-istio-token\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.150026 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.149959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-socket\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.150026 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.149985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-envoy\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.150026 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.150016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52416269-32c4-4280-9508-7de137dd746d-istiod-ca-cert\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.150170 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.150036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-certs\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.150170 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.150095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52416269-32c4-4280-9508-7de137dd746d-istio-podinfo\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.150170 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.150122    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-data\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.150170 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.150149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-credential-socket\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.240352 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.240281    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"]
Sep 11 19:47:05.244907 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.244888    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.247605 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.247585    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-7df2ac-serving-cert\""
Sep 11 19:47:05.250667 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.250646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-istio-token\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.250799 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.250691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-socket\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.250799 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.250713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-envoy\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.250799 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.250741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52416269-32c4-4280-9508-7de137dd746d-istiod-ca-cert\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.250799 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.250772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-certs\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.251059 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.250830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52416269-32c4-4280-9508-7de137dd746d-istio-podinfo\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.251059 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.250872    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-data\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.251059 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.250913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-credential-socket\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.251059 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.250968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42q42\" (UniqueName: \"kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-kube-api-access-42q42\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.251310 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.251202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-certs\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.251639 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.251612    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52416269-32c4-4280-9508-7de137dd746d-istiod-ca-cert\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.251787 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.251768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-credential-socket\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.251860 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.251849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-data\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.252085 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.252066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-socket\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.254498 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.254462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52416269-32c4-4280-9508-7de137dd746d-istio-podinfo\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.254675 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.254655    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-envoy\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.258536 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.258514    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"]
Sep 11 19:47:05.264535 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.264515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-istio-token\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.269345 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.269320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42q42\" (UniqueName: \"kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-kube-api-access-42q42\") pod \"e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") " pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.352249 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.352206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z74v9\" (UniqueName: \"kubernetes.io/projected/080fb9cf-5115-4c79-88aa-0329ad97dbf4-kube-api-access-z74v9\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.352434 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.352294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-metrics-certs\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.352637 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.352612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-maas-api-tls\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.352735 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.352674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/080fb9cf-5115-4c79-88aa-0329ad97dbf4-openshift-service-ca\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.407411 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.407377    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:05.457161 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.456910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-metrics-certs\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.457161 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.457016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-maas-api-tls\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.457161 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.457068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/080fb9cf-5115-4c79-88aa-0329ad97dbf4-openshift-service-ca\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.457161 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.457128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z74v9\" (UniqueName: \"kubernetes.io/projected/080fb9cf-5115-4c79-88aa-0329ad97dbf4-kube-api-access-z74v9\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.457498 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:47:05.457310    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-serving-cert: secret "maas-api-e2e-autores-7df2ac-serving-cert" not found
Sep 11 19:47:05.457498 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:47:05.457385    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-maas-api-tls podName:080fb9cf-5115-4c79-88aa-0329ad97dbf4 nodeName:}" failed. No retries permitted until 2026-09-11 19:47:05.957364453 +0000 UTC m=+1060.191437852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-maas-api-tls") pod "maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n" (UID: "080fb9cf-5115-4c79-88aa-0329ad97dbf4") : secret "maas-api-e2e-autores-7df2ac-serving-cert" not found
Sep 11 19:47:05.457954 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.457922    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/080fb9cf-5115-4c79-88aa-0329ad97dbf4-openshift-service-ca\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.459926 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.459905    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-metrics-certs\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.468461 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.468415    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z74v9\" (UniqueName: \"kubernetes.io/projected/080fb9cf-5115-4c79-88aa-0329ad97dbf4-kube-api-access-z74v9\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.701653 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.701026    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"]
Sep 11 19:47:05.722896 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:47:05.722850    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52416269_32c4_4280_9508_7de137dd746d.slice/crio-6b512c4b937601314f2a0cf52fc5d2f121cd2d4002c130bf45d74d3039062a63 WatchSource:0}: Error finding container 6b512c4b937601314f2a0cf52fc5d2f121cd2d4002c130bf45d74d3039062a63: Status 404 returned error can't find the container with id 6b512c4b937601314f2a0cf52fc5d2f121cd2d4002c130bf45d74d3039062a63
Sep 11 19:47:05.726727 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.726693    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:47:05.726850 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.726781    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:47:05.726850 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.726824    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:47:05.963805 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.963730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-maas-api-tls\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:05.966153 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:05.966131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-maas-api-tls\") pod \"maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:06.035811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.035680    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" event={"ID":"52416269-32c4-4280-9508-7de137dd746d","Type":"ContainerStarted","Data":"69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711"}
Sep 11 19:47:06.035811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.035794    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" event={"ID":"52416269-32c4-4280-9508-7de137dd746d","Type":"ContainerStarted","Data":"6b512c4b937601314f2a0cf52fc5d2f121cd2d4002c130bf45d74d3039062a63"}
Sep 11 19:47:06.067636 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.067588    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" podStartSLOduration=1.067571008 podStartE2EDuration="1.067571008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:47:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:47:06.064219305 +0000 UTC m=+1060.298292720" watchObservedRunningTime="2026-09-11 19:47:06.067571008 +0000 UTC m=+1060.301644428"
Sep 11 19:47:06.219309 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.218983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:06.412582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.412548    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:06.421658 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.421629    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:06.486771 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.486672    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"]
Sep 11 19:47:06.527519 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.527496    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"]
Sep 11 19:47:06.527798 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.527755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:06.533662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.533558    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6fddae31-serving-cert\""
Sep 11 19:47:06.533817 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.533679    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"]
Sep 11 19:47:06.537293 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:47:06.537254    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080fb9cf_5115_4c79_88aa_0329ad97dbf4.slice/crio-d686971737cfba58e7c716cded2d108de98619f7725875e132cc524af0e571fd WatchSource:0}: Error finding container d686971737cfba58e7c716cded2d108de98619f7725875e132cc524af0e571fd: Status 404 returned error can't find the container with id d686971737cfba58e7c716cded2d108de98619f7725875e132cc524af0e571fd
Sep 11 19:47:06.569442 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.569415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crbcm\" (UniqueName: \"kubernetes.io/projected/a5500a21-33eb-401a-a702-0474263926d2-kube-api-access-crbcm\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:06.569555 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.569452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-metrics-certs\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:06.569620 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.569554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-maas-api-tls\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:06.569675 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.569618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5500a21-33eb-401a-a702-0474263926d2-openshift-service-ca\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:06.670346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.670316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crbcm\" (UniqueName: \"kubernetes.io/projected/a5500a21-33eb-401a-a702-0474263926d2-kube-api-access-crbcm\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:06.670346 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.670352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-metrics-certs\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:06.670543 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.670412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-maas-api-tls\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:06.670543 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.670457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5500a21-33eb-401a-a702-0474263926d2-openshift-service-ca\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:06.670608 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:47:06.670576    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-serving-cert: secret "maas-api-e2e-ait-6fddae31-serving-cert" not found
Sep 11 19:47:06.670667 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:47:06.670652    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-maas-api-tls podName:a5500a21-33eb-401a-a702-0474263926d2 nodeName:}" failed. No retries permitted until 2026-09-11 19:47:07.170633953 +0000 UTC m=+1061.404707354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-maas-api-tls") pod "maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv" (UID: "a5500a21-33eb-401a-a702-0474263926d2") : secret "maas-api-e2e-ait-6fddae31-serving-cert" not found
Sep 11 19:47:06.671215 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.671143    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5500a21-33eb-401a-a702-0474263926d2-openshift-service-ca\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:06.672801 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.672780    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-metrics-certs\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:06.682786 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:06.682766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crbcm\" (UniqueName: \"kubernetes.io/projected/a5500a21-33eb-401a-a702-0474263926d2-kube-api-access-crbcm\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:07.045125 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:07.045089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n" event={"ID":"080fb9cf-5115-4c79-88aa-0329ad97dbf4","Type":"ContainerStarted","Data":"949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada"}
Sep 11 19:47:07.045599 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:07.045194    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n" event={"ID":"080fb9cf-5115-4c79-88aa-0329ad97dbf4","Type":"ContainerStarted","Data":"d686971737cfba58e7c716cded2d108de98619f7725875e132cc524af0e571fd"}
Sep 11 19:47:07.045663 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:07.045599    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:07.045663 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:07.045652    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:07.046718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:07.046695    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:07.141480 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:07.141427    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n" podStartSLOduration=1.75624214 podStartE2EDuration="2.141408767s" totalImagesPullingTime="385.166627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:47:07.086165957 +0000 UTC m=+1061.320239403" watchObservedRunningTime="2026-09-11 19:47:07.141408767 +0000 UTC m=+1061.375482187"
Sep 11 19:47:07.176662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:07.176577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-maas-api-tls\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:07.179627 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:07.179605    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-maas-api-tls\") pod \"maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:07.451895 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:07.451807    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:07.774702 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:07.774668    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"]
Sep 11 19:47:07.775902 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:47:07.775879    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5500a21_33eb_401a_a702_0474263926d2.slice/crio-f79edc8030bb5868be5cee7e168bce32037fa311d80bf1808f80115ab364ef34 WatchSource:0}: Error finding container f79edc8030bb5868be5cee7e168bce32037fa311d80bf1808f80115ab364ef34: Status 404 returned error can't find the container with id f79edc8030bb5868be5cee7e168bce32037fa311d80bf1808f80115ab364ef34
Sep 11 19:47:08.056685 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:08.056585    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv" event={"ID":"a5500a21-33eb-401a-a702-0474263926d2","Type":"ContainerStarted","Data":"f79edc8030bb5868be5cee7e168bce32037fa311d80bf1808f80115ab364ef34"}
Sep 11 19:47:09.064649 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:09.064615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv" event={"ID":"a5500a21-33eb-401a-a702-0474263926d2","Type":"ContainerStarted","Data":"89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c"}
Sep 11 19:47:09.065170 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:09.065142    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:13.062681 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:13.062649    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:47:13.087357 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:13.087298    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv" podStartSLOduration=6.6799964670000005 podStartE2EDuration="7.08724965s" totalImagesPullingTime="407.253183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:47:09.101515708 +0000 UTC m=+1063.335589130" watchObservedRunningTime="2026-09-11 19:47:13.08724965 +0000 UTC m=+1067.321323072"
Sep 11 19:47:15.105334 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:15.105294    2578 generic.go:356] "Generic (PLEG): container finished" podID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerID="914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac" exitCode=0
Sep 11 19:47:15.105865 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:15.105350    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" event={"ID":"273e9337-5ab2-42c3-b053-033dcc6e4ac5","Type":"ContainerDied","Data":"914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac"}
Sep 11 19:47:15.105935 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:15.105908    2578 scope.go:117] "RemoveContainer" containerID="914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac"
Sep 11 19:47:15.107128 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:15.107100    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:47:15.107199 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:15.107187    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:47:15.107242 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:15.107219    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:47:16.084518 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:16.084489    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:16.125357 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:16.124512    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" event={"ID":"273e9337-5ab2-42c3-b053-033dcc6e4ac5","Type":"ContainerStarted","Data":"10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a"}
Sep 11 19:47:16.598951 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:16.598903    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:47:16.600576 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:16.600540    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 19:47:16.600703 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:16.600621    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 19:47:17.599945 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:17.599860    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 19:47:17.600510 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:17.600479    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 19:47:18.598913 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:18.598877    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 19:47:18.599222 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:18.599193    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 19:47:19.599106 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:19.599066    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 19:47:19.599619 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:19.599140    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 19:47:20.600275 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:20.600212    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 19:47:20.600792 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:20.600301    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 19:47:20.922227 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:20.922138    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:47:21.599513 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:21.599475    2578 patch_prober.go:28] interesting pod/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 19:47:21.599687 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:21.599536    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 19:47:22.602760 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:22.602723    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:47:22.603846 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:22.603828    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 19:47:36.270012 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:36.269909    2578 generic.go:356] "Generic (PLEG): container finished" podID="52416269-32c4-4280-9508-7de137dd746d" containerID="69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711" exitCode=0
Sep 11 19:47:36.270012 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:36.269984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" event={"ID":"52416269-32c4-4280-9508-7de137dd746d","Type":"ContainerDied","Data":"69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711"}
Sep 11 19:47:36.270503 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:36.270400    2578 scope.go:117] "RemoveContainer" containerID="69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711"
Sep 11 19:47:36.271587 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:36.271560    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:47:36.271716 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:36.271638    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:47:36.271716 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:36.271686    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 19:47:37.045349 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:37.045313    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:37.278105 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:37.278072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" event={"ID":"52416269-32c4-4280-9508-7de137dd746d","Type":"ContainerStarted","Data":"523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13"}
Sep 11 19:47:37.408070 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:37.408034    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:37.409456 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:37.409419    2578 patch_prober.go:28] interesting pod/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:47:37.409577 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:37.409543    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 11 19:47:38.408532 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:38.408494    2578 patch_prober.go:28] interesting pod/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:47:38.409103 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:38.409070    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 11 19:47:39.408867 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:39.408827    2578 patch_prober.go:28] interesting pod/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:47:39.409358 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:39.408910    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 11 19:47:40.408018 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:40.407980    2578 patch_prober.go:28] interesting pod/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:47:40.408352 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:40.408319    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 11 19:47:41.414849 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:41.414810    2578 patch_prober.go:28] interesting pod/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:47:41.415469 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:41.415435    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 11 19:47:42.412762 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:42.412729    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:42.413407 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:42.413377    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:42.414245 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:42.414228    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:47:46.939820 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:46.939788    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"]
Sep 11 19:47:46.940642 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:46.940607    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv" podUID="a5500a21-33eb-401a-a702-0474263926d2" containerName="maas-api" containerID="cri-o://89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c" gracePeriod=30
Sep 11 19:47:47.200427 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.200371    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:47.326136 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.326102    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crbcm\" (UniqueName: \"kubernetes.io/projected/a5500a21-33eb-401a-a702-0474263926d2-kube-api-access-crbcm\") pod \"a5500a21-33eb-401a-a702-0474263926d2\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") "
Sep 11 19:47:47.326368 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.326192    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-metrics-certs\") pod \"a5500a21-33eb-401a-a702-0474263926d2\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") "
Sep 11 19:47:47.326368 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.326290    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-maas-api-tls\") pod \"a5500a21-33eb-401a-a702-0474263926d2\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") "
Sep 11 19:47:47.326368 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.326363    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5500a21-33eb-401a-a702-0474263926d2-openshift-service-ca\") pod \"a5500a21-33eb-401a-a702-0474263926d2\" (UID: \"a5500a21-33eb-401a-a702-0474263926d2\") "
Sep 11 19:47:47.326983 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.326929    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5500a21-33eb-401a-a702-0474263926d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5500a21-33eb-401a-a702-0474263926d2" (UID: "a5500a21-33eb-401a-a702-0474263926d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:47:47.330100 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.330076    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5500a21-33eb-401a-a702-0474263926d2-kube-api-access-crbcm" (OuterVolumeSpecName: "kube-api-access-crbcm") pod "a5500a21-33eb-401a-a702-0474263926d2" (UID: "a5500a21-33eb-401a-a702-0474263926d2"). InnerVolumeSpecName "kube-api-access-crbcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:47:47.331184 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.331153    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a5500a21-33eb-401a-a702-0474263926d2" (UID: "a5500a21-33eb-401a-a702-0474263926d2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:47:47.331568 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.331535    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5500a21-33eb-401a-a702-0474263926d2" (UID: "a5500a21-33eb-401a-a702-0474263926d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:47:47.355191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.352649    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5500a21-33eb-401a-a702-0474263926d2" containerID="89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c" exitCode=0
Sep 11 19:47:47.355191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.353186    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"
Sep 11 19:47:47.355191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.353654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv" event={"ID":"a5500a21-33eb-401a-a702-0474263926d2","Type":"ContainerDied","Data":"89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c"}
Sep 11 19:47:47.355191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.353725    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv" event={"ID":"a5500a21-33eb-401a-a702-0474263926d2","Type":"ContainerDied","Data":"f79edc8030bb5868be5cee7e168bce32037fa311d80bf1808f80115ab364ef34"}
Sep 11 19:47:47.355191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.354623    2578 scope.go:117] "RemoveContainer" containerID="89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c"
Sep 11 19:47:47.377593 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.373565    2578 scope.go:117] "RemoveContainer" containerID="89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c"
Sep 11 19:47:47.377593 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:47:47.376752    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c\": container with ID starting with 89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c not found: ID does not exist" containerID="89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c"
Sep 11 19:47:47.377593 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.376791    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c"} err="failed to get container status \"89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c\": rpc error: code = NotFound desc = could not find container \"89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c\": container with ID starting with 89cd3b9d06f4a711b57a6e0c05f022b2da2a1f20b4f9d4eadae1a9a0b8eaa03c not found: ID does not exist"
Sep 11 19:47:47.410092 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.410041    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"]
Sep 11 19:47:47.414582 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.414552    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6fddae31-6bf9556b6b-4cqzv"]
Sep 11 19:47:47.427643 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.427614    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crbcm\" (UniqueName: \"kubernetes.io/projected/a5500a21-33eb-401a-a702-0474263926d2-kube-api-access-crbcm\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:47:47.427643 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.427640    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:47:47.427805 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.427651    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5500a21-33eb-401a-a702-0474263926d2-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:47:47.427805 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:47.427659    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5500a21-33eb-401a-a702-0474263926d2-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:47:48.258871 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:48.258838    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5500a21-33eb-401a-a702-0474263926d2" path="/var/lib/kubelet/pods/a5500a21-33eb-401a-a702-0474263926d2/volumes"
Sep 11 19:47:53.470497 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.470464    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"]
Sep 11 19:47:53.471247 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.471230    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5500a21-33eb-401a-a702-0474263926d2" containerName="maas-api"
Sep 11 19:47:53.471324 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.471250    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5500a21-33eb-401a-a702-0474263926d2" containerName="maas-api"
Sep 11 19:47:53.471405 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.471394    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5500a21-33eb-401a-a702-0474263926d2" containerName="maas-api"
Sep 11 19:47:53.474857 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.474842    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.478439 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.478417    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c8fc710a-serving-cert\""
Sep 11 19:47:53.493521 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.493494    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"]
Sep 11 19:47:53.595831 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.595768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48f860ca-c620-4f2a-b193-02549fd87bf6-openshift-service-ca\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.596053 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.596001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-metrics-certs\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.596053 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.596045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-maas-api-tls\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.596189 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.596086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brwqw\" (UniqueName: \"kubernetes.io/projected/48f860ca-c620-4f2a-b193-02549fd87bf6-kube-api-access-brwqw\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.696805 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.696756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brwqw\" (UniqueName: \"kubernetes.io/projected/48f860ca-c620-4f2a-b193-02549fd87bf6-kube-api-access-brwqw\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.696967 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.696843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48f860ca-c620-4f2a-b193-02549fd87bf6-openshift-service-ca\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.697024 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.697006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-metrics-certs\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.697065 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.697043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-maas-api-tls\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.697678 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.697645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48f860ca-c620-4f2a-b193-02549fd87bf6-openshift-service-ca\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.699722 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.699689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-metrics-certs\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.699868 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.699721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-maas-api-tls\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.705008 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.704984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brwqw\" (UniqueName: \"kubernetes.io/projected/48f860ca-c620-4f2a-b193-02549fd87bf6-kube-api-access-brwqw\") pod \"maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:53.785602 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:53.785523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:54.064274 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:54.064232    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"]
Sep 11 19:47:54.066435 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:47:54.066400    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f860ca_c620_4f2a_b193_02549fd87bf6.slice/crio-52329e64f3f67ada86e5a8b72750792f0f2568f2d6cd3ddccefb9d9d6e502edb WatchSource:0}: Error finding container 52329e64f3f67ada86e5a8b72750792f0f2568f2d6cd3ddccefb9d9d6e502edb: Status 404 returned error can't find the container with id 52329e64f3f67ada86e5a8b72750792f0f2568f2d6cd3ddccefb9d9d6e502edb
Sep 11 19:47:54.398815 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:54.398732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7" event={"ID":"48f860ca-c620-4f2a-b193-02549fd87bf6","Type":"ContainerStarted","Data":"52329e64f3f67ada86e5a8b72750792f0f2568f2d6cd3ddccefb9d9d6e502edb"}
Sep 11 19:47:55.406757 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:55.406721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7" event={"ID":"48f860ca-c620-4f2a-b193-02549fd87bf6","Type":"ContainerStarted","Data":"ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70"}
Sep 11 19:47:55.407199 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:55.406883    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:47:55.428362 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:47:55.428303    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7" podStartSLOduration=2.066641828 podStartE2EDuration="2.428286193s" totalImagesPullingTime="361.644365ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:47:55.424681754 +0000 UTC m=+1109.658755174" watchObservedRunningTime="2026-09-11 19:47:55.428286193 +0000 UTC m=+1109.662359611"
Sep 11 19:48:01.419415 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:01.419388    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:48:22.801447 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:22.801411    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"]
Sep 11 19:48:22.801927 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:22.801666    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7" podUID="48f860ca-c620-4f2a-b193-02549fd87bf6" containerName="maas-api" containerID="cri-o://ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70" gracePeriod=30
Sep 11 19:48:23.067362 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.067341    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:48:23.207082 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.207040    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brwqw\" (UniqueName: \"kubernetes.io/projected/48f860ca-c620-4f2a-b193-02549fd87bf6-kube-api-access-brwqw\") pod \"48f860ca-c620-4f2a-b193-02549fd87bf6\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") "
Sep 11 19:48:23.207299 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.207107    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48f860ca-c620-4f2a-b193-02549fd87bf6-openshift-service-ca\") pod \"48f860ca-c620-4f2a-b193-02549fd87bf6\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") "
Sep 11 19:48:23.207299 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.207158    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-metrics-certs\") pod \"48f860ca-c620-4f2a-b193-02549fd87bf6\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") "
Sep 11 19:48:23.207299 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.207181    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-maas-api-tls\") pod \"48f860ca-c620-4f2a-b193-02549fd87bf6\" (UID: \"48f860ca-c620-4f2a-b193-02549fd87bf6\") "
Sep 11 19:48:23.208037 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.207855    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48f860ca-c620-4f2a-b193-02549fd87bf6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48f860ca-c620-4f2a-b193-02549fd87bf6" (UID: "48f860ca-c620-4f2a-b193-02549fd87bf6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:48:23.208204 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.208176    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48f860ca-c620-4f2a-b193-02549fd87bf6-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:48:23.224109 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.224076    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48f860ca-c620-4f2a-b193-02549fd87bf6-kube-api-access-brwqw" (OuterVolumeSpecName: "kube-api-access-brwqw") pod "48f860ca-c620-4f2a-b193-02549fd87bf6" (UID: "48f860ca-c620-4f2a-b193-02549fd87bf6"). InnerVolumeSpecName "kube-api-access-brwqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:48:23.224305 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.224151    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48f860ca-c620-4f2a-b193-02549fd87bf6" (UID: "48f860ca-c620-4f2a-b193-02549fd87bf6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:48:23.224710 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.224684    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "48f860ca-c620-4f2a-b193-02549fd87bf6" (UID: "48f860ca-c620-4f2a-b193-02549fd87bf6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:48:23.309978 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.309940    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brwqw\" (UniqueName: \"kubernetes.io/projected/48f860ca-c620-4f2a-b193-02549fd87bf6-kube-api-access-brwqw\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:48:23.309978 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.309976    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:48:23.310182 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.309991    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48f860ca-c620-4f2a-b193-02549fd87bf6-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:48:23.570135 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.570100    2578 generic.go:356] "Generic (PLEG): container finished" podID="48f860ca-c620-4f2a-b193-02549fd87bf6" containerID="ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70" exitCode=0
Sep 11 19:48:23.570335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.570163    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"
Sep 11 19:48:23.570335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.570183    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7" event={"ID":"48f860ca-c620-4f2a-b193-02549fd87bf6","Type":"ContainerDied","Data":"ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70"}
Sep 11 19:48:23.570335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.570239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7" event={"ID":"48f860ca-c620-4f2a-b193-02549fd87bf6","Type":"ContainerDied","Data":"52329e64f3f67ada86e5a8b72750792f0f2568f2d6cd3ddccefb9d9d6e502edb"}
Sep 11 19:48:23.570335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.570279    2578 scope.go:117] "RemoveContainer" containerID="ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70"
Sep 11 19:48:23.580031 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.580013    2578 scope.go:117] "RemoveContainer" containerID="ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70"
Sep 11 19:48:23.580334 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:48:23.580316    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70\": container with ID starting with ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70 not found: ID does not exist" containerID="ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70"
Sep 11 19:48:23.580391 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.580343    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70"} err="failed to get container status \"ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70\": rpc error: code = NotFound desc = could not find container \"ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70\": container with ID starting with ad67a4c7a8103ffdd34d6c60f4ae267ec8deea3d6e3fb1299ff965b8b3b0df70 not found: ID does not exist"
Sep 11 19:48:23.593838 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.593806    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"]
Sep 11 19:48:23.599747 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:23.599726    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8fc710a-78b5b589d4-f87w7"]
Sep 11 19:48:24.258780 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:24.258750    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48f860ca-c620-4f2a-b193-02549fd87bf6" path="/var/lib/kubelet/pods/48f860ca-c620-4f2a-b193-02549fd87bf6/volumes"
Sep 11 19:48:27.881116 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:27.881084    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"]
Sep 11 19:48:27.881623 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:27.881609    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f860ca-c620-4f2a-b193-02549fd87bf6" containerName="maas-api"
Sep 11 19:48:27.881672 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:27.881625    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f860ca-c620-4f2a-b193-02549fd87bf6" containerName="maas-api"
Sep 11 19:48:27.881707 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:27.881701    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="48f860ca-c620-4f2a-b193-02549fd87bf6" containerName="maas-api"
Sep 11 19:48:27.886245 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:27.886227    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:27.889169 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:27.889145    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5d9a4dfe-serving-cert\""
Sep 11 19:48:27.897362 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:27.897204    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"]
Sep 11 19:48:27.965902 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:27.965866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7hfz\" (UniqueName: \"kubernetes.io/projected/3103ea77-bbd3-4c2e-a2cf-48918b121acd-kube-api-access-z7hfz\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:27.965902 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:27.965912    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3103ea77-bbd3-4c2e-a2cf-48918b121acd-openshift-service-ca\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:27.966170 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:27.966045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-maas-api-tls\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:27.966170 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:27.966079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-metrics-certs\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:28.067141 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:28.067108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-maas-api-tls\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:28.067360 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:28.067152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-metrics-certs\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:28.067360 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:28.067192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7hfz\" (UniqueName: \"kubernetes.io/projected/3103ea77-bbd3-4c2e-a2cf-48918b121acd-kube-api-access-z7hfz\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:28.067360 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:28.067211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3103ea77-bbd3-4c2e-a2cf-48918b121acd-openshift-service-ca\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:28.067360 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:48:28.067275    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-serving-cert: secret "maas-api-e2e-ait-5d9a4dfe-serving-cert" not found
Sep 11 19:48:28.067360 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:48:28.067360    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-maas-api-tls podName:3103ea77-bbd3-4c2e-a2cf-48918b121acd nodeName:}" failed. No retries permitted until 2026-09-11 19:48:28.567336819 +0000 UTC m=+1142.801410237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-maas-api-tls") pod "maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876" (UID: "3103ea77-bbd3-4c2e-a2cf-48918b121acd") : secret "maas-api-e2e-ait-5d9a4dfe-serving-cert" not found
Sep 11 19:48:28.067820 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:28.067802    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3103ea77-bbd3-4c2e-a2cf-48918b121acd-openshift-service-ca\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:28.069755 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:28.069731    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-metrics-certs\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:28.075786 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:28.075762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7hfz\" (UniqueName: \"kubernetes.io/projected/3103ea77-bbd3-4c2e-a2cf-48918b121acd-kube-api-access-z7hfz\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:28.572690 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:28.572652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-maas-api-tls\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:28.575480 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:28.575453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-maas-api-tls\") pod \"maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:28.802184 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:28.802146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:29.080894 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:29.080856    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"]
Sep 11 19:48:29.082399 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:48:29.082374    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3103ea77_bbd3_4c2e_a2cf_48918b121acd.slice/crio-ff9e03ac64817245c7fa4ad614f3936b7e857f32b04d63a6809af65d86c11644 WatchSource:0}: Error finding container ff9e03ac64817245c7fa4ad614f3936b7e857f32b04d63a6809af65d86c11644: Status 404 returned error can't find the container with id ff9e03ac64817245c7fa4ad614f3936b7e857f32b04d63a6809af65d86c11644
Sep 11 19:48:29.612335 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:29.612291    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876" event={"ID":"3103ea77-bbd3-4c2e-a2cf-48918b121acd","Type":"ContainerStarted","Data":"b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207"}
Sep 11 19:48:29.612505 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:29.612350    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876" event={"ID":"3103ea77-bbd3-4c2e-a2cf-48918b121acd","Type":"ContainerStarted","Data":"ff9e03ac64817245c7fa4ad614f3936b7e857f32b04d63a6809af65d86c11644"}
Sep 11 19:48:29.612505 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:29.612385    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:29.633971 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:29.633925    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876" podStartSLOduration=2.242155381 podStartE2EDuration="2.633908924s" totalImagesPullingTime="391.753543ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:48:29.630923116 +0000 UTC m=+1143.864996538" watchObservedRunningTime="2026-09-11 19:48:29.633908924 +0000 UTC m=+1143.867982344"
Sep 11 19:48:35.626168 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:35.626138    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:57.194747 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.194703    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"]
Sep 11 19:48:57.195490 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.195000    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876" podUID="3103ea77-bbd3-4c2e-a2cf-48918b121acd" containerName="maas-api" containerID="cri-o://b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207" gracePeriod=30
Sep 11 19:48:57.462450 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.462426    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:57.575046 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.575009    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-maas-api-tls\") pod \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") "
Sep 11 19:48:57.575231 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.575054    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7hfz\" (UniqueName: \"kubernetes.io/projected/3103ea77-bbd3-4c2e-a2cf-48918b121acd-kube-api-access-z7hfz\") pod \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") "
Sep 11 19:48:57.575231 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.575084    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-metrics-certs\") pod \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") "
Sep 11 19:48:57.575231 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.575112    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3103ea77-bbd3-4c2e-a2cf-48918b121acd-openshift-service-ca\") pod \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\" (UID: \"3103ea77-bbd3-4c2e-a2cf-48918b121acd\") "
Sep 11 19:48:57.575651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.575625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3103ea77-bbd3-4c2e-a2cf-48918b121acd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3103ea77-bbd3-4c2e-a2cf-48918b121acd" (UID: "3103ea77-bbd3-4c2e-a2cf-48918b121acd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:48:57.577416 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.577393    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3103ea77-bbd3-4c2e-a2cf-48918b121acd" (UID: "3103ea77-bbd3-4c2e-a2cf-48918b121acd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:48:57.577416 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.577402    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3103ea77-bbd3-4c2e-a2cf-48918b121acd" (UID: "3103ea77-bbd3-4c2e-a2cf-48918b121acd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:48:57.577541 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.577416    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3103ea77-bbd3-4c2e-a2cf-48918b121acd-kube-api-access-z7hfz" (OuterVolumeSpecName: "kube-api-access-z7hfz") pod "3103ea77-bbd3-4c2e-a2cf-48918b121acd" (UID: "3103ea77-bbd3-4c2e-a2cf-48918b121acd"). InnerVolumeSpecName "kube-api-access-z7hfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:48:57.676433 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.676397    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:48:57.676433 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.676428    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7hfz\" (UniqueName: \"kubernetes.io/projected/3103ea77-bbd3-4c2e-a2cf-48918b121acd-kube-api-access-z7hfz\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:48:57.676433 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.676437    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3103ea77-bbd3-4c2e-a2cf-48918b121acd-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:48:57.676663 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.676445    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3103ea77-bbd3-4c2e-a2cf-48918b121acd-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:48:57.781399 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.781301    2578 generic.go:356] "Generic (PLEG): container finished" podID="3103ea77-bbd3-4c2e-a2cf-48918b121acd" containerID="b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207" exitCode=0
Sep 11 19:48:57.781573 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.781415    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"
Sep 11 19:48:57.781573 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.781436    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876" event={"ID":"3103ea77-bbd3-4c2e-a2cf-48918b121acd","Type":"ContainerDied","Data":"b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207"}
Sep 11 19:48:57.781573 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.781493    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876" event={"ID":"3103ea77-bbd3-4c2e-a2cf-48918b121acd","Type":"ContainerDied","Data":"ff9e03ac64817245c7fa4ad614f3936b7e857f32b04d63a6809af65d86c11644"}
Sep 11 19:48:57.781573 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.781522    2578 scope.go:117] "RemoveContainer" containerID="b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207"
Sep 11 19:48:57.792482 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.792449    2578 scope.go:117] "RemoveContainer" containerID="b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207"
Sep 11 19:48:57.792777 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:48:57.792750    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207\": container with ID starting with b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207 not found: ID does not exist" containerID="b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207"
Sep 11 19:48:57.792885 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.792785    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207"} err="failed to get container status \"b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207\": rpc error: code = NotFound desc = could not find container \"b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207\": container with ID starting with b35d7706f21b17b527fbe8287f02b50dac6618774f35522608c9a3eedacba207 not found: ID does not exist"
Sep 11 19:48:57.803447 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.803428    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"]
Sep 11 19:48:57.807052 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:57.807030    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5d9a4dfe-8584d47bcd-49876"]
Sep 11 19:48:58.258353 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:48:58.258318    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3103ea77-bbd3-4c2e-a2cf-48918b121acd" path="/var/lib/kubelet/pods/3103ea77-bbd3-4c2e-a2cf-48918b121acd/volumes"
Sep 11 19:49:05.980662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:05.980618    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"]
Sep 11 19:49:05.981411 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:05.981387    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3103ea77-bbd3-4c2e-a2cf-48918b121acd" containerName="maas-api"
Sep 11 19:49:05.981411 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:05.981412    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3103ea77-bbd3-4c2e-a2cf-48918b121acd" containerName="maas-api"
Sep 11 19:49:05.981596 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:05.981560    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3103ea77-bbd3-4c2e-a2cf-48918b121acd" containerName="maas-api"
Sep 11 19:49:05.987165 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:05.986985    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:05.990718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:05.990695    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-6008a04d-serving-cert\""
Sep 11 19:49:05.999881 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:05.999819    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"]
Sep 11 19:49:06.063428 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.063394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfdh4\" (UniqueName: \"kubernetes.io/projected/dcf9235a-002e-492a-9d1a-9e4c27910aa0-kube-api-access-nfdh4\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.063588 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.063454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-maas-api-tls\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.063588 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.063572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-metrics-certs\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.063677 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.063610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf9235a-002e-492a-9d1a-9e4c27910aa0-openshift-service-ca\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.165082 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.165048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-metrics-certs\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.165254 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.165099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf9235a-002e-492a-9d1a-9e4c27910aa0-openshift-service-ca\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.165254 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.165193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdh4\" (UniqueName: \"kubernetes.io/projected/dcf9235a-002e-492a-9d1a-9e4c27910aa0-kube-api-access-nfdh4\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.165254 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.165239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-maas-api-tls\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.165875 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.165792    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf9235a-002e-492a-9d1a-9e4c27910aa0-openshift-service-ca\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.167662 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.167640    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-maas-api-tls\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.167762 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.167680    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-metrics-certs\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.175550 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.175529    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfdh4\" (UniqueName: \"kubernetes.io/projected/dcf9235a-002e-492a-9d1a-9e4c27910aa0-kube-api-access-nfdh4\") pod \"maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.304098 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.304019    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:06.581111 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.581087    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"]
Sep 11 19:49:06.582760 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:49:06.582735    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf9235a_002e_492a_9d1a_9e4c27910aa0.slice/crio-1c6a7b58fe5859887d80c571a1049e0e16570670a22225c3319effaac840a8a8 WatchSource:0}: Error finding container 1c6a7b58fe5859887d80c571a1049e0e16570670a22225c3319effaac840a8a8: Status 404 returned error can't find the container with id 1c6a7b58fe5859887d80c571a1049e0e16570670a22225c3319effaac840a8a8
Sep 11 19:49:06.836661 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:06.836583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt" event={"ID":"dcf9235a-002e-492a-9d1a-9e4c27910aa0","Type":"ContainerStarted","Data":"1c6a7b58fe5859887d80c571a1049e0e16570670a22225c3319effaac840a8a8"}
Sep 11 19:49:07.843450 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:07.843415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt" event={"ID":"dcf9235a-002e-492a-9d1a-9e4c27910aa0","Type":"ContainerStarted","Data":"fd99079639380e8c291567de9798b9d36255fd137ec4297ff6d433555d659bbe"}
Sep 11 19:49:07.843837 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:07.843495    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:07.865714 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:07.865662    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt" podStartSLOduration=2.428218285 podStartE2EDuration="2.865644095s" totalImagesPullingTime="437.42581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:49:07.862534677 +0000 UTC m=+1182.096608115" watchObservedRunningTime="2026-09-11 19:49:07.865644095 +0000 UTC m=+1182.099717519"
Sep 11 19:49:13.856097 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:13.856066    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:26.584605 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:26.584519    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:49:26.585642 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:26.585620    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:49:43.908991 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:43.908958    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"]
Sep 11 19:49:43.909897 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:43.909860    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt" podUID="dcf9235a-002e-492a-9d1a-9e4c27910aa0" containerName="maas-api" containerID="cri-o://fd99079639380e8c291567de9798b9d36255fd137ec4297ff6d433555d659bbe" gracePeriod=30
Sep 11 19:49:44.062723 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.062008    2578 generic.go:356] "Generic (PLEG): container finished" podID="dcf9235a-002e-492a-9d1a-9e4c27910aa0" containerID="fd99079639380e8c291567de9798b9d36255fd137ec4297ff6d433555d659bbe" exitCode=0
Sep 11 19:49:44.062723 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.062205    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt" event={"ID":"dcf9235a-002e-492a-9d1a-9e4c27910aa0","Type":"ContainerDied","Data":"fd99079639380e8c291567de9798b9d36255fd137ec4297ff6d433555d659bbe"}
Sep 11 19:49:44.173845 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.173784    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:44.258296 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.258220    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfdh4\" (UniqueName: \"kubernetes.io/projected/dcf9235a-002e-492a-9d1a-9e4c27910aa0-kube-api-access-nfdh4\") pod \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") "
Sep 11 19:49:44.258598 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.258569    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-metrics-certs\") pod \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") "
Sep 11 19:49:44.258719 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.258678    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-maas-api-tls\") pod \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") "
Sep 11 19:49:44.258787 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.258718    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf9235a-002e-492a-9d1a-9e4c27910aa0-openshift-service-ca\") pod \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\" (UID: \"dcf9235a-002e-492a-9d1a-9e4c27910aa0\") "
Sep 11 19:49:44.259343 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.259316    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcf9235a-002e-492a-9d1a-9e4c27910aa0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dcf9235a-002e-492a-9d1a-9e4c27910aa0" (UID: "dcf9235a-002e-492a-9d1a-9e4c27910aa0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:49:44.262466 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.262427    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf9235a-002e-492a-9d1a-9e4c27910aa0-kube-api-access-nfdh4" (OuterVolumeSpecName: "kube-api-access-nfdh4") pod "dcf9235a-002e-492a-9d1a-9e4c27910aa0" (UID: "dcf9235a-002e-492a-9d1a-9e4c27910aa0"). InnerVolumeSpecName "kube-api-access-nfdh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:49:44.263907 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.263070    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dcf9235a-002e-492a-9d1a-9e4c27910aa0" (UID: "dcf9235a-002e-492a-9d1a-9e4c27910aa0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:49:44.265457 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.265196    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dcf9235a-002e-492a-9d1a-9e4c27910aa0" (UID: "dcf9235a-002e-492a-9d1a-9e4c27910aa0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:49:44.360562 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.360519    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:49:44.360562 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.360559    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf9235a-002e-492a-9d1a-9e4c27910aa0-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:49:44.360765 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.360570    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf9235a-002e-492a-9d1a-9e4c27910aa0-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:49:44.360765 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:44.360583    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfdh4\" (UniqueName: \"kubernetes.io/projected/dcf9235a-002e-492a-9d1a-9e4c27910aa0-kube-api-access-nfdh4\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:49:45.069993 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:45.069944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt" event={"ID":"dcf9235a-002e-492a-9d1a-9e4c27910aa0","Type":"ContainerDied","Data":"1c6a7b58fe5859887d80c571a1049e0e16570670a22225c3319effaac840a8a8"}
Sep 11 19:49:45.070537 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:45.070043    2578 scope.go:117] "RemoveContainer" containerID="fd99079639380e8c291567de9798b9d36255fd137ec4297ff6d433555d659bbe"
Sep 11 19:49:45.070537 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:45.070288    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"
Sep 11 19:49:45.100063 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:45.100033    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"]
Sep 11 19:49:45.103490 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:45.103464    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6008a04d-59567cdf94-p8jjt"]
Sep 11 19:49:46.258418 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:46.258384    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcf9235a-002e-492a-9d1a-9e4c27910aa0" path="/var/lib/kubelet/pods/dcf9235a-002e-492a-9d1a-9e4c27910aa0/volumes"
Sep 11 19:49:55.753437 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:55.753402    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"]
Sep 11 19:49:55.753896 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:55.753633    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n" podUID="080fb9cf-5115-4c79-88aa-0329ad97dbf4" containerName="maas-api" containerID="cri-o://949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada" gracePeriod=30
Sep 11 19:49:56.009937 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.009877    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:49:56.077916 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.077881    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-maas-api-tls\") pod \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") "
Sep 11 19:49:56.078119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.077940    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z74v9\" (UniqueName: \"kubernetes.io/projected/080fb9cf-5115-4c79-88aa-0329ad97dbf4-kube-api-access-z74v9\") pod \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") "
Sep 11 19:49:56.078119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.078035    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/080fb9cf-5115-4c79-88aa-0329ad97dbf4-openshift-service-ca\") pod \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") "
Sep 11 19:49:56.078119 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.078075    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-metrics-certs\") pod \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\" (UID: \"080fb9cf-5115-4c79-88aa-0329ad97dbf4\") "
Sep 11 19:49:56.078505 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.078472    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/080fb9cf-5115-4c79-88aa-0329ad97dbf4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "080fb9cf-5115-4c79-88aa-0329ad97dbf4" (UID: "080fb9cf-5115-4c79-88aa-0329ad97dbf4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:49:56.080830 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.080798    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "080fb9cf-5115-4c79-88aa-0329ad97dbf4" (UID: "080fb9cf-5115-4c79-88aa-0329ad97dbf4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:49:56.081330 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.081305    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "080fb9cf-5115-4c79-88aa-0329ad97dbf4" (UID: "080fb9cf-5115-4c79-88aa-0329ad97dbf4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:49:56.081420 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.081336    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/080fb9cf-5115-4c79-88aa-0329ad97dbf4-kube-api-access-z74v9" (OuterVolumeSpecName: "kube-api-access-z74v9") pod "080fb9cf-5115-4c79-88aa-0329ad97dbf4" (UID: "080fb9cf-5115-4c79-88aa-0329ad97dbf4"). InnerVolumeSpecName "kube-api-access-z74v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:49:56.141376 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.141329    2578 generic.go:356] "Generic (PLEG): container finished" podID="080fb9cf-5115-4c79-88aa-0329ad97dbf4" containerID="949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada" exitCode=0
Sep 11 19:49:56.141555 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.141412    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"
Sep 11 19:49:56.141555 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.141454    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n" event={"ID":"080fb9cf-5115-4c79-88aa-0329ad97dbf4","Type":"ContainerDied","Data":"949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada"}
Sep 11 19:49:56.141555 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.141533    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n" event={"ID":"080fb9cf-5115-4c79-88aa-0329ad97dbf4","Type":"ContainerDied","Data":"d686971737cfba58e7c716cded2d108de98619f7725875e132cc524af0e571fd"}
Sep 11 19:49:56.141718 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.141563    2578 scope.go:117] "RemoveContainer" containerID="949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada"
Sep 11 19:49:56.155036 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.155016    2578 scope.go:117] "RemoveContainer" containerID="949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada"
Sep 11 19:49:56.155387 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:49:56.155363    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada\": container with ID starting with 949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada not found: ID does not exist" containerID="949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada"
Sep 11 19:49:56.155506 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.155395    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada"} err="failed to get container status \"949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada\": rpc error: code = NotFound desc = could not find container \"949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada\": container with ID starting with 949b05cd558f7fc2042a09e88b06c59a04509d00ac432e3e5b36eda905dbcada not found: ID does not exist"
Sep 11 19:49:56.166216 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.166191    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"]
Sep 11 19:49:56.169711 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.169688    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-7df2ac-66b7fbcb4-bmz9n"]
Sep 11 19:49:56.180123 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.180102    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:49:56.180225 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.180128    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z74v9\" (UniqueName: \"kubernetes.io/projected/080fb9cf-5115-4c79-88aa-0329ad97dbf4-kube-api-access-z74v9\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:49:56.180225 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.180144    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/080fb9cf-5115-4c79-88aa-0329ad97dbf4-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:49:56.180225 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.180158    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080fb9cf-5115-4c79-88aa-0329ad97dbf4-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:49:56.258891 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:49:56.258858    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="080fb9cf-5115-4c79-88aa-0329ad97dbf4" path="/var/lib/kubelet/pods/080fb9cf-5115-4c79-88aa-0329ad97dbf4/volumes"
Sep 11 19:50:56.567373 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.567342    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"]
Sep 11 19:50:56.568122 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.568104    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf9235a-002e-492a-9d1a-9e4c27910aa0" containerName="maas-api"
Sep 11 19:50:56.568175 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.568127    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf9235a-002e-492a-9d1a-9e4c27910aa0" containerName="maas-api"
Sep 11 19:50:56.568175 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.568144    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="080fb9cf-5115-4c79-88aa-0329ad97dbf4" containerName="maas-api"
Sep 11 19:50:56.568175 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.568153    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="080fb9cf-5115-4c79-88aa-0329ad97dbf4" containerName="maas-api"
Sep 11 19:50:56.568327 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.568315    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf9235a-002e-492a-9d1a-9e4c27910aa0" containerName="maas-api"
Sep 11 19:50:56.568411 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.568331    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="080fb9cf-5115-4c79-88aa-0329ad97dbf4" containerName="maas-api"
Sep 11 19:50:56.571776 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.571758    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.574600 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.574580    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-f76076-serving-cert\""
Sep 11 19:50:56.581820 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.581781    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"]
Sep 11 19:50:56.686738 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.686708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7jmz\" (UniqueName: \"kubernetes.io/projected/866c02f5-6b5f-468b-a31f-a82867b0afd1-kube-api-access-j7jmz\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.686942 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.686759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-maas-api-tls\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.686942 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.686864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866c02f5-6b5f-468b-a31f-a82867b0afd1-openshift-service-ca\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.687070 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.686985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-metrics-certs\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.787988 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.787957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7jmz\" (UniqueName: \"kubernetes.io/projected/866c02f5-6b5f-468b-a31f-a82867b0afd1-kube-api-access-j7jmz\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.787988 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.788002    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-maas-api-tls\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.788227 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.788124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866c02f5-6b5f-468b-a31f-a82867b0afd1-openshift-service-ca\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.788227 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.788224    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-metrics-certs\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.788928 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.788901    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866c02f5-6b5f-468b-a31f-a82867b0afd1-openshift-service-ca\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.791668 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.791642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-metrics-certs\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.791826 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.791807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-maas-api-tls\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.796707 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.796687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7jmz\" (UniqueName: \"kubernetes.io/projected/866c02f5-6b5f-468b-a31f-a82867b0afd1-kube-api-access-j7jmz\") pod \"maas-api-e2e-explicit-f76076-788df8bbbd-q2djm\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:56.886723 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:56.886649    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:57.170776 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:57.170750    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"]
Sep 11 19:50:57.172375 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:50:57.172354    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866c02f5_6b5f_468b_a31f_a82867b0afd1.slice/crio-4c45728d1fdd9dcf0d16375db302b1e3db3ef4d08d3719ba76ebdc9cadcffab7 WatchSource:0}: Error finding container 4c45728d1fdd9dcf0d16375db302b1e3db3ef4d08d3719ba76ebdc9cadcffab7: Status 404 returned error can't find the container with id 4c45728d1fdd9dcf0d16375db302b1e3db3ef4d08d3719ba76ebdc9cadcffab7
Sep 11 19:50:57.508348 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:57.508252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm" event={"ID":"866c02f5-6b5f-468b-a31f-a82867b0afd1","Type":"ContainerStarted","Data":"4c45728d1fdd9dcf0d16375db302b1e3db3ef4d08d3719ba76ebdc9cadcffab7"}
Sep 11 19:50:58.515981 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:58.515930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm" event={"ID":"866c02f5-6b5f-468b-a31f-a82867b0afd1","Type":"ContainerStarted","Data":"371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832"}
Sep 11 19:50:58.516699 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:58.516026    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:50:58.537916 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:50:58.537864    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm" podStartSLOduration=2.173752402 podStartE2EDuration="2.537849017s" totalImagesPullingTime="364.096615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:50:58.534621081 +0000 UTC m=+1292.768694536" watchObservedRunningTime="2026-09-11 19:50:58.537849017 +0000 UTC m=+1292.771922438"
Sep 11 19:51:04.527583 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:04.527552    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:51:40.949605 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:40.949570    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"]
Sep 11 19:51:40.955077 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:40.955058    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:40.957746 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:40.957728    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-81969518-serving-cert\""
Sep 11 19:51:40.962217 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:40.962191    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"]
Sep 11 19:51:41.043284 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.043218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a62b6cf-0f57-42ce-82d2-6703b6f10863-openshift-service-ca\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.043284 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.043278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-maas-api-tls\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.043500 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.043385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz62z\" (UniqueName: \"kubernetes.io/projected/6a62b6cf-0f57-42ce-82d2-6703b6f10863-kube-api-access-sz62z\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.043500 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.043444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-metrics-certs\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.144895 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.144860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a62b6cf-0f57-42ce-82d2-6703b6f10863-openshift-service-ca\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.145053 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.144899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-maas-api-tls\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.145053 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.144986    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz62z\" (UniqueName: \"kubernetes.io/projected/6a62b6cf-0f57-42ce-82d2-6703b6f10863-kube-api-access-sz62z\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.145053 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.145046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-metrics-certs\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.145163 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:51:41.145072    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-81969518-serving-cert: secret "maas-api-e2e-mt-81969518-serving-cert" not found
Sep 11 19:51:41.145163 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:51:41.145136    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-maas-api-tls podName:6a62b6cf-0f57-42ce-82d2-6703b6f10863 nodeName:}" failed. No retries permitted until 2026-09-11 19:51:41.645118717 +0000 UTC m=+1335.879192119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-maas-api-tls") pod "maas-api-e2e-mt-81969518-5468cd96-79sbz" (UID: "6a62b6cf-0f57-42ce-82d2-6703b6f10863") : secret "maas-api-e2e-mt-81969518-serving-cert" not found
Sep 11 19:51:41.145747 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.145718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a62b6cf-0f57-42ce-82d2-6703b6f10863-openshift-service-ca\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.147897 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.147872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-metrics-certs\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.155248 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.155223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz62z\" (UniqueName: \"kubernetes.io/projected/6a62b6cf-0f57-42ce-82d2-6703b6f10863-kube-api-access-sz62z\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.650474 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.650443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-maas-api-tls\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.653393 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.653368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-maas-api-tls\") pod \"maas-api-e2e-mt-81969518-5468cd96-79sbz\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:41.866744 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:41.866716    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:42.147135 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:42.147109    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"]
Sep 11 19:51:42.148642 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:51:42.148609    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a62b6cf_0f57_42ce_82d2_6703b6f10863.slice/crio-c89d37facdcd51dcecb4db8ac2e6104c85017242e4ba20df28373006b610ebd3 WatchSource:0}: Error finding container c89d37facdcd51dcecb4db8ac2e6104c85017242e4ba20df28373006b610ebd3: Status 404 returned error can't find the container with id c89d37facdcd51dcecb4db8ac2e6104c85017242e4ba20df28373006b610ebd3
Sep 11 19:51:42.150029 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:42.150008    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:51:42.769425 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:42.769393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz" event={"ID":"6a62b6cf-0f57-42ce-82d2-6703b6f10863","Type":"ContainerStarted","Data":"576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f"}
Sep 11 19:51:42.769589 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:42.769440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz" event={"ID":"6a62b6cf-0f57-42ce-82d2-6703b6f10863","Type":"ContainerStarted","Data":"c89d37facdcd51dcecb4db8ac2e6104c85017242e4ba20df28373006b610ebd3"}
Sep 11 19:51:42.769589 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:42.769479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:51:42.791126 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:42.791070    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz" podStartSLOduration=2.388138996 podStartE2EDuration="2.791049435s" totalImagesPullingTime="402.910439ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:51:42.789143622 +0000 UTC m=+1337.023217044" watchObservedRunningTime="2026-09-11 19:51:42.791049435 +0000 UTC m=+1337.025122857"
Sep 11 19:51:48.780668 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:51:48.780600    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:52:25.399713 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.399675    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"]
Sep 11 19:52:25.400381 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.399932    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz" podUID="6a62b6cf-0f57-42ce-82d2-6703b6f10863" containerName="maas-api" containerID="cri-o://576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f" gracePeriod=30
Sep 11 19:52:25.667329 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.667251    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:52:25.814736 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.814702    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-metrics-certs\") pod \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") "
Sep 11 19:52:25.814909 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.814839    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-maas-api-tls\") pod \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") "
Sep 11 19:52:25.814909 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.814867    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a62b6cf-0f57-42ce-82d2-6703b6f10863-openshift-service-ca\") pod \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") "
Sep 11 19:52:25.815003 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.814910    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz62z\" (UniqueName: \"kubernetes.io/projected/6a62b6cf-0f57-42ce-82d2-6703b6f10863-kube-api-access-sz62z\") pod \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\" (UID: \"6a62b6cf-0f57-42ce-82d2-6703b6f10863\") "
Sep 11 19:52:25.815275 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.815239    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a62b6cf-0f57-42ce-82d2-6703b6f10863-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6a62b6cf-0f57-42ce-82d2-6703b6f10863" (UID: "6a62b6cf-0f57-42ce-82d2-6703b6f10863"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:52:25.816913 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.816885    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6a62b6cf-0f57-42ce-82d2-6703b6f10863" (UID: "6a62b6cf-0f57-42ce-82d2-6703b6f10863"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:52:25.817103 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.817078    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a62b6cf-0f57-42ce-82d2-6703b6f10863-kube-api-access-sz62z" (OuterVolumeSpecName: "kube-api-access-sz62z") pod "6a62b6cf-0f57-42ce-82d2-6703b6f10863" (UID: "6a62b6cf-0f57-42ce-82d2-6703b6f10863"). InnerVolumeSpecName "kube-api-access-sz62z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:52:25.817157 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.817123    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6a62b6cf-0f57-42ce-82d2-6703b6f10863" (UID: "6a62b6cf-0f57-42ce-82d2-6703b6f10863"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:52:25.916009 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.915975    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz62z\" (UniqueName: \"kubernetes.io/projected/6a62b6cf-0f57-42ce-82d2-6703b6f10863-kube-api-access-sz62z\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:52:25.916009 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.916007    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:52:25.916211 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.916019    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a62b6cf-0f57-42ce-82d2-6703b6f10863-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:52:25.916211 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:25.916031    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a62b6cf-0f57-42ce-82d2-6703b6f10863-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:52:26.024516 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:26.024427    2578 generic.go:356] "Generic (PLEG): container finished" podID="6a62b6cf-0f57-42ce-82d2-6703b6f10863" containerID="576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f" exitCode=0
Sep 11 19:52:26.024516 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:26.024485    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"
Sep 11 19:52:26.024742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:26.024514    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz" event={"ID":"6a62b6cf-0f57-42ce-82d2-6703b6f10863","Type":"ContainerDied","Data":"576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f"}
Sep 11 19:52:26.024742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:26.024570    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz" event={"ID":"6a62b6cf-0f57-42ce-82d2-6703b6f10863","Type":"ContainerDied","Data":"c89d37facdcd51dcecb4db8ac2e6104c85017242e4ba20df28373006b610ebd3"}
Sep 11 19:52:26.024742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:26.024592    2578 scope.go:117] "RemoveContainer" containerID="576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f"
Sep 11 19:52:26.035630 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:26.035612    2578 scope.go:117] "RemoveContainer" containerID="576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f"
Sep 11 19:52:26.035956 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:52:26.035935    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f\": container with ID starting with 576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f not found: ID does not exist" containerID="576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f"
Sep 11 19:52:26.036040 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:26.035964    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f"} err="failed to get container status \"576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f\": rpc error: code = NotFound desc = could not find container \"576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f\": container with ID starting with 576e93c3be32502d576efb1e633b26601bdccb8a1520720f7944a8ac1d934b4f not found: ID does not exist"
Sep 11 19:52:26.046949 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:26.046918    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"]
Sep 11 19:52:26.052353 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:26.052327    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-81969518-5468cd96-79sbz"]
Sep 11 19:52:26.258535 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:26.258507    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a62b6cf-0f57-42ce-82d2-6703b6f10863" path="/var/lib/kubelet/pods/6a62b6cf-0f57-42ce-82d2-6703b6f10863/volumes"
Sep 11 19:52:52.546820 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.546786    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"]
Sep 11 19:52:52.549168 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.547759    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a62b6cf-0f57-42ce-82d2-6703b6f10863" containerName="maas-api"
Sep 11 19:52:52.549168 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.547775    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a62b6cf-0f57-42ce-82d2-6703b6f10863" containerName="maas-api"
Sep 11 19:52:52.549168 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.547881    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a62b6cf-0f57-42ce-82d2-6703b6f10863" containerName="maas-api"
Sep 11 19:52:52.551187 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.551165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:52.553960 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.553941    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-e8cfcf-serving-cert\""
Sep 11 19:52:52.560821 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.560795    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"]
Sep 11 19:52:52.694164 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.694125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:52.694368 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.694180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdgkz\" (UniqueName: \"kubernetes.io/projected/3814bba3-2869-4672-b099-a25e90d2d1fb-kube-api-access-mdgkz\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:52.694368 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.694337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:52.694498 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.694390    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3814bba3-2869-4672-b099-a25e90d2d1fb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:52.795558 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.795521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:52.795729 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.795572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdgkz\" (UniqueName: \"kubernetes.io/projected/3814bba3-2869-4672-b099-a25e90d2d1fb-kube-api-access-mdgkz\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:52.795729 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.795669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:52.795729 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.795720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3814bba3-2869-4672-b099-a25e90d2d1fb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:52.795896 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:52:52.795840    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-serving-cert: secret "maas-api-e2e-shared-a-w2-e8cfcf-serving-cert" not found
Sep 11 19:52:52.795952 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:52:52.795937    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-maas-api-tls podName:3814bba3-2869-4672-b099-a25e90d2d1fb nodeName:}" failed. No retries permitted until 2026-09-11 19:52:53.295901409 +0000 UTC m=+1407.529974811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-maas-api-tls") pod "maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz" (UID: "3814bba3-2869-4672-b099-a25e90d2d1fb") : secret "maas-api-e2e-shared-a-w2-e8cfcf-serving-cert" not found
Sep 11 19:52:52.796505 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.796427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3814bba3-2869-4672-b099-a25e90d2d1fb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:52.798396 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.798343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:52.804927 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:52.804906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdgkz\" (UniqueName: \"kubernetes.io/projected/3814bba3-2869-4672-b099-a25e90d2d1fb-kube-api-access-mdgkz\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:53.302343 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:53.302306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:53.304954 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:53.304929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:53.466598 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:53.466563    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:53.745170 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:53.745147    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"]
Sep 11 19:52:53.746928 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:52:53.746897    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3814bba3_2869_4672_b099_a25e90d2d1fb.slice/crio-54bf0ff060bd86eaecc769ac26bae26b3046c22893f377204d62fc24db586eb6 WatchSource:0}: Error finding container 54bf0ff060bd86eaecc769ac26bae26b3046c22893f377204d62fc24db586eb6: Status 404 returned error can't find the container with id 54bf0ff060bd86eaecc769ac26bae26b3046c22893f377204d62fc24db586eb6
Sep 11 19:52:54.186966 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:54.186929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz" event={"ID":"3814bba3-2869-4672-b099-a25e90d2d1fb","Type":"ContainerStarted","Data":"dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef"}
Sep 11 19:52:54.187146 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:54.186985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz" event={"ID":"3814bba3-2869-4672-b099-a25e90d2d1fb","Type":"ContainerStarted","Data":"54bf0ff060bd86eaecc769ac26bae26b3046c22893f377204d62fc24db586eb6"}
Sep 11 19:52:54.187146 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:54.187053    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:52:54.205184 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:54.205130    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz" podStartSLOduration=1.871968473 podStartE2EDuration="2.205116362s" totalImagesPullingTime="333.147889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:52:54.203339225 +0000 UTC m=+1408.437412650" watchObservedRunningTime="2026-09-11 19:52:54.205116362 +0000 UTC m=+1408.439189810"
Sep 11 19:52:57.530050 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.530019    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"]
Sep 11 19:52:57.541994 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.541965    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.542521 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.542497    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"]
Sep 11 19:52:57.545113 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.545093    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-4b032e\"/\"default-dockercfg-t8xhs\""
Sep 11 19:52:57.546042 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.546022    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-4b032e\"/\"distinct-w0-4b032e-kserve-self-signed-certs\""
Sep 11 19:52:57.546371 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.546352    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-4b032e\"/\"kube-root-ca.crt\""
Sep 11 19:52:57.546371 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.546345    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-4b032e\"/\"openshift-service-ca.crt\""
Sep 11 19:52:57.649455 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.649417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-tmp-dir\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.649638 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.649462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-home\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.649638 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.649603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc876\" (UniqueName: \"kubernetes.io/projected/a655538b-e97a-4f48-bff2-ab99032b03f4-kube-api-access-wc876\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.649742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.649674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-model-cache\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.649742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.649708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a655538b-e97a-4f48-bff2-ab99032b03f4-tls-certs\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.649742 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.649727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-dshm\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.750880 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.750848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-model-cache\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.751099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.750888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a655538b-e97a-4f48-bff2-ab99032b03f4-tls-certs\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.751099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.750920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-dshm\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.751099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.750963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-tmp-dir\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.751099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.750985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-home\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.751099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.751085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc876\" (UniqueName: \"kubernetes.io/projected/a655538b-e97a-4f48-bff2-ab99032b03f4-kube-api-access-wc876\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.751439 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.751364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-model-cache\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.751500 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.751447    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-tmp-dir\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.751589 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.751571    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-home\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.753455 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.753428    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-dshm\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.753675 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.753658    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a655538b-e97a-4f48-bff2-ab99032b03f4-tls-certs\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.759444 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.759424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc876\" (UniqueName: \"kubernetes.io/projected/a655538b-e97a-4f48-bff2-ab99032b03f4-kube-api-access-wc876\") pod \"distinct-w0-4b032e-kserve-6775587c-hv76l\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") " pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:57.851993 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:57.851967    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:52:58.130877 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:58.130849    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"]
Sep 11 19:52:58.132902 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:52:58.132872    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda655538b_e97a_4f48_bff2_ab99032b03f4.slice/crio-e9808ca0adacb35ba2958841c16897ddfe16f4fcc472d1c2570b188d7620bf35 WatchSource:0}: Error finding container e9808ca0adacb35ba2958841c16897ddfe16f4fcc472d1c2570b188d7620bf35: Status 404 returned error can't find the container with id e9808ca0adacb35ba2958841c16897ddfe16f4fcc472d1c2570b188d7620bf35
Sep 11 19:52:58.215708 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:58.215666    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l" event={"ID":"a655538b-e97a-4f48-bff2-ab99032b03f4","Type":"ContainerStarted","Data":"b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0"}
Sep 11 19:52:58.215890 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:58.215723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l" event={"ID":"a655538b-e97a-4f48-bff2-ab99032b03f4","Type":"ContainerStarted","Data":"e9808ca0adacb35ba2958841c16897ddfe16f4fcc472d1c2570b188d7620bf35"}
Sep 11 19:52:58.232953 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:52:58.232908    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l" podStartSLOduration=1.232892449 podStartE2EDuration="1.232892449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:52:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:52:58.231556942 +0000 UTC m=+1412.465630358" watchObservedRunningTime="2026-09-11 19:52:58.232892449 +0000 UTC m=+1412.466965869"
Sep 11 19:53:00.200357 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:00.200330    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 19:53:07.852108 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:07.852070    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:53:07.852544 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:07.852131    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:53:07.865091 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:07.865071    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:53:08.284412 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:08.284336    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 19:53:27.186869 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.186785    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"]
Sep 11 19:53:27.191762 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.191737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.195369 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.195340    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-f7fd24-serving-cert\""
Sep 11 19:53:27.203919 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.203894    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"]
Sep 11 19:53:27.262430 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.262392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvrrb\" (UniqueName: \"kubernetes.io/projected/0e693e03-b69b-43db-ba21-651eb5bab081-kube-api-access-bvrrb\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.262609 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.262442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.262609 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.262505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.262609 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.262598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e693e03-b69b-43db-ba21-651eb5bab081-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.364221 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.364179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.364447 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.364276    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.364447 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.364355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e693e03-b69b-43db-ba21-651eb5bab081-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.364627 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.364496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvrrb\" (UniqueName: \"kubernetes.io/projected/0e693e03-b69b-43db-ba21-651eb5bab081-kube-api-access-bvrrb\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.365371 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.365339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e693e03-b69b-43db-ba21-651eb5bab081-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.367057 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.367038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.367196 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.367172    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.372935 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.372908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvrrb\" (UniqueName: \"kubernetes.io/projected/0e693e03-b69b-43db-ba21-651eb5bab081-kube-api-access-bvrrb\") pod \"maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.506857 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.506619    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:27.784796 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:27.784764    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"]
Sep 11 19:53:27.786849 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:53:27.786816    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e693e03_b69b_43db_ba21_651eb5bab081.slice/crio-6993c25e8415d24dd3052e874ba887a0f95462046b1fd82be5a08240a7708f20 WatchSource:0}: Error finding container 6993c25e8415d24dd3052e874ba887a0f95462046b1fd82be5a08240a7708f20: Status 404 returned error can't find the container with id 6993c25e8415d24dd3052e874ba887a0f95462046b1fd82be5a08240a7708f20
Sep 11 19:53:28.393525 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:28.393427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65" event={"ID":"0e693e03-b69b-43db-ba21-651eb5bab081","Type":"ContainerStarted","Data":"36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd"}
Sep 11 19:53:28.393525 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:28.393484    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65" event={"ID":"0e693e03-b69b-43db-ba21-651eb5bab081","Type":"ContainerStarted","Data":"6993c25e8415d24dd3052e874ba887a0f95462046b1fd82be5a08240a7708f20"}
Sep 11 19:53:28.394100 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:28.393616    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:28.410015 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:28.409967    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65" podStartSLOduration=1.118105556 podStartE2EDuration="1.409952328s" totalImagesPullingTime="291.846772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:53:28.408675909 +0000 UTC m=+1442.642749330" watchObservedRunningTime="2026-09-11 19:53:28.409952328 +0000 UTC m=+1442.644025749"
Sep 11 19:53:29.343429 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.343385    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"]
Sep 11 19:53:29.343735 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.343629    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm" podUID="866c02f5-6b5f-468b-a31f-a82867b0afd1" containerName="maas-api" containerID="cri-o://371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832" gracePeriod=30
Sep 11 19:53:29.523528 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.523440    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm" podUID="866c02f5-6b5f-468b-a31f-a82867b0afd1" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.67:8443/health\": dial tcp 10.133.0.67:8443: connect: connection refused"
Sep 11 19:53:29.634403 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.634377    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:53:29.698007 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.697961    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-metrics-certs\") pod \"866c02f5-6b5f-468b-a31f-a82867b0afd1\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") "
Sep 11 19:53:29.698208 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.698030    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866c02f5-6b5f-468b-a31f-a82867b0afd1-openshift-service-ca\") pod \"866c02f5-6b5f-468b-a31f-a82867b0afd1\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") "
Sep 11 19:53:29.698208 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.698063    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-maas-api-tls\") pod \"866c02f5-6b5f-468b-a31f-a82867b0afd1\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") "
Sep 11 19:53:29.698389 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.698248    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7jmz\" (UniqueName: \"kubernetes.io/projected/866c02f5-6b5f-468b-a31f-a82867b0afd1-kube-api-access-j7jmz\") pod \"866c02f5-6b5f-468b-a31f-a82867b0afd1\" (UID: \"866c02f5-6b5f-468b-a31f-a82867b0afd1\") "
Sep 11 19:53:29.698777 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.698682    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/866c02f5-6b5f-468b-a31f-a82867b0afd1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "866c02f5-6b5f-468b-a31f-a82867b0afd1" (UID: "866c02f5-6b5f-468b-a31f-a82867b0afd1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:53:29.701327 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.701295    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "866c02f5-6b5f-468b-a31f-a82867b0afd1" (UID: "866c02f5-6b5f-468b-a31f-a82867b0afd1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:53:29.701543 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.701521    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "866c02f5-6b5f-468b-a31f-a82867b0afd1" (UID: "866c02f5-6b5f-468b-a31f-a82867b0afd1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:53:29.701630 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.701613    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/866c02f5-6b5f-468b-a31f-a82867b0afd1-kube-api-access-j7jmz" (OuterVolumeSpecName: "kube-api-access-j7jmz") pod "866c02f5-6b5f-468b-a31f-a82867b0afd1" (UID: "866c02f5-6b5f-468b-a31f-a82867b0afd1"). InnerVolumeSpecName "kube-api-access-j7jmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:53:29.799608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.799575    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7jmz\" (UniqueName: \"kubernetes.io/projected/866c02f5-6b5f-468b-a31f-a82867b0afd1-kube-api-access-j7jmz\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:29.799608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.799606    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:29.799608 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.799616    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866c02f5-6b5f-468b-a31f-a82867b0afd1-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:29.799853 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:29.799624    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866c02f5-6b5f-468b-a31f-a82867b0afd1-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:30.409576 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:30.409540    2578 generic.go:356] "Generic (PLEG): container finished" podID="866c02f5-6b5f-468b-a31f-a82867b0afd1" containerID="371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832" exitCode=0
Sep 11 19:53:30.409576 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:30.409580    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"
Sep 11 19:53:30.409811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:30.409617    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm" event={"ID":"866c02f5-6b5f-468b-a31f-a82867b0afd1","Type":"ContainerDied","Data":"371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832"}
Sep 11 19:53:30.409811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:30.409667    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm" event={"ID":"866c02f5-6b5f-468b-a31f-a82867b0afd1","Type":"ContainerDied","Data":"4c45728d1fdd9dcf0d16375db302b1e3db3ef4d08d3719ba76ebdc9cadcffab7"}
Sep 11 19:53:30.409811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:30.409698    2578 scope.go:117] "RemoveContainer" containerID="371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832"
Sep 11 19:53:30.419607 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:30.419589    2578 scope.go:117] "RemoveContainer" containerID="371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832"
Sep 11 19:53:30.419919 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:53:30.419892    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832\": container with ID starting with 371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832 not found: ID does not exist" containerID="371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832"
Sep 11 19:53:30.419968 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:30.419930    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832"} err="failed to get container status \"371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832\": rpc error: code = NotFound desc = could not find container \"371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832\": container with ID starting with 371e604023b0203d31b87f317ed4337d252027e20867d0e593e06f9872fcb832 not found: ID does not exist"
Sep 11 19:53:30.429602 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:30.429579    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"]
Sep 11 19:53:30.437415 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:30.437391    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f76076-788df8bbbd-q2djm"]
Sep 11 19:53:32.258805 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:32.258770    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="866c02f5-6b5f-468b-a31f-a82867b0afd1" path="/var/lib/kubelet/pods/866c02f5-6b5f-468b-a31f-a82867b0afd1/volumes"
Sep 11 19:53:34.407937 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:34.407906    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 19:53:42.069226 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.069187    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-3d6e9d"]
Sep 11 19:53:42.069770 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.069755    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866c02f5-6b5f-468b-a31f-a82867b0afd1" containerName="maas-api"
Sep 11 19:53:42.069819 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.069772    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="866c02f5-6b5f-468b-a31f-a82867b0afd1" containerName="maas-api"
Sep 11 19:53:42.069885 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.069876    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="866c02f5-6b5f-468b-a31f-a82867b0afd1" containerName="maas-api"
Sep 11 19:53:42.074950 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.074909    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-3d6e9d"
Sep 11 19:53:42.077136 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.077115    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-3d6e9d"]
Sep 11 19:53:42.077752 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.077733    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-76rlb\""
Sep 11 19:53:42.138324 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.138292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mpb8\" (UniqueName: \"kubernetes.io/projected/8a54075e-8d83-44fb-8b34-bd5f59433f8d-kube-api-access-7mpb8\") pod \"test-curl-7497-3d6e9d\" (UID: \"8a54075e-8d83-44fb-8b34-bd5f59433f8d\") " pod="opendatahub/test-curl-7497-3d6e9d"
Sep 11 19:53:42.239110 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.239070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mpb8\" (UniqueName: \"kubernetes.io/projected/8a54075e-8d83-44fb-8b34-bd5f59433f8d-kube-api-access-7mpb8\") pod \"test-curl-7497-3d6e9d\" (UID: \"8a54075e-8d83-44fb-8b34-bd5f59433f8d\") " pod="opendatahub/test-curl-7497-3d6e9d"
Sep 11 19:53:42.247084 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.247062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mpb8\" (UniqueName: \"kubernetes.io/projected/8a54075e-8d83-44fb-8b34-bd5f59433f8d-kube-api-access-7mpb8\") pod \"test-curl-7497-3d6e9d\" (UID: \"8a54075e-8d83-44fb-8b34-bd5f59433f8d\") " pod="opendatahub/test-curl-7497-3d6e9d"
Sep 11 19:53:42.385764 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.385683    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-3d6e9d"
Sep 11 19:53:42.666515 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:42.666494    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-3d6e9d"]
Sep 11 19:53:42.668493 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:53:42.668467    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a54075e_8d83_44fb_8b34_bd5f59433f8d.slice/crio-327034356d85d992475d7fb8ca5fee3396e82b0c9cfefa6743474ac5aa700327 WatchSource:0}: Error finding container 327034356d85d992475d7fb8ca5fee3396e82b0c9cfefa6743474ac5aa700327: Status 404 returned error can't find the container with id 327034356d85d992475d7fb8ca5fee3396e82b0c9cfefa6743474ac5aa700327
Sep 11 19:53:43.491429 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:43.491235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-3d6e9d" event={"ID":"8a54075e-8d83-44fb-8b34-bd5f59433f8d","Type":"ContainerStarted","Data":"327034356d85d992475d7fb8ca5fee3396e82b0c9cfefa6743474ac5aa700327"}
Sep 11 19:53:45.506640 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:45.506607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-3d6e9d" event={"ID":"8a54075e-8d83-44fb-8b34-bd5f59433f8d","Type":"ContainerStarted","Data":"26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53"}
Sep 11 19:53:45.522709 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:45.522659    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7497-3d6e9d" podStartSLOduration=1.592534338 podStartE2EDuration="3.522644032s" totalImagesPullingTime="1.930109694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:53:45.520932933 +0000 UTC m=+1459.755006355" watchObservedRunningTime="2026-09-11 19:53:45.522644032 +0000 UTC m=+1459.756717452"
Sep 11 19:53:46.090403 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.090366    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-3d6e9d"]
Sep 11 19:53:46.094728 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.094699    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-3d6e9d"]
Sep 11 19:53:46.204140 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.204056    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-cde61a"]
Sep 11 19:53:46.204645 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.204626    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a54075e-8d83-44fb-8b34-bd5f59433f8d" containerName="test-curl-7497-3d6e9d"
Sep 11 19:53:46.204698 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.204651    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a54075e-8d83-44fb-8b34-bd5f59433f8d" containerName="test-curl-7497-3d6e9d"
Sep 11 19:53:46.204753 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.204743    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a54075e-8d83-44fb-8b34-bd5f59433f8d" containerName="test-curl-7497-3d6e9d"
Sep 11 19:53:46.208167 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.208153    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-cde61a"
Sep 11 19:53:46.213142 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.213117    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-cde61a"]
Sep 11 19:53:46.284851 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.284813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpk4w\" (UniqueName: \"kubernetes.io/projected/36709478-66c0-4190-be42-f44ae978225b-kube-api-access-xpk4w\") pod \"test-curl-7497-cde61a\" (UID: \"36709478-66c0-4190-be42-f44ae978225b\") " pod="opendatahub/test-curl-7497-cde61a"
Sep 11 19:53:46.385510 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.385475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpk4w\" (UniqueName: \"kubernetes.io/projected/36709478-66c0-4190-be42-f44ae978225b-kube-api-access-xpk4w\") pod \"test-curl-7497-cde61a\" (UID: \"36709478-66c0-4190-be42-f44ae978225b\") " pod="opendatahub/test-curl-7497-cde61a"
Sep 11 19:53:46.393975 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.393942    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpk4w\" (UniqueName: \"kubernetes.io/projected/36709478-66c0-4190-be42-f44ae978225b-kube-api-access-xpk4w\") pod \"test-curl-7497-cde61a\" (UID: \"36709478-66c0-4190-be42-f44ae978225b\") " pod="opendatahub/test-curl-7497-cde61a"
Sep 11 19:53:46.512391 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:53:46.512310    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7497-3d6e9d" container="test-curl-7497-3d6e9d"
Sep 11 19:53:46.520115 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.520085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-cde61a"
Sep 11 19:53:46.801129 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:53:46.801098    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36709478_66c0_4190_be42_f44ae978225b.slice/crio-35732e918091d78a2f02e5f4ec4e8c7597889a0d4b2d7f586ef06d3c714c8abb WatchSource:0}: Error finding container 35732e918091d78a2f02e5f4ec4e8c7597889a0d4b2d7f586ef06d3c714c8abb: Status 404 returned error can't find the container with id 35732e918091d78a2f02e5f4ec4e8c7597889a0d4b2d7f586ef06d3c714c8abb
Sep 11 19:53:46.806727 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:46.806702    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-cde61a"]
Sep 11 19:53:47.519182 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:47.519146    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-cde61a" event={"ID":"36709478-66c0-4190-be42-f44ae978225b","Type":"ContainerStarted","Data":"6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9"}
Sep 11 19:53:47.519649 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:47.519192    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-cde61a" event={"ID":"36709478-66c0-4190-be42-f44ae978225b","Type":"ContainerStarted","Data":"35732e918091d78a2f02e5f4ec4e8c7597889a0d4b2d7f586ef06d3c714c8abb"}
Sep 11 19:53:47.519649 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:47.519217    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7497-3d6e9d" podUID="8a54075e-8d83-44fb-8b34-bd5f59433f8d" containerName="test-curl-7497-3d6e9d" containerID="cri-o://26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53" gracePeriod=2
Sep 11 19:53:47.534772 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:47.534730    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7497-cde61a" podStartSLOduration=1.534715085 podStartE2EDuration="1.534715085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:53:47.533158486 +0000 UTC m=+1461.767231901" watchObservedRunningTime="2026-09-11 19:53:47.534715085 +0000 UTC m=+1461.768788506"
Sep 11 19:53:48.099626 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:48.099553    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-cde61a"]
Sep 11 19:53:48.113902 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:48.113867    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-cde61a"]
Sep 11 19:53:48.525241 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:53:48.525203    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7497-cde61a" container="test-curl-7497-cde61a"
Sep 11 19:53:49.531811 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:49.531777    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7497-cde61a" podUID="36709478-66c0-4190-be42-f44ae978225b" containerName="test-curl-7497-cde61a" containerID="cri-o://6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9" gracePeriod=2
Sep 11 19:53:49.709895 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:49.709870    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-3d6e9d"
Sep 11 19:53:49.824044 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:49.824012    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mpb8\" (UniqueName: \"kubernetes.io/projected/8a54075e-8d83-44fb-8b34-bd5f59433f8d-kube-api-access-7mpb8\") pod \"8a54075e-8d83-44fb-8b34-bd5f59433f8d\" (UID: \"8a54075e-8d83-44fb-8b34-bd5f59433f8d\") "
Sep 11 19:53:49.826294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:49.826249    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a54075e-8d83-44fb-8b34-bd5f59433f8d-kube-api-access-7mpb8" (OuterVolumeSpecName: "kube-api-access-7mpb8") pod "8a54075e-8d83-44fb-8b34-bd5f59433f8d" (UID: "8a54075e-8d83-44fb-8b34-bd5f59433f8d"). InnerVolumeSpecName "kube-api-access-7mpb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:53:49.925791 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:49.925756    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mpb8\" (UniqueName: \"kubernetes.io/projected/8a54075e-8d83-44fb-8b34-bd5f59433f8d-kube-api-access-7mpb8\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:50.258748 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:50.258668    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a54075e-8d83-44fb-8b34-bd5f59433f8d" path="/var/lib/kubelet/pods/8a54075e-8d83-44fb-8b34-bd5f59433f8d/volumes"
Sep 11 19:53:50.539111 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:50.539000    2578 generic.go:356] "Generic (PLEG): container finished" podID="8a54075e-8d83-44fb-8b34-bd5f59433f8d" containerID="26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53" exitCode=137
Sep 11 19:53:50.539111 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:50.539045    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-3d6e9d"
Sep 11 19:53:50.539111 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:50.539106    2578 scope.go:117] "RemoveContainer" containerID="26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53"
Sep 11 19:53:50.549559 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:50.549524    2578 scope.go:117] "RemoveContainer" containerID="26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53"
Sep 11 19:53:50.549911 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:53:50.549890    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53\": container with ID starting with 26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53 not found: ID does not exist" containerID="26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53"
Sep 11 19:53:50.549995 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:50.549926    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53"} err="failed to get container status \"26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53\": rpc error: code = NotFound desc = could not find container \"26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53\": container with ID starting with 26fe9e259d26c82539e73d79355e5eaa38a317df50387188709b10bfebb5eb53 not found: ID does not exist"
Sep 11 19:53:51.756660 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:51.756636    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-cde61a"
Sep 11 19:53:51.848750 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:51.848720    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpk4w\" (UniqueName: \"kubernetes.io/projected/36709478-66c0-4190-be42-f44ae978225b-kube-api-access-xpk4w\") pod \"36709478-66c0-4190-be42-f44ae978225b\" (UID: \"36709478-66c0-4190-be42-f44ae978225b\") "
Sep 11 19:53:51.850910 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:51.850877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36709478-66c0-4190-be42-f44ae978225b-kube-api-access-xpk4w" (OuterVolumeSpecName: "kube-api-access-xpk4w") pod "36709478-66c0-4190-be42-f44ae978225b" (UID: "36709478-66c0-4190-be42-f44ae978225b"). InnerVolumeSpecName "kube-api-access-xpk4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:53:51.949840 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:51.949800    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpk4w\" (UniqueName: \"kubernetes.io/projected/36709478-66c0-4190-be42-f44ae978225b-kube-api-access-xpk4w\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:52.259975 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:52.259897    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36709478-66c0-4190-be42-f44ae978225b" path="/var/lib/kubelet/pods/36709478-66c0-4190-be42-f44ae978225b/volumes"
Sep 11 19:53:52.555311 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:52.555199    2578 generic.go:356] "Generic (PLEG): container finished" podID="36709478-66c0-4190-be42-f44ae978225b" containerID="6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9" exitCode=137
Sep 11 19:53:52.555311 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:52.555240    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-cde61a"
Sep 11 19:53:52.555311 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:52.555305    2578 scope.go:117] "RemoveContainer" containerID="6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9"
Sep 11 19:53:52.564461 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:52.564445    2578 scope.go:117] "RemoveContainer" containerID="6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9"
Sep 11 19:53:52.564752 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:53:52.564732    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9\": container with ID starting with 6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9 not found: ID does not exist" containerID="6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9"
Sep 11 19:53:52.564805 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:52.564762    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9"} err="failed to get container status \"6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9\": rpc error: code = NotFound desc = could not find container \"6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9\": container with ID starting with 6741a24de8bcad9f259897655d777438da5c4f931c8f4b1c6542f889bd5743c9 not found: ID does not exist"
Sep 11 19:53:55.528748 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.528713    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"]
Sep 11 19:53:55.529160 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.528966    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h" podUID="6821b98d-adca-4cc5-9f2b-c3ea1b702f63" containerName="maas-api" containerID="cri-o://76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c" gracePeriod=30
Sep 11 19:53:55.603195 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.603161    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"]
Sep 11 19:53:55.603521 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.603472    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr" podUID="bed74668-7637-4c85-afe5-c36d4b13f0ba" containerName="payload-pre-processing" containerID="cri-o://cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187" gracePeriod=30
Sep 11 19:53:55.881919 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.881896    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:53:55.908077 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.908053    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:53:55.996634 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.996602    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwndk\" (UniqueName: \"kubernetes.io/projected/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-kube-api-access-lwndk\") pod \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") "
Sep 11 19:53:55.996927 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.996906    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8rfm\" (UniqueName: \"kubernetes.io/projected/bed74668-7637-4c85-afe5-c36d4b13f0ba-kube-api-access-r8rfm\") pod \"bed74668-7637-4c85-afe5-c36d4b13f0ba\" (UID: \"bed74668-7637-4c85-afe5-c36d4b13f0ba\") "
Sep 11 19:53:55.997100 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.997085    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-metrics-certs\") pod \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") "
Sep 11 19:53:55.997203 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.997191    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bed74668-7637-4c85-afe5-c36d4b13f0ba-plugins-config-volume\") pod \"bed74668-7637-4c85-afe5-c36d4b13f0ba\" (UID: \"bed74668-7637-4c85-afe5-c36d4b13f0ba\") "
Sep 11 19:53:55.997419 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.997401    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-maas-api-tls\") pod \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") "
Sep 11 19:53:55.997574 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.997558    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-openshift-service-ca\") pod \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\" (UID: \"6821b98d-adca-4cc5-9f2b-c3ea1b702f63\") "
Sep 11 19:53:55.998536 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.998510    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6821b98d-adca-4cc5-9f2b-c3ea1b702f63" (UID: "6821b98d-adca-4cc5-9f2b-c3ea1b702f63"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:53:55.998702 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.998605    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bed74668-7637-4c85-afe5-c36d4b13f0ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bed74668-7637-4c85-afe5-c36d4b13f0ba" (UID: "bed74668-7637-4c85-afe5-c36d4b13f0ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:53:55.999968 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:55.999938    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bed74668-7637-4c85-afe5-c36d4b13f0ba-kube-api-access-r8rfm" (OuterVolumeSpecName: "kube-api-access-r8rfm") pod "bed74668-7637-4c85-afe5-c36d4b13f0ba" (UID: "bed74668-7637-4c85-afe5-c36d4b13f0ba"). InnerVolumeSpecName "kube-api-access-r8rfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:53:56.001225 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.001195    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6821b98d-adca-4cc5-9f2b-c3ea1b702f63" (UID: "6821b98d-adca-4cc5-9f2b-c3ea1b702f63"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:53:56.002727 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.002706    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6821b98d-adca-4cc5-9f2b-c3ea1b702f63" (UID: "6821b98d-adca-4cc5-9f2b-c3ea1b702f63"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:53:56.003184 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.003162    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-kube-api-access-lwndk" (OuterVolumeSpecName: "kube-api-access-lwndk") pod "6821b98d-adca-4cc5-9f2b-c3ea1b702f63" (UID: "6821b98d-adca-4cc5-9f2b-c3ea1b702f63"). InnerVolumeSpecName "kube-api-access-lwndk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:53:56.098830 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.098726    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:56.098830 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.098759    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwndk\" (UniqueName: \"kubernetes.io/projected/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-kube-api-access-lwndk\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:56.098830 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.098769    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8rfm\" (UniqueName: \"kubernetes.io/projected/bed74668-7637-4c85-afe5-c36d4b13f0ba-kube-api-access-r8rfm\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:56.098830 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.098779    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:56.098830 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.098788    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bed74668-7637-4c85-afe5-c36d4b13f0ba-plugins-config-volume\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:56.098830 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.098797    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6821b98d-adca-4cc5-9f2b-c3ea1b702f63-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:53:56.581342 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.581309    2578 generic.go:356] "Generic (PLEG): container finished" podID="bed74668-7637-4c85-afe5-c36d4b13f0ba" containerID="cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187" exitCode=0
Sep 11 19:53:56.581715 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.581390    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"
Sep 11 19:53:56.581715 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.581394    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr" event={"ID":"bed74668-7637-4c85-afe5-c36d4b13f0ba","Type":"ContainerDied","Data":"cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187"}
Sep 11 19:53:56.581715 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.581450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr" event={"ID":"bed74668-7637-4c85-afe5-c36d4b13f0ba","Type":"ContainerDied","Data":"4d417fab1f47257d0168e076d3bcce6fd238eec4c0ba8cb3f404ea9a6d154ca3"}
Sep 11 19:53:56.581715 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.581480    2578 scope.go:117] "RemoveContainer" containerID="cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187"
Sep 11 19:53:56.582840 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.582814    2578 generic.go:356] "Generic (PLEG): container finished" podID="6821b98d-adca-4cc5-9f2b-c3ea1b702f63" containerID="76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c" exitCode=0
Sep 11 19:53:56.582912 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.582878    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"
Sep 11 19:53:56.582974 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.582946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h" event={"ID":"6821b98d-adca-4cc5-9f2b-c3ea1b702f63","Type":"ContainerDied","Data":"76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c"}
Sep 11 19:53:56.583035 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.583010    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h" event={"ID":"6821b98d-adca-4cc5-9f2b-c3ea1b702f63","Type":"ContainerDied","Data":"7270ea08e59c219b66acaf0cddd8fb4c9c4019577d87fd26484955abd08cc6f9"}
Sep 11 19:53:56.592343 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.591905    2578 scope.go:117] "RemoveContainer" containerID="cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187"
Sep 11 19:53:56.592860 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:53:56.592833    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187\": container with ID starting with cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187 not found: ID does not exist" containerID="cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187"
Sep 11 19:53:56.592975 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.592867    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187"} err="failed to get container status \"cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187\": rpc error: code = NotFound desc = could not find container \"cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187\": container with ID starting with cdff679d4b58120f78b1badb8b02e82ac8225c92b4e3fa99c77bf3411a76c187 not found: ID does not exist"
Sep 11 19:53:56.592975 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.592891    2578 scope.go:117] "RemoveContainer" containerID="76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c"
Sep 11 19:53:56.603307 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.603291    2578 scope.go:117] "RemoveContainer" containerID="76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c"
Sep 11 19:53:56.603570 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:53:56.603550    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c\": container with ID starting with 76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c not found: ID does not exist" containerID="76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c"
Sep 11 19:53:56.603656 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.603576    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c"} err="failed to get container status \"76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c\": rpc error: code = NotFound desc = could not find container \"76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c\": container with ID starting with 76f4860d807edbc2e323f8973e8744c1e67814596e6ab93508e9ef3be3ba8d1c not found: ID does not exist"
Sep 11 19:53:56.606252 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.606234    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"]
Sep 11 19:53:56.608929 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.608913    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr"]
Sep 11 19:53:56.620054 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.620035    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"]
Sep 11 19:53:56.624176 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:56.624150    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a58a49-64bf4c9cdf-dfs9h"]
Sep 11 19:53:57.760187 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.760157    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"]
Sep 11 19:53:57.760693 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.760679    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6821b98d-adca-4cc5-9f2b-c3ea1b702f63" containerName="maas-api"
Sep 11 19:53:57.760755 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.760696    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6821b98d-adca-4cc5-9f2b-c3ea1b702f63" containerName="maas-api"
Sep 11 19:53:57.760755 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.760707    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bed74668-7637-4c85-afe5-c36d4b13f0ba" containerName="payload-pre-processing"
Sep 11 19:53:57.760755 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.760713    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bed74668-7637-4c85-afe5-c36d4b13f0ba" containerName="payload-pre-processing"
Sep 11 19:53:57.760755 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.760720    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36709478-66c0-4190-be42-f44ae978225b" containerName="test-curl-7497-cde61a"
Sep 11 19:53:57.760755 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.760725    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="36709478-66c0-4190-be42-f44ae978225b" containerName="test-curl-7497-cde61a"
Sep 11 19:53:57.760899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.760809    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6821b98d-adca-4cc5-9f2b-c3ea1b702f63" containerName="maas-api"
Sep 11 19:53:57.760899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.760818    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bed74668-7637-4c85-afe5-c36d4b13f0ba" containerName="payload-pre-processing"
Sep 11 19:53:57.760899 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.760825    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="36709478-66c0-4190-be42-f44ae978225b" containerName="test-curl-7497-cde61a"
Sep 11 19:53:57.765701 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.765681    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:57.770103 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.770078    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-105b25aa-serving-cert\""
Sep 11 19:53:57.779382 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.779318    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"]
Sep 11 19:53:57.918936 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.918886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29l55\" (UniqueName: \"kubernetes.io/projected/8b9b1304-ce5a-4c90-a8be-630b611103f8-kube-api-access-29l55\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:57.919111 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.918963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-metrics-certs\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:57.919159 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.919112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9b1304-ce5a-4c90-a8be-630b611103f8-openshift-service-ca\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:57.919209 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:57.919165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:58.020587 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:58.020497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9b1304-ce5a-4c90-a8be-630b611103f8-openshift-service-ca\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:58.020587 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:58.020548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:58.020587 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:58.020584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29l55\" (UniqueName: \"kubernetes.io/projected/8b9b1304-ce5a-4c90-a8be-630b611103f8-kube-api-access-29l55\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:58.020877 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:58.020612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-metrics-certs\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:58.020877 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:53:58.020749    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-serving-cert: secret "maas-api-e2e-mt-105b25aa-serving-cert" not found
Sep 11 19:53:58.020877 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:53:58.020827    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls podName:8b9b1304-ce5a-4c90-a8be-630b611103f8 nodeName:}" failed. No retries permitted until 2026-09-11 19:53:58.520797467 +0000 UTC m=+1472.754870868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls") pod "maas-api-e2e-mt-105b25aa-65466ff446-c4k65" (UID: "8b9b1304-ce5a-4c90-a8be-630b611103f8") : secret "maas-api-e2e-mt-105b25aa-serving-cert" not found
Sep 11 19:53:58.021137 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:58.021117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9b1304-ce5a-4c90-a8be-630b611103f8-openshift-service-ca\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:58.023517 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:58.023489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-metrics-certs\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:58.035751 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:58.035728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29l55\" (UniqueName: \"kubernetes.io/projected/8b9b1304-ce5a-4c90-a8be-630b611103f8-kube-api-access-29l55\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:58.260761 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:58.260719    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6821b98d-adca-4cc5-9f2b-c3ea1b702f63" path="/var/lib/kubelet/pods/6821b98d-adca-4cc5-9f2b-c3ea1b702f63/volumes"
Sep 11 19:53:58.261360 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:58.261340    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bed74668-7637-4c85-afe5-c36d4b13f0ba" path="/var/lib/kubelet/pods/bed74668-7637-4c85-afe5-c36d4b13f0ba/volumes"
Sep 11 19:53:58.525294 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:58.525234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:58.525500 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:53:58.525417    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-serving-cert: secret "maas-api-e2e-mt-105b25aa-serving-cert" not found
Sep 11 19:53:58.525569 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:53:58.525526    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls podName:8b9b1304-ce5a-4c90-a8be-630b611103f8 nodeName:}" failed. No retries permitted until 2026-09-11 19:53:59.525503087 +0000 UTC m=+1473.759576502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls") pod "maas-api-e2e-mt-105b25aa-65466ff446-c4k65" (UID: "8b9b1304-ce5a-4c90-a8be-630b611103f8") : secret "maas-api-e2e-mt-105b25aa-serving-cert" not found
Sep 11 19:53:59.535901 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:59.535848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:59.538382 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:59.538360    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls\") pod \"maas-api-e2e-mt-105b25aa-65466ff446-c4k65\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:59.577610 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:59.577581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:53:59.864371 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:53:59.863746    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"]
Sep 11 19:53:59.867116 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:53:59.867085    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9b1304_ce5a_4c90_a8be_630b611103f8.slice/crio-7ab8481f06f677e81a901803fbc15baf411c844d69c1128d2ce9bc4b6b9fc6af WatchSource:0}: Error finding container 7ab8481f06f677e81a901803fbc15baf411c844d69c1128d2ce9bc4b6b9fc6af: Status 404 returned error can't find the container with id 7ab8481f06f677e81a901803fbc15baf411c844d69c1128d2ce9bc4b6b9fc6af
Sep 11 19:54:00.612739 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:00.612682    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65" event={"ID":"8b9b1304-ce5a-4c90-a8be-630b611103f8","Type":"ContainerStarted","Data":"b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10"}
Sep 11 19:54:00.613186 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:00.612768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65" event={"ID":"8b9b1304-ce5a-4c90-a8be-630b611103f8","Type":"ContainerStarted","Data":"7ab8481f06f677e81a901803fbc15baf411c844d69c1128d2ce9bc4b6b9fc6af"}
Sep 11 19:54:00.613186 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:00.612799    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:54:00.633923 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:00.633868    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65" podStartSLOduration=3.09862311 podStartE2EDuration="3.633846622s" totalImagesPullingTime="535.223512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:54:00.631422241 +0000 UTC m=+1474.865495680" watchObservedRunningTime="2026-09-11 19:54:00.633846622 +0000 UTC m=+1474.867920043"
Sep 11 19:54:06.624906 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:06.624881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:54:22.731284 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:22.727848    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"]
Sep 11 19:54:22.731284 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:22.728109    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy" containerID="cri-o://523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13" gracePeriod=30
Sep 11 19:54:26.636023 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:26.635994    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:54:26.640440 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:26.640365    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:54:27.416633 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:27.416599    2578 patch_prober.go:28] interesting pod/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:54:27.416829 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:27.416667    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:54:28.011140 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.011059    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:54:28.146469 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146436    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-credential-socket\") pod \"52416269-32c4-4280-9508-7de137dd746d\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") "
Sep 11 19:54:28.146651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146494    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52416269-32c4-4280-9508-7de137dd746d-istio-podinfo\") pod \"52416269-32c4-4280-9508-7de137dd746d\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") "
Sep 11 19:54:28.146651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146531    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-envoy\") pod \"52416269-32c4-4280-9508-7de137dd746d\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") "
Sep 11 19:54:28.146651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146564    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-data\") pod \"52416269-32c4-4280-9508-7de137dd746d\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") "
Sep 11 19:54:28.146651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146586    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-socket\") pod \"52416269-32c4-4280-9508-7de137dd746d\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") "
Sep 11 19:54:28.146651 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146626    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-certs\") pod \"52416269-32c4-4280-9508-7de137dd746d\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") "
Sep 11 19:54:28.146991 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146667    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42q42\" (UniqueName: \"kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-kube-api-access-42q42\") pod \"52416269-32c4-4280-9508-7de137dd746d\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") "
Sep 11 19:54:28.146991 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146708    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52416269-32c4-4280-9508-7de137dd746d" (UID: "52416269-32c4-4280-9508-7de137dd746d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:54:28.146991 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146762    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-istio-token\") pod \"52416269-32c4-4280-9508-7de137dd746d\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") "
Sep 11 19:54:28.146991 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146801    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52416269-32c4-4280-9508-7de137dd746d-istiod-ca-cert\") pod \"52416269-32c4-4280-9508-7de137dd746d\" (UID: \"52416269-32c4-4280-9508-7de137dd746d\") "
Sep 11 19:54:28.146991 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146843    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-data" (OuterVolumeSpecName: "istio-data") pod "52416269-32c4-4280-9508-7de137dd746d" (UID: "52416269-32c4-4280-9508-7de137dd746d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:54:28.146991 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146874    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52416269-32c4-4280-9508-7de137dd746d" (UID: "52416269-32c4-4280-9508-7de137dd746d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:54:28.146991 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.146948    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52416269-32c4-4280-9508-7de137dd746d" (UID: "52416269-32c4-4280-9508-7de137dd746d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:54:28.147521 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.147153    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52416269-32c4-4280-9508-7de137dd746d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52416269-32c4-4280-9508-7de137dd746d" (UID: "52416269-32c4-4280-9508-7de137dd746d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:54:28.147521 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.147235    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:54:28.147521 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.147247    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52416269-32c4-4280-9508-7de137dd746d-istiod-ca-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:54:28.147521 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.147275    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-credential-socket\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:54:28.147521 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.147292    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-data\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:54:28.147521 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.147303    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-workload-socket\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:54:28.148986 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.148956    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52416269-32c4-4280-9508-7de137dd746d" (UID: "52416269-32c4-4280-9508-7de137dd746d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:54:28.149099 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.149080    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52416269-32c4-4280-9508-7de137dd746d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52416269-32c4-4280-9508-7de137dd746d" (UID: "52416269-32c4-4280-9508-7de137dd746d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:54:28.149495 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.149475    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-kube-api-access-42q42" (OuterVolumeSpecName: "kube-api-access-42q42") pod "52416269-32c4-4280-9508-7de137dd746d" (UID: "52416269-32c4-4280-9508-7de137dd746d"). InnerVolumeSpecName "kube-api-access-42q42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:54:28.149548 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.149505    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-istio-token" (OuterVolumeSpecName: "istio-token") pod "52416269-32c4-4280-9508-7de137dd746d" (UID: "52416269-32c4-4280-9508-7de137dd746d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:54:28.248895 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.248856    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52416269-32c4-4280-9508-7de137dd746d-istio-podinfo\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:54:28.248895 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.248888    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52416269-32c4-4280-9508-7de137dd746d-istio-envoy\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:54:28.248895 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.248900    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42q42\" (UniqueName: \"kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-kube-api-access-42q42\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:54:28.249135 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.248912    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52416269-32c4-4280-9508-7de137dd746d-istio-token\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:54:28.785107 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.785075    2578 generic.go:356] "Generic (PLEG): container finished" podID="52416269-32c4-4280-9508-7de137dd746d" containerID="523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13" exitCode=0
Sep 11 19:54:28.785306 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.785137    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"
Sep 11 19:54:28.785306 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.785161    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" event={"ID":"52416269-32c4-4280-9508-7de137dd746d","Type":"ContainerDied","Data":"523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13"}
Sep 11 19:54:28.785306 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.785213    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7" event={"ID":"52416269-32c4-4280-9508-7de137dd746d","Type":"ContainerDied","Data":"6b512c4b937601314f2a0cf52fc5d2f121cd2d4002c130bf45d74d3039062a63"}
Sep 11 19:54:28.785306 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.785236    2578 scope.go:117] "RemoveContainer" containerID="523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13"
Sep 11 19:54:28.795618 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.795600    2578 scope.go:117] "RemoveContainer" containerID="69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711"
Sep 11 19:54:28.805932 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.805907    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"]
Sep 11 19:54:28.806393 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.806365    2578 scope.go:117] "RemoveContainer" containerID="523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13"
Sep 11 19:54:28.806697 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:54:28.806679    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13\": container with ID starting with 523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13 not found: ID does not exist" containerID="523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13"
Sep 11 19:54:28.806782 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.806710    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13"} err="failed to get container status \"523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13\": rpc error: code = NotFound desc = could not find container \"523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13\": container with ID starting with 523d007effe139c15e0c8fc9a05c2fa765b4c106f373fdd6e865cbd3d1765b13 not found: ID does not exist"
Sep 11 19:54:28.806782 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.806732    2578 scope.go:117] "RemoveContainer" containerID="69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711"
Sep 11 19:54:28.807110 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:54:28.807082    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711\": container with ID starting with 69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711 not found: ID does not exist" containerID="69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711"
Sep 11 19:54:28.807203 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.807120    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711"} err="failed to get container status \"69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711\": rpc error: code = NotFound desc = could not find container \"69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711\": container with ID starting with 69e24d34e51701d962af7e27bffa44531b0740a30743d6e4600a88c9102fe711 not found: ID does not exist"
Sep 11 19:54:28.810439 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:28.810419    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7"]
Sep 11 19:54:30.260074 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.260035    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52416269-32c4-4280-9508-7de137dd746d" path="/var/lib/kubelet/pods/52416269-32c4-4280-9508-7de137dd746d/volumes"
Sep 11 19:54:30.894253 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.894217    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"]
Sep 11 19:54:30.894729 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.894714    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy"
Sep 11 19:54:30.894804 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.894731    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy"
Sep 11 19:54:30.894804 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.894773    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy"
Sep 11 19:54:30.894804 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.894779    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy"
Sep 11 19:54:30.894911 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.894846    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy"
Sep 11 19:54:30.894911 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.894853    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="52416269-32c4-4280-9508-7de137dd746d" containerName="istio-proxy"
Sep 11 19:54:30.899404 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.899385    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:30.901808 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.901787    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-57d97d-serving-cert\""
Sep 11 19:54:30.906183 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.906158    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"]
Sep 11 19:54:30.976063 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.976029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcjgz\" (UniqueName: \"kubernetes.io/projected/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-kube-api-access-fcjgz\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:30.976237 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.976120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:30.976237 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.976174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:30.976237 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:30.976208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:31.077133 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:31.077102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:31.077362 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:31.077170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:31.077362 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:31.077196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:31.077362 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:31.077228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcjgz\" (UniqueName: \"kubernetes.io/projected/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-kube-api-access-fcjgz\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:31.077954 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:31.077919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:31.079909 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:31.079886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:31.080118 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:31.080095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:31.086351 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:31.086327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcjgz\" (UniqueName: \"kubernetes.io/projected/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-kube-api-access-fcjgz\") pod \"maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:31.212413 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:31.212325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:31.499664 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:31.499589    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"]
Sep 11 19:54:31.502519 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:54:31.502486    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f70d0b1_dacf_4bf1_a9e8_50bd4dba5dbf.slice/crio-362e3f39f4e5d2d14932bd054f71d30c5529e125bcec6e69d5f588419f0b64b7 WatchSource:0}: Error finding container 362e3f39f4e5d2d14932bd054f71d30c5529e125bcec6e69d5f588419f0b64b7: Status 404 returned error can't find the container with id 362e3f39f4e5d2d14932bd054f71d30c5529e125bcec6e69d5f588419f0b64b7
Sep 11 19:54:31.808195 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:31.808099    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t" event={"ID":"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf","Type":"ContainerStarted","Data":"362e3f39f4e5d2d14932bd054f71d30c5529e125bcec6e69d5f588419f0b64b7"}
Sep 11 19:54:32.816430 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:32.816395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t" event={"ID":"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf","Type":"ContainerStarted","Data":"969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0"}
Sep 11 19:54:32.816867 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:32.816474    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:54:32.835643 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:32.835591    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t" podStartSLOduration=2.451081003 podStartE2EDuration="2.835573635s" totalImagesPullingTime="384.492632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:54:32.834357166 +0000 UTC m=+1507.068430588" watchObservedRunningTime="2026-09-11 19:54:32.835573635 +0000 UTC m=+1507.069647055"
Sep 11 19:54:38.828844 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:54:38.828812    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 19:55:05.783909 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:05.783873    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"]
Sep 11 19:55:05.789293 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:05.789243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:05.793740 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:05.793711    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-8a4eb7-serving-cert\""
Sep 11 19:55:05.799129 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:05.798971    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"]
Sep 11 19:55:05.950916 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:05.950869    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbcf4174-30ec-4bd9-b748-4445cbef4970-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:05.951093 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:05.950986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:05.951093 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:05.951036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:05.951093 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:05.951083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrx92\" (UniqueName: \"kubernetes.io/projected/cbcf4174-30ec-4bd9-b748-4445cbef4970-kube-api-access-hrx92\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:06.051921 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:06.051841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:06.051921 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:06.051895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrx92\" (UniqueName: \"kubernetes.io/projected/cbcf4174-30ec-4bd9-b748-4445cbef4970-kube-api-access-hrx92\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:06.052112 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:06.051943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbcf4174-30ec-4bd9-b748-4445cbef4970-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:06.052112 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:06.051995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:06.052738 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:06.052636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbcf4174-30ec-4bd9-b748-4445cbef4970-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:06.054485 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:06.054463    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:06.054579 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:06.054533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:06.060420 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:06.060402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrx92\" (UniqueName: \"kubernetes.io/projected/cbcf4174-30ec-4bd9-b748-4445cbef4970-kube-api-access-hrx92\") pod \"maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:06.107206 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:06.107177    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:06.390491 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:55:06.390461    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbcf4174_30ec_4bd9_b748_4445cbef4970.slice/crio-da153c68991bf5666ef92a6761f1851c6e4b75e0cb463421c665c3ca0d0c6a97 WatchSource:0}: Error finding container da153c68991bf5666ef92a6761f1851c6e4b75e0cb463421c665c3ca0d0c6a97: Status 404 returned error can't find the container with id da153c68991bf5666ef92a6761f1851c6e4b75e0cb463421c665c3ca0d0c6a97
Sep 11 19:55:06.390898 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:06.390868    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"]
Sep 11 19:55:07.018523 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:07.018491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms" event={"ID":"cbcf4174-30ec-4bd9-b748-4445cbef4970","Type":"ContainerStarted","Data":"cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc"}
Sep 11 19:55:07.018936 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:07.018541    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms" event={"ID":"cbcf4174-30ec-4bd9-b748-4445cbef4970","Type":"ContainerStarted","Data":"da153c68991bf5666ef92a6761f1851c6e4b75e0cb463421c665c3ca0d0c6a97"}
Sep 11 19:55:07.018936 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:07.018594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:55:07.036752 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:07.036708    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms" podStartSLOduration=1.588930639 podStartE2EDuration="2.036691143s" totalImagesPullingTime="447.760504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:55:07.034756536 +0000 UTC m=+1541.268829952" watchObservedRunningTime="2026-09-11 19:55:07.036691143 +0000 UTC m=+1541.270764564"
Sep 11 19:55:13.030455 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:55:13.030423    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 19:57:40.984638 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:40.984607    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"]
Sep 11 19:57:40.985133 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:40.984851    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65" podUID="8b9b1304-ce5a-4c90-a8be-630b611103f8" containerName="maas-api" containerID="cri-o://b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10" gracePeriod=30
Sep 11 19:57:41.247511 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.247449    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:57:41.362021 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.361986    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29l55\" (UniqueName: \"kubernetes.io/projected/8b9b1304-ce5a-4c90-a8be-630b611103f8-kube-api-access-29l55\") pod \"8b9b1304-ce5a-4c90-a8be-630b611103f8\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") "
Sep 11 19:57:41.362191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.362033    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls\") pod \"8b9b1304-ce5a-4c90-a8be-630b611103f8\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") "
Sep 11 19:57:41.362191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.362054    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-metrics-certs\") pod \"8b9b1304-ce5a-4c90-a8be-630b611103f8\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") "
Sep 11 19:57:41.362191 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.362073    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9b1304-ce5a-4c90-a8be-630b611103f8-openshift-service-ca\") pod \"8b9b1304-ce5a-4c90-a8be-630b611103f8\" (UID: \"8b9b1304-ce5a-4c90-a8be-630b611103f8\") "
Sep 11 19:57:41.362588 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.362560    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b9b1304-ce5a-4c90-a8be-630b611103f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8b9b1304-ce5a-4c90-a8be-630b611103f8" (UID: "8b9b1304-ce5a-4c90-a8be-630b611103f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:57:41.364380 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.364348    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8b9b1304-ce5a-4c90-a8be-630b611103f8" (UID: "8b9b1304-ce5a-4c90-a8be-630b611103f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:57:41.364475 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.364388    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8b9b1304-ce5a-4c90-a8be-630b611103f8" (UID: "8b9b1304-ce5a-4c90-a8be-630b611103f8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:57:41.364794 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.364772    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b9b1304-ce5a-4c90-a8be-630b611103f8-kube-api-access-29l55" (OuterVolumeSpecName: "kube-api-access-29l55") pod "8b9b1304-ce5a-4c90-a8be-630b611103f8" (UID: "8b9b1304-ce5a-4c90-a8be-630b611103f8"). InnerVolumeSpecName "kube-api-access-29l55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:57:41.463947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.463910    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29l55\" (UniqueName: \"kubernetes.io/projected/8b9b1304-ce5a-4c90-a8be-630b611103f8-kube-api-access-29l55\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:57:41.463947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.463940    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:57:41.463947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.463949    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b9b1304-ce5a-4c90-a8be-630b611103f8-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:57:41.463947 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.463957    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9b1304-ce5a-4c90-a8be-630b611103f8-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 19:57:41.930619 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.930580    2578 generic.go:356] "Generic (PLEG): container finished" podID="8b9b1304-ce5a-4c90-a8be-630b611103f8" containerID="b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10" exitCode=0
Sep 11 19:57:41.930798 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.930630    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"
Sep 11 19:57:41.930798 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.930632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65" event={"ID":"8b9b1304-ce5a-4c90-a8be-630b611103f8","Type":"ContainerDied","Data":"b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10"}
Sep 11 19:57:41.930798 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.930684    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65" event={"ID":"8b9b1304-ce5a-4c90-a8be-630b611103f8","Type":"ContainerDied","Data":"7ab8481f06f677e81a901803fbc15baf411c844d69c1128d2ce9bc4b6b9fc6af"}
Sep 11 19:57:41.930798 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.930707    2578 scope.go:117] "RemoveContainer" containerID="b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10"
Sep 11 19:57:41.942006 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.941985    2578 scope.go:117] "RemoveContainer" containerID="b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10"
Sep 11 19:57:41.942298 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:57:41.942275    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10\": container with ID starting with b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10 not found: ID does not exist" containerID="b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10"
Sep 11 19:57:41.942372 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.942313    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10"} err="failed to get container status \"b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10\": rpc error: code = NotFound desc = could not find container \"b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10\": container with ID starting with b527e9869beefdcd82399a5c85b8b47a89b11e8380cf31f0dd7e8845e7b46e10 not found: ID does not exist"
Sep 11 19:57:41.960633 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.960606    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"]
Sep 11 19:57:41.964376 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:41.964353    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-105b25aa-65466ff446-c4k65"]
Sep 11 19:57:42.259903 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:57:42.259824    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b9b1304-ce5a-4c90-a8be-630b611103f8" path="/var/lib/kubelet/pods/8b9b1304-ce5a-4c90-a8be-630b611103f8/volumes"
Sep 11 19:58:21.737551 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.737512    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"]
Sep 11 19:58:21.738046 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.738030    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9b1304-ce5a-4c90-a8be-630b611103f8" containerName="maas-api"
Sep 11 19:58:21.738091 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.738048    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9b1304-ce5a-4c90-a8be-630b611103f8" containerName="maas-api"
Sep 11 19:58:21.738139 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.738129    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b9b1304-ce5a-4c90-a8be-630b611103f8" containerName="maas-api"
Sep 11 19:58:21.741499 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.741484    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:21.745329 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.745310    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a8ee95\"/\"default-dockercfg-4l56f\""
Sep 11 19:58:21.745464 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.745351    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-a8ee95\"/\"kube-root-ca.crt\""
Sep 11 19:58:21.745464 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.745408    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-a8ee95\"/\"openshift-service-ca.crt\""
Sep 11 19:58:21.745464 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.745443    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a8ee95\"/\"distinct-2-w4-a8ee95-kserve-self-signed-certs\""
Sep 11 19:58:21.751118 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.751090    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"]
Sep 11 19:58:21.899109 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.899077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-home\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:21.899299 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.899114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlt2g\" (UniqueName: \"kubernetes.io/projected/64400a76-70bb-4801-9936-8cd5d7f49214-kube-api-access-rlt2g\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:21.899299 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.899241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64400a76-70bb-4801-9936-8cd5d7f49214-tls-certs\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:21.899402 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.899306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-model-cache\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:21.899402 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.899346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-tmp-dir\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:21.899402 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:21.899372    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-dshm\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.000233 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.000151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-home\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.000233 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.000192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlt2g\" (UniqueName: \"kubernetes.io/projected/64400a76-70bb-4801-9936-8cd5d7f49214-kube-api-access-rlt2g\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.000491 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.000248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64400a76-70bb-4801-9936-8cd5d7f49214-tls-certs\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.000491 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.000300    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-model-cache\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.000491 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.000333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-tmp-dir\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.000491 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.000366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-dshm\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.000682 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.000662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-home\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.000740 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.000720    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-model-cache\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.000795 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.000770    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-tmp-dir\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.002762 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.002743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-dshm\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.002933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.002918    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64400a76-70bb-4801-9936-8cd5d7f49214-tls-certs\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.008735 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.008713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlt2g\" (UniqueName: \"kubernetes.io/projected/64400a76-70bb-4801-9936-8cd5d7f49214-kube-api-access-rlt2g\") pod \"distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") " pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.052195 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.052160    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:22.326655 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:22.326629    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"]
Sep 11 19:58:22.328534 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:58:22.328508    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64400a76_70bb_4801_9936_8cd5d7f49214.slice/crio-8221e54dc92c3e2c443d3801b477e48355a0f09e3f2c47417caebfb306839569 WatchSource:0}: Error finding container 8221e54dc92c3e2c443d3801b477e48355a0f09e3f2c47417caebfb306839569: Status 404 returned error can't find the container with id 8221e54dc92c3e2c443d3801b477e48355a0f09e3f2c47417caebfb306839569
Sep 11 19:58:23.170821 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:23.170785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n" event={"ID":"64400a76-70bb-4801-9936-8cd5d7f49214","Type":"ContainerStarted","Data":"a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6"}
Sep 11 19:58:23.171223 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:23.170829    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n" event={"ID":"64400a76-70bb-4801-9936-8cd5d7f49214","Type":"ContainerStarted","Data":"8221e54dc92c3e2c443d3801b477e48355a0f09e3f2c47417caebfb306839569"}
Sep 11 19:58:23.187837 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:23.187790    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n" podStartSLOduration=2.187774127 podStartE2EDuration="2.187774127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:58:23.186819741 +0000 UTC m=+1737.420893214" watchObservedRunningTime="2026-09-11 19:58:23.187774127 +0000 UTC m=+1737.421847576"
Sep 11 19:58:32.052813 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:32.052760    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:32.053638 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:32.053613    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:32.079708 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:32.079674    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:58:32.236331 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:58:32.236294    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 19:59:09.440970 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:09.440935    2578 generic.go:356] "Generic (PLEG): container finished" podID="c5dccc1d-02cf-4490-99fb-8d53da95c80c" containerID="9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf" exitCode=137
Sep 11 19:59:09.441426 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:09.441008    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4" event={"ID":"c5dccc1d-02cf-4490-99fb-8d53da95c80c","Type":"ContainerDied","Data":"9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf"}
Sep 11 19:59:09.441426 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:09.441399    2578 scope.go:117] "RemoveContainer" containerID="9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf"
Sep 11 19:59:10.450330 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:10.450297    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4" event={"ID":"c5dccc1d-02cf-4490-99fb-8d53da95c80c","Type":"ContainerStarted","Data":"54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc"}
Sep 11 19:59:10.450712 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:10.450493    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:59:21.458327 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:21.458229    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 19:59:26.682616 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:26.682567    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:59:26.687367 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:26.687347    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 19:59:49.657505 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.657473    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"]
Sep 11 19:59:49.661673 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.661653    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:49.664240 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.664218    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e7cdd6-serving-cert\""
Sep 11 19:59:49.675483 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.675456    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"]
Sep 11 19:59:49.705565 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.705529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed728c08-26fb-44d9-ae79-229901b95603-openshift-service-ca\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:49.705710 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.705689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x24d7\" (UniqueName: \"kubernetes.io/projected/ed728c08-26fb-44d9-ae79-229901b95603-kube-api-access-x24d7\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:49.705752 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.705736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-maas-api-tls\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:49.705798 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.705782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-metrics-certs\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:49.806516 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.806481    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x24d7\" (UniqueName: \"kubernetes.io/projected/ed728c08-26fb-44d9-ae79-229901b95603-kube-api-access-x24d7\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:49.806683 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.806526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-maas-api-tls\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:49.806683 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.806548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-metrics-certs\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:49.806683 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.806603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed728c08-26fb-44d9-ae79-229901b95603-openshift-service-ca\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:49.806683 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:59:49.806668    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-serving-cert: secret "maas-api-e2e-api-a-e7cdd6-serving-cert" not found
Sep 11 19:59:49.806875 ip-10-0-139-38 kubenswrapper[2578]: E0911 19:59:49.806736    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-maas-api-tls podName:ed728c08-26fb-44d9-ae79-229901b95603 nodeName:}" failed. No retries permitted until 2026-09-11 19:59:50.306711298 +0000 UTC m=+1824.540784717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-maas-api-tls") pod "maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4" (UID: "ed728c08-26fb-44d9-ae79-229901b95603") : secret "maas-api-e2e-api-a-e7cdd6-serving-cert" not found
Sep 11 19:59:49.807357 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.807339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed728c08-26fb-44d9-ae79-229901b95603-openshift-service-ca\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:49.809282 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.809247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-metrics-certs\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:49.818054 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:49.818029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x24d7\" (UniqueName: \"kubernetes.io/projected/ed728c08-26fb-44d9-ae79-229901b95603-kube-api-access-x24d7\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:50.311539 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:50.311504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-maas-api-tls\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:50.314432 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:50.314407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-maas-api-tls\") pod \"maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:50.575197 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:50.575120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:50.852152 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:50.852126    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"]
Sep 11 19:59:50.854130 ip-10-0-139-38 kubenswrapper[2578]: W0911 19:59:50.854099    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded728c08_26fb_44d9_ae79_229901b95603.slice/crio-6a2a90dd899f1ef70fe750b1d0cb0b655f9aa322311d8a8c35998d2c6b77c9e3 WatchSource:0}: Error finding container 6a2a90dd899f1ef70fe750b1d0cb0b655f9aa322311d8a8c35998d2c6b77c9e3: Status 404 returned error can't find the container with id 6a2a90dd899f1ef70fe750b1d0cb0b655f9aa322311d8a8c35998d2c6b77c9e3
Sep 11 19:59:50.855852 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:50.855833    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:59:51.689327 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:51.689209    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4" event={"ID":"ed728c08-26fb-44d9-ae79-229901b95603","Type":"ContainerStarted","Data":"8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df"}
Sep 11 19:59:51.689327 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:51.689312    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4" event={"ID":"ed728c08-26fb-44d9-ae79-229901b95603","Type":"ContainerStarted","Data":"6a2a90dd899f1ef70fe750b1d0cb0b655f9aa322311d8a8c35998d2c6b77c9e3"}
Sep 11 19:59:51.689933 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:51.689908    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 19:59:51.707299 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:51.707230    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4" podStartSLOduration=2.234035803 podStartE2EDuration="2.707215787s" totalImagesPullingTime="473.179984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:59:51.706131721 +0000 UTC m=+1825.940205143" watchObservedRunningTime="2026-09-11 19:59:51.707215787 +0000 UTC m=+1825.941289208"
Sep 11 19:59:57.702529 ip-10-0-139-38 kubenswrapper[2578]: I0911 19:59:57.702501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 20:00:06.488470 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:06.488434    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"]
Sep 11 20:00:15.236399 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.236364    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"]
Sep 11 20:00:15.236920 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.236703    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh" podUID="a88aa6ff-907e-4be6-ae60-729733aef025" containerName="maas-api" containerID="cri-o://0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87" gracePeriod=30
Sep 11 20:00:15.504647 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.504574    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 20:00:15.578952 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.578920    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-maas-api-tls\") pod \"a88aa6ff-907e-4be6-ae60-729733aef025\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") "
Sep 11 20:00:15.579156 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.578960    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bggp5\" (UniqueName: \"kubernetes.io/projected/a88aa6ff-907e-4be6-ae60-729733aef025-kube-api-access-bggp5\") pod \"a88aa6ff-907e-4be6-ae60-729733aef025\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") "
Sep 11 20:00:15.579156 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.579014    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-metrics-certs\") pod \"a88aa6ff-907e-4be6-ae60-729733aef025\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") "
Sep 11 20:00:15.579156 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.579090    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a88aa6ff-907e-4be6-ae60-729733aef025-openshift-service-ca\") pod \"a88aa6ff-907e-4be6-ae60-729733aef025\" (UID: \"a88aa6ff-907e-4be6-ae60-729733aef025\") "
Sep 11 20:00:15.579594 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.579565    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a88aa6ff-907e-4be6-ae60-729733aef025-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a88aa6ff-907e-4be6-ae60-729733aef025" (UID: "a88aa6ff-907e-4be6-ae60-729733aef025"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:00:15.581497 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.581468    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a88aa6ff-907e-4be6-ae60-729733aef025" (UID: "a88aa6ff-907e-4be6-ae60-729733aef025"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:00:15.581599 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.581497    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a88aa6ff-907e-4be6-ae60-729733aef025" (UID: "a88aa6ff-907e-4be6-ae60-729733aef025"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:00:15.581599 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.581537    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a88aa6ff-907e-4be6-ae60-729733aef025-kube-api-access-bggp5" (OuterVolumeSpecName: "kube-api-access-bggp5") pod "a88aa6ff-907e-4be6-ae60-729733aef025" (UID: "a88aa6ff-907e-4be6-ae60-729733aef025"). InnerVolumeSpecName "kube-api-access-bggp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:00:15.680353 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.680321    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:15.680353 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.680349    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a88aa6ff-907e-4be6-ae60-729733aef025-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:15.680353 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.680359    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a88aa6ff-907e-4be6-ae60-729733aef025-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:15.680628 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.680368    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bggp5\" (UniqueName: \"kubernetes.io/projected/a88aa6ff-907e-4be6-ae60-729733aef025-kube-api-access-bggp5\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:15.837627 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.837587    2578 generic.go:356] "Generic (PLEG): container finished" podID="a88aa6ff-907e-4be6-ae60-729733aef025" containerID="0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87" exitCode=0
Sep 11 20:00:15.837788 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.837639    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"
Sep 11 20:00:15.837788 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.837664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh" event={"ID":"a88aa6ff-907e-4be6-ae60-729733aef025","Type":"ContainerDied","Data":"0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87"}
Sep 11 20:00:15.837788 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.837749    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh" event={"ID":"a88aa6ff-907e-4be6-ae60-729733aef025","Type":"ContainerDied","Data":"ee7cefe7fa3e7f725448d32ea48f861115a18025348e75ab03ce67b02537ca8d"}
Sep 11 20:00:15.837788 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.837776    2578 scope.go:117] "RemoveContainer" containerID="0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87"
Sep 11 20:00:15.847976 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.847953    2578 scope.go:117] "RemoveContainer" containerID="0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87"
Sep 11 20:00:15.848248 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:00:15.848229    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87\": container with ID starting with 0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87 not found: ID does not exist" containerID="0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87"
Sep 11 20:00:15.848338 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.848282    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87"} err="failed to get container status \"0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87\": rpc error: code = NotFound desc = could not find container \"0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87\": container with ID starting with 0730d6aa8573aa9b45fd3229754fcca57bc3e09f9404800948e44889e5415b87 not found: ID does not exist"
Sep 11 20:00:15.862800 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.862776    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"]
Sep 11 20:00:15.866088 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:15.866068    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4b032e-79cfbdbf46-jjwfh"]
Sep 11 20:00:16.259111 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:16.258991    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a88aa6ff-907e-4be6-ae60-729733aef025" path="/var/lib/kubelet/pods/a88aa6ff-907e-4be6-ae60-729733aef025/volumes"
Sep 11 20:00:19.302127 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.302099    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"]
Sep 11 20:00:19.302641 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.302626    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a88aa6ff-907e-4be6-ae60-729733aef025" containerName="maas-api"
Sep 11 20:00:19.302698 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.302643    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a88aa6ff-907e-4be6-ae60-729733aef025" containerName="maas-api"
Sep 11 20:00:19.302734 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.302724    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a88aa6ff-907e-4be6-ae60-729733aef025" containerName="maas-api"
Sep 11 20:00:19.307232 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.307214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:19.309995 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.309971    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-b1a074-serving-cert\""
Sep 11 20:00:19.317657 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.317630    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"]
Sep 11 20:00:19.419081 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.419050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-metrics-certs\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:19.419253 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.419094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-maas-api-tls\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:19.419253 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.419139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7kkb\" (UniqueName: \"kubernetes.io/projected/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-kube-api-access-v7kkb\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:19.419253 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.419181    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-openshift-service-ca\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:19.520775 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.520740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-metrics-certs\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:19.520948 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.520784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-maas-api-tls\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:19.520948 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.520831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7kkb\" (UniqueName: \"kubernetes.io/projected/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-kube-api-access-v7kkb\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:19.520948 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.520863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-openshift-service-ca\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:19.521054 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:00:19.520971    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-serving-cert: secret "maas-api-e2e-api-b-b1a074-serving-cert" not found
Sep 11 20:00:19.521089 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:00:19.521059    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-maas-api-tls podName:d70fc8ee-0d49-488a-a94e-a7c4414ebd7c nodeName:}" failed. No retries permitted until 2026-09-11 20:00:20.021036446 +0000 UTC m=+1854.255109862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-maas-api-tls") pod "maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2" (UID: "d70fc8ee-0d49-488a-a94e-a7c4414ebd7c") : secret "maas-api-e2e-api-b-b1a074-serving-cert" not found
Sep 11 20:00:19.521560 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.521494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-openshift-service-ca\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:19.523444 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.523423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-metrics-certs\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:19.532136 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:19.532117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7kkb\" (UniqueName: \"kubernetes.io/projected/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-kube-api-access-v7kkb\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:20.026645 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:20.026612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-maas-api-tls\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:20.029466 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:20.029437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-maas-api-tls\") pod \"maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:20.220088 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:20.220058    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:20.531498 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:20.531460    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"]
Sep 11 20:00:20.533288 ip-10-0-139-38 kubenswrapper[2578]: W0911 20:00:20.533238    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70fc8ee_0d49_488a_a94e_a7c4414ebd7c.slice/crio-e36201915d934be6870ff8174b2619a74f02801974f7d6ce36b6a35aa8275fcf WatchSource:0}: Error finding container e36201915d934be6870ff8174b2619a74f02801974f7d6ce36b6a35aa8275fcf: Status 404 returned error can't find the container with id e36201915d934be6870ff8174b2619a74f02801974f7d6ce36b6a35aa8275fcf
Sep 11 20:00:20.871772 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:20.871739    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2" event={"ID":"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c","Type":"ContainerStarted","Data":"e36201915d934be6870ff8174b2619a74f02801974f7d6ce36b6a35aa8275fcf"}
Sep 11 20:00:21.510081 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.509899    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l" podUID="a655538b-e97a-4f48-bff2-ab99032b03f4" containerName="main" containerID="cri-o://b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0" gracePeriod=45
Sep 11 20:00:21.833539 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.833509    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 20:00:21.884792 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.884737    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2" event={"ID":"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c","Type":"ContainerStarted","Data":"18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be"}
Sep 11 20:00:21.884994 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.884823    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:21.886448 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.886419    2578 generic.go:356] "Generic (PLEG): container finished" podID="a655538b-e97a-4f48-bff2-ab99032b03f4" containerID="b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0" exitCode=0
Sep 11 20:00:21.886573 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.886474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l" event={"ID":"a655538b-e97a-4f48-bff2-ab99032b03f4","Type":"ContainerDied","Data":"b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0"}
Sep 11 20:00:21.886573 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.886518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l" event={"ID":"a655538b-e97a-4f48-bff2-ab99032b03f4","Type":"ContainerDied","Data":"e9808ca0adacb35ba2958841c16897ddfe16f4fcc472d1c2570b188d7620bf35"}
Sep 11 20:00:21.886573 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.886542    2578 scope.go:117] "RemoveContainer" containerID="b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0"
Sep 11 20:00:21.886573 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.886480    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"
Sep 11 20:00:21.899994 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.899967    2578 scope.go:117] "RemoveContainer" containerID="b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0"
Sep 11 20:00:21.900390 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:00:21.900364    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0\": container with ID starting with b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0 not found: ID does not exist" containerID="b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0"
Sep 11 20:00:21.900513 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.900404    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0"} err="failed to get container status \"b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0\": rpc error: code = NotFound desc = could not find container \"b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0\": container with ID starting with b5f083df5ec8d18c3427874ec8820876e83267cb08130744d9043de0ed0e6cd0 not found: ID does not exist"
Sep 11 20:00:21.904425 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.904368    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2" podStartSLOduration=2.561578461 podStartE2EDuration="2.904348926s" totalImagesPullingTime="342.770465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:00:21.902499165 +0000 UTC m=+1856.136572586" watchObservedRunningTime="2026-09-11 20:00:21.904348926 +0000 UTC m=+1856.138422365"
Sep 11 20:00:21.958047 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.958014    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-dshm\") pod \"a655538b-e97a-4f48-bff2-ab99032b03f4\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") "
Sep 11 20:00:21.958230 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.958067    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-model-cache\") pod \"a655538b-e97a-4f48-bff2-ab99032b03f4\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") "
Sep 11 20:00:21.958230 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.958120    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-tmp-dir\") pod \"a655538b-e97a-4f48-bff2-ab99032b03f4\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") "
Sep 11 20:00:21.958230 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.958217    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc876\" (UniqueName: \"kubernetes.io/projected/a655538b-e97a-4f48-bff2-ab99032b03f4-kube-api-access-wc876\") pod \"a655538b-e97a-4f48-bff2-ab99032b03f4\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") "
Sep 11 20:00:21.958444 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.958308    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-home\") pod \"a655538b-e97a-4f48-bff2-ab99032b03f4\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") "
Sep 11 20:00:21.958444 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.958346    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a655538b-e97a-4f48-bff2-ab99032b03f4-tls-certs\") pod \"a655538b-e97a-4f48-bff2-ab99032b03f4\" (UID: \"a655538b-e97a-4f48-bff2-ab99032b03f4\") "
Sep 11 20:00:21.958444 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.958421    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-model-cache" (OuterVolumeSpecName: "model-cache") pod "a655538b-e97a-4f48-bff2-ab99032b03f4" (UID: "a655538b-e97a-4f48-bff2-ab99032b03f4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:21.958605 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.958440    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a655538b-e97a-4f48-bff2-ab99032b03f4" (UID: "a655538b-e97a-4f48-bff2-ab99032b03f4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:21.958837 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.958704    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-home" (OuterVolumeSpecName: "home") pod "a655538b-e97a-4f48-bff2-ab99032b03f4" (UID: "a655538b-e97a-4f48-bff2-ab99032b03f4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:21.959453 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.959370    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-home\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:21.959453 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.959409    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-model-cache\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:21.959453 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.959424    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-tmp-dir\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:21.960841 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.960814    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-dshm" (OuterVolumeSpecName: "dshm") pod "a655538b-e97a-4f48-bff2-ab99032b03f4" (UID: "a655538b-e97a-4f48-bff2-ab99032b03f4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:21.961195 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.961174    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a655538b-e97a-4f48-bff2-ab99032b03f4-kube-api-access-wc876" (OuterVolumeSpecName: "kube-api-access-wc876") pod "a655538b-e97a-4f48-bff2-ab99032b03f4" (UID: "a655538b-e97a-4f48-bff2-ab99032b03f4"). InnerVolumeSpecName "kube-api-access-wc876". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:00:21.961368 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:21.961344    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a655538b-e97a-4f48-bff2-ab99032b03f4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a655538b-e97a-4f48-bff2-ab99032b03f4" (UID: "a655538b-e97a-4f48-bff2-ab99032b03f4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:00:22.060443 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:22.060346    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a655538b-e97a-4f48-bff2-ab99032b03f4-tls-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:22.060443 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:22.060377    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a655538b-e97a-4f48-bff2-ab99032b03f4-dshm\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:22.060443 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:22.060388    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc876\" (UniqueName: \"kubernetes.io/projected/a655538b-e97a-4f48-bff2-ab99032b03f4-kube-api-access-wc876\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:22.210465 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:22.210434    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"]
Sep 11 20:00:22.215296 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:22.215271    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-4b032e/distinct-w0-4b032e-kserve-6775587c-hv76l"]
Sep 11 20:00:22.258422 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:22.258396    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a655538b-e97a-4f48-bff2-ab99032b03f4" path="/var/lib/kubelet/pods/a655538b-e97a-4f48-bff2-ab99032b03f4/volumes"
Sep 11 20:00:22.944282 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:22.944238    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"]
Sep 11 20:00:22.944667 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:22.944452    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy" containerID="cri-o://10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a" gracePeriod=30
Sep 11 20:00:27.901964 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:27.901932    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:00:28.712579 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.712556    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 20:00:28.832275 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832228    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-podinfo\") pod \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") "
Sep 11 20:00:28.832452 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832344    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-data\") pod \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") "
Sep 11 20:00:28.832452 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832366    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-certs\") pod \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") "
Sep 11 20:00:28.832452 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832400    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-token\") pod \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") "
Sep 11 20:00:28.832699 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832462    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-envoy\") pod \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") "
Sep 11 20:00:28.832699 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832511    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-credential-socket\") pod \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") "
Sep 11 20:00:28.832699 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832560    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istiod-ca-cert\") pod \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") "
Sep 11 20:00:28.832699 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832599    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-socket\") pod \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") "
Sep 11 20:00:28.832699 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832625    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flqsj\" (UniqueName: \"kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-kube-api-access-flqsj\") pod \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\" (UID: \"273e9337-5ab2-42c3-b053-033dcc6e4ac5\") "
Sep 11 20:00:28.832699 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832679    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-data" (OuterVolumeSpecName: "istio-data") pod "273e9337-5ab2-42c3-b053-033dcc6e4ac5" (UID: "273e9337-5ab2-42c3-b053-033dcc6e4ac5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:28.832699 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832696    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "273e9337-5ab2-42c3-b053-033dcc6e4ac5" (UID: "273e9337-5ab2-42c3-b053-033dcc6e4ac5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:28.833068 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832829    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "273e9337-5ab2-42c3-b053-033dcc6e4ac5" (UID: "273e9337-5ab2-42c3-b053-033dcc6e4ac5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:28.833068 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832894    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "273e9337-5ab2-42c3-b053-033dcc6e4ac5" (UID: "273e9337-5ab2-42c3-b053-033dcc6e4ac5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:28.833068 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.832956    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "273e9337-5ab2-42c3-b053-033dcc6e4ac5" (UID: "273e9337-5ab2-42c3-b053-033dcc6e4ac5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:00:28.833068 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.833042    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-data\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:28.833068 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.833061    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:28.833068 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.833074    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-credential-socket\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:28.833580 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.833083    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-workload-socket\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:28.834923 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.834897    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "273e9337-5ab2-42c3-b053-033dcc6e4ac5" (UID: "273e9337-5ab2-42c3-b053-033dcc6e4ac5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:28.835006 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.834948    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "273e9337-5ab2-42c3-b053-033dcc6e4ac5" (UID: "273e9337-5ab2-42c3-b053-033dcc6e4ac5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:00:28.835006 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.834995    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-token" (OuterVolumeSpecName: "istio-token") pod "273e9337-5ab2-42c3-b053-033dcc6e4ac5" (UID: "273e9337-5ab2-42c3-b053-033dcc6e4ac5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:00:28.835081 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.835005    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-kube-api-access-flqsj" (OuterVolumeSpecName: "kube-api-access-flqsj") pod "273e9337-5ab2-42c3-b053-033dcc6e4ac5" (UID: "273e9337-5ab2-42c3-b053-033dcc6e4ac5"). InnerVolumeSpecName "kube-api-access-flqsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:00:28.933698 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.933665    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istiod-ca-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:28.933698 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.933690    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flqsj\" (UniqueName: \"kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-kube-api-access-flqsj\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:28.933698 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.933701    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-podinfo\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:28.933698 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.933710    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-token\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:28.934183 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.933717    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/273e9337-5ab2-42c3-b053-033dcc6e4ac5-istio-envoy\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:00:28.934183 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.934086    2578 generic.go:356] "Generic (PLEG): container finished" podID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerID="10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a" exitCode=0
Sep 11 20:00:28.934183 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.934141    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"
Sep 11 20:00:28.934347 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.934178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" event={"ID":"273e9337-5ab2-42c3-b053-033dcc6e4ac5","Type":"ContainerDied","Data":"10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a"}
Sep 11 20:00:28.934347 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.934244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z" event={"ID":"273e9337-5ab2-42c3-b053-033dcc6e4ac5","Type":"ContainerDied","Data":"f45934a712b080d123df005714b54ea516d88546deee4d2f603bbc0a1a281fa3"}
Sep 11 20:00:28.934347 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.934284    2578 scope.go:117] "RemoveContainer" containerID="10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a"
Sep 11 20:00:28.944226 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.944209    2578 scope.go:117] "RemoveContainer" containerID="914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac"
Sep 11 20:00:28.953150 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.953127    2578 scope.go:117] "RemoveContainer" containerID="10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a"
Sep 11 20:00:28.953514 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:00:28.953495    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a\": container with ID starting with 10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a not found: ID does not exist" containerID="10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a"
Sep 11 20:00:28.953569 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.953522    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a"} err="failed to get container status \"10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a\": rpc error: code = NotFound desc = could not find container \"10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a\": container with ID starting with 10fc31249532c8743dce5d89e885859cb14846af38220087a48f859b4e3c1c3a not found: ID does not exist"
Sep 11 20:00:28.953569 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.953540    2578 scope.go:117] "RemoveContainer" containerID="914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac"
Sep 11 20:00:28.953800 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:00:28.953784    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac\": container with ID starting with 914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac not found: ID does not exist" containerID="914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac"
Sep 11 20:00:28.953852 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.953804    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac"} err="failed to get container status \"914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac\": rpc error: code = NotFound desc = could not find container \"914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac\": container with ID starting with 914fe4ceea04a7a8844ba538c7b4ee82e437a6e84f073afb5ab671411f2ea9ac not found: ID does not exist"
Sep 11 20:00:28.959112 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.959090    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"]
Sep 11 20:00:28.965800 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:28.965778    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z"]
Sep 11 20:00:30.258826 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:00:30.258794    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" path="/var/lib/kubelet/pods/273e9337-5ab2-42c3-b053-033dcc6e4ac5/volumes"
Sep 11 20:01:02.430284 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.430230    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"]
Sep 11 20:01:02.430853 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.430458    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4" podUID="ed728c08-26fb-44d9-ae79-229901b95603" containerName="maas-api" containerID="cri-o://8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df" gracePeriod=30
Sep 11 20:01:02.698744 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.698663    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 20:01:02.788534 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.788501    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x24d7\" (UniqueName: \"kubernetes.io/projected/ed728c08-26fb-44d9-ae79-229901b95603-kube-api-access-x24d7\") pod \"ed728c08-26fb-44d9-ae79-229901b95603\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") "
Sep 11 20:01:02.788736 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.788704    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-metrics-certs\") pod \"ed728c08-26fb-44d9-ae79-229901b95603\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") "
Sep 11 20:01:02.788800 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.788738    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed728c08-26fb-44d9-ae79-229901b95603-openshift-service-ca\") pod \"ed728c08-26fb-44d9-ae79-229901b95603\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") "
Sep 11 20:01:02.788800 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.788771    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-maas-api-tls\") pod \"ed728c08-26fb-44d9-ae79-229901b95603\" (UID: \"ed728c08-26fb-44d9-ae79-229901b95603\") "
Sep 11 20:01:02.789346 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.789293    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed728c08-26fb-44d9-ae79-229901b95603-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed728c08-26fb-44d9-ae79-229901b95603" (UID: "ed728c08-26fb-44d9-ae79-229901b95603"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:01:02.791720 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.791682    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed728c08-26fb-44d9-ae79-229901b95603" (UID: "ed728c08-26fb-44d9-ae79-229901b95603"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:01:02.792058 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.792035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed728c08-26fb-44d9-ae79-229901b95603-kube-api-access-x24d7" (OuterVolumeSpecName: "kube-api-access-x24d7") pod "ed728c08-26fb-44d9-ae79-229901b95603" (UID: "ed728c08-26fb-44d9-ae79-229901b95603"). InnerVolumeSpecName "kube-api-access-x24d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:01:02.794639 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.794620    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ed728c08-26fb-44d9-ae79-229901b95603" (UID: "ed728c08-26fb-44d9-ae79-229901b95603"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:01:02.890383 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.890344    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:02.890383 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.890385    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed728c08-26fb-44d9-ae79-229901b95603-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:02.890612 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.890427    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed728c08-26fb-44d9-ae79-229901b95603-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:02.890612 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:02.890444    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x24d7\" (UniqueName: \"kubernetes.io/projected/ed728c08-26fb-44d9-ae79-229901b95603-kube-api-access-x24d7\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:03.138019 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:03.137978    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed728c08-26fb-44d9-ae79-229901b95603" containerID="8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df" exitCode=0
Sep 11 20:01:03.138213 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:03.138036    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"
Sep 11 20:01:03.138213 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:03.138062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4" event={"ID":"ed728c08-26fb-44d9-ae79-229901b95603","Type":"ContainerDied","Data":"8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df"}
Sep 11 20:01:03.138213 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:03.138137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4" event={"ID":"ed728c08-26fb-44d9-ae79-229901b95603","Type":"ContainerDied","Data":"6a2a90dd899f1ef70fe750b1d0cb0b655f9aa322311d8a8c35998d2c6b77c9e3"}
Sep 11 20:01:03.138213 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:03.138160    2578 scope.go:117] "RemoveContainer" containerID="8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df"
Sep 11 20:01:03.148582 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:03.148563    2578 scope.go:117] "RemoveContainer" containerID="8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df"
Sep 11 20:01:03.148887 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:01:03.148860    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df\": container with ID starting with 8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df not found: ID does not exist" containerID="8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df"
Sep 11 20:01:03.148984 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:03.148895    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df"} err="failed to get container status \"8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df\": rpc error: code = NotFound desc = could not find container \"8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df\": container with ID starting with 8cd3acac51107621fec75d2183f417d37d249333b6261799c48f9cbe9bff11df not found: ID does not exist"
Sep 11 20:01:03.163121 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:03.163099    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"]
Sep 11 20:01:03.167404 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:03.167382    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e7cdd6-6d8cc5d7d7-xhjq4"]
Sep 11 20:01:04.257968 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:04.257936    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed728c08-26fb-44d9-ae79-229901b95603" path="/var/lib/kubelet/pods/ed728c08-26fb-44d9-ae79-229901b95603/volumes"
Sep 11 20:01:22.228852 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:22.228818    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"]
Sep 11 20:01:25.278868 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.278839    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"]
Sep 11 20:01:25.279365 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.279106    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2" podUID="d70fc8ee-0d49-488a-a94e-a7c4414ebd7c" containerName="maas-api" containerID="cri-o://18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be" gracePeriod=30
Sep 11 20:01:25.543577 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.543518    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:01:25.633961 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.633922    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-metrics-certs\") pod \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") "
Sep 11 20:01:25.634156 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.633978    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-openshift-service-ca\") pod \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") "
Sep 11 20:01:25.634156 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.634081    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-maas-api-tls\") pod \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") "
Sep 11 20:01:25.634156 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.634127    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7kkb\" (UniqueName: \"kubernetes.io/projected/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-kube-api-access-v7kkb\") pod \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\" (UID: \"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c\") "
Sep 11 20:01:25.634377 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.634348    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d70fc8ee-0d49-488a-a94e-a7c4414ebd7c" (UID: "d70fc8ee-0d49-488a-a94e-a7c4414ebd7c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:01:25.634455 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.634435    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:25.636343 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.636312    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d70fc8ee-0d49-488a-a94e-a7c4414ebd7c" (UID: "d70fc8ee-0d49-488a-a94e-a7c4414ebd7c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:01:25.636440 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.636349    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d70fc8ee-0d49-488a-a94e-a7c4414ebd7c" (UID: "d70fc8ee-0d49-488a-a94e-a7c4414ebd7c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:01:25.636440 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.636369    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-kube-api-access-v7kkb" (OuterVolumeSpecName: "kube-api-access-v7kkb") pod "d70fc8ee-0d49-488a-a94e-a7c4414ebd7c" (UID: "d70fc8ee-0d49-488a-a94e-a7c4414ebd7c"). InnerVolumeSpecName "kube-api-access-v7kkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:01:25.735001 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.734965    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:25.735001 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.734994    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7kkb\" (UniqueName: \"kubernetes.io/projected/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-kube-api-access-v7kkb\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:25.735001 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:25.735005    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:26.279393 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:26.279354    2578 generic.go:356] "Generic (PLEG): container finished" podID="d70fc8ee-0d49-488a-a94e-a7c4414ebd7c" containerID="18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be" exitCode=0
Sep 11 20:01:26.279788 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:26.279414    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"
Sep 11 20:01:26.279788 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:26.279443    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2" event={"ID":"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c","Type":"ContainerDied","Data":"18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be"}
Sep 11 20:01:26.279788 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:26.279491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2" event={"ID":"d70fc8ee-0d49-488a-a94e-a7c4414ebd7c","Type":"ContainerDied","Data":"e36201915d934be6870ff8174b2619a74f02801974f7d6ce36b6a35aa8275fcf"}
Sep 11 20:01:26.279788 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:26.279512    2578 scope.go:117] "RemoveContainer" containerID="18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be"
Sep 11 20:01:26.289454 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:26.289427    2578 scope.go:117] "RemoveContainer" containerID="18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be"
Sep 11 20:01:26.289815 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:01:26.289788    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be\": container with ID starting with 18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be not found: ID does not exist" containerID="18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be"
Sep 11 20:01:26.289898 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:26.289821    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be"} err="failed to get container status \"18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be\": rpc error: code = NotFound desc = could not find container \"18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be\": container with ID starting with 18eaf639ac344f13fb589eb14821683df886c86dbd22ca845dfe6645f13e97be not found: ID does not exist"
Sep 11 20:01:26.299462 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:26.299437    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"]
Sep 11 20:01:26.303494 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:26.303471    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b1a074-8b5c57676-ggpt2"]
Sep 11 20:01:28.258538 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:28.258507    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d70fc8ee-0d49-488a-a94e-a7c4414ebd7c" path="/var/lib/kubelet/pods/d70fc8ee-0d49-488a-a94e-a7c4414ebd7c/volumes"
Sep 11 20:01:33.673880 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:33.673831    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"]
Sep 11 20:01:33.674405 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:33.674107    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b" podUID="1e04a092-67d4-4574-bfb0-0e43b603d396" containerName="maas-api" containerID="cri-o://433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d" gracePeriod=30
Sep 11 20:01:34.130174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.130149    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 20:01:34.227736 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.227648    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq5qb\" (UniqueName: \"kubernetes.io/projected/1e04a092-67d4-4574-bfb0-0e43b603d396-kube-api-access-vq5qb\") pod \"1e04a092-67d4-4574-bfb0-0e43b603d396\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") "
Sep 11 20:01:34.227736 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.227726    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-metrics-certs\") pod \"1e04a092-67d4-4574-bfb0-0e43b603d396\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") "
Sep 11 20:01:34.227977 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.227827    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-maas-api-tls\") pod \"1e04a092-67d4-4574-bfb0-0e43b603d396\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") "
Sep 11 20:01:34.227977 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.227915    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e04a092-67d4-4574-bfb0-0e43b603d396-openshift-service-ca\") pod \"1e04a092-67d4-4574-bfb0-0e43b603d396\" (UID: \"1e04a092-67d4-4574-bfb0-0e43b603d396\") "
Sep 11 20:01:34.228248 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.228222    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e04a092-67d4-4574-bfb0-0e43b603d396-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e04a092-67d4-4574-bfb0-0e43b603d396" (UID: "1e04a092-67d4-4574-bfb0-0e43b603d396"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:01:34.229926 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.229902    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1e04a092-67d4-4574-bfb0-0e43b603d396" (UID: "1e04a092-67d4-4574-bfb0-0e43b603d396"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:01:34.230020 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.229947    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e04a092-67d4-4574-bfb0-0e43b603d396-kube-api-access-vq5qb" (OuterVolumeSpecName: "kube-api-access-vq5qb") pod "1e04a092-67d4-4574-bfb0-0e43b603d396" (UID: "1e04a092-67d4-4574-bfb0-0e43b603d396"). InnerVolumeSpecName "kube-api-access-vq5qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:01:34.230097 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.230033    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e04a092-67d4-4574-bfb0-0e43b603d396" (UID: "1e04a092-67d4-4574-bfb0-0e43b603d396"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:01:34.328927 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.328895    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:34.328927 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.328918    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e04a092-67d4-4574-bfb0-0e43b603d396-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:34.328927 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.328929    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e04a092-67d4-4574-bfb0-0e43b603d396-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:34.328927 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.328937    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq5qb\" (UniqueName: \"kubernetes.io/projected/1e04a092-67d4-4574-bfb0-0e43b603d396-kube-api-access-vq5qb\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:34.335517 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.335490    2578 generic.go:356] "Generic (PLEG): container finished" podID="1e04a092-67d4-4574-bfb0-0e43b603d396" containerID="433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d" exitCode=0
Sep 11 20:01:34.335664 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.335543    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"
Sep 11 20:01:34.335664 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.335571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b" event={"ID":"1e04a092-67d4-4574-bfb0-0e43b603d396","Type":"ContainerDied","Data":"433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d"}
Sep 11 20:01:34.335664 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.335623    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b" event={"ID":"1e04a092-67d4-4574-bfb0-0e43b603d396","Type":"ContainerDied","Data":"88f655bbdc39e0f2c3dad6974b271c895476f7f907818cab350143f886c1eb19"}
Sep 11 20:01:34.335664 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.335644    2578 scope.go:117] "RemoveContainer" containerID="433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d"
Sep 11 20:01:34.344953 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.344939    2578 scope.go:117] "RemoveContainer" containerID="433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d"
Sep 11 20:01:34.345221 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:01:34.345205    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d\": container with ID starting with 433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d not found: ID does not exist" containerID="433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d"
Sep 11 20:01:34.345288 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.345230    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d"} err="failed to get container status \"433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d\": rpc error: code = NotFound desc = could not find container \"433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d\": container with ID starting with 433ad6d461ce8431d57a399063d1f8804f8ac6499f10392e16f9fb66cc69665d not found: ID does not exist"
Sep 11 20:01:34.351902 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.351882    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"]
Sep 11 20:01:34.355959 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:34.355938    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a8ee95-6f8d68cbc5-sq84b"]
Sep 11 20:01:36.259277 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:36.259236    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e04a092-67d4-4574-bfb0-0e43b603d396" path="/var/lib/kubelet/pods/1e04a092-67d4-4574-bfb0-0e43b603d396/volumes"
Sep 11 20:01:37.249501 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.249444    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n" podUID="64400a76-70bb-4801-9936-8cd5d7f49214" containerName="main" containerID="cri-o://a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6" gracePeriod=45
Sep 11 20:01:37.513641 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.513577    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 20:01:37.664078 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664044    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-dshm\") pod \"64400a76-70bb-4801-9936-8cd5d7f49214\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") "
Sep 11 20:01:37.664246 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664090    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlt2g\" (UniqueName: \"kubernetes.io/projected/64400a76-70bb-4801-9936-8cd5d7f49214-kube-api-access-rlt2g\") pod \"64400a76-70bb-4801-9936-8cd5d7f49214\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") "
Sep 11 20:01:37.664246 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664112    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-home\") pod \"64400a76-70bb-4801-9936-8cd5d7f49214\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") "
Sep 11 20:01:37.664246 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664175    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-tmp-dir\") pod \"64400a76-70bb-4801-9936-8cd5d7f49214\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") "
Sep 11 20:01:37.664246 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664236    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-model-cache\") pod \"64400a76-70bb-4801-9936-8cd5d7f49214\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") "
Sep 11 20:01:37.664453 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664320    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64400a76-70bb-4801-9936-8cd5d7f49214-tls-certs\") pod \"64400a76-70bb-4801-9936-8cd5d7f49214\" (UID: \"64400a76-70bb-4801-9936-8cd5d7f49214\") "
Sep 11 20:01:37.664505 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664483    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-home" (OuterVolumeSpecName: "home") pod "64400a76-70bb-4801-9936-8cd5d7f49214" (UID: "64400a76-70bb-4801-9936-8cd5d7f49214"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:01:37.664562 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664512    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "64400a76-70bb-4801-9936-8cd5d7f49214" (UID: "64400a76-70bb-4801-9936-8cd5d7f49214"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:01:37.664841 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664587    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-model-cache" (OuterVolumeSpecName: "model-cache") pod "64400a76-70bb-4801-9936-8cd5d7f49214" (UID: "64400a76-70bb-4801-9936-8cd5d7f49214"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:01:37.664841 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664755    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-home\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:37.664978 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664963    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-tmp-dir\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:37.665035 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.664978    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-model-cache\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:37.666531 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.666502    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64400a76-70bb-4801-9936-8cd5d7f49214-kube-api-access-rlt2g" (OuterVolumeSpecName: "kube-api-access-rlt2g") pod "64400a76-70bb-4801-9936-8cd5d7f49214" (UID: "64400a76-70bb-4801-9936-8cd5d7f49214"). InnerVolumeSpecName "kube-api-access-rlt2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:01:37.666910 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.666875    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-dshm" (OuterVolumeSpecName: "dshm") pod "64400a76-70bb-4801-9936-8cd5d7f49214" (UID: "64400a76-70bb-4801-9936-8cd5d7f49214"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:01:37.666910 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.666878    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64400a76-70bb-4801-9936-8cd5d7f49214-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "64400a76-70bb-4801-9936-8cd5d7f49214" (UID: "64400a76-70bb-4801-9936-8cd5d7f49214"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:01:37.766326 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.766225    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64400a76-70bb-4801-9936-8cd5d7f49214-tls-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:37.766326 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.766283    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64400a76-70bb-4801-9936-8cd5d7f49214-dshm\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:37.766326 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:37.766295    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlt2g\" (UniqueName: \"kubernetes.io/projected/64400a76-70bb-4801-9936-8cd5d7f49214-kube-api-access-rlt2g\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:38.360925 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:38.360892    2578 generic.go:356] "Generic (PLEG): container finished" podID="64400a76-70bb-4801-9936-8cd5d7f49214" containerID="a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6" exitCode=0
Sep 11 20:01:38.361128 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:38.360934    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"
Sep 11 20:01:38.361128 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:38.360935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n" event={"ID":"64400a76-70bb-4801-9936-8cd5d7f49214","Type":"ContainerDied","Data":"a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6"}
Sep 11 20:01:38.361128 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:38.361064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n" event={"ID":"64400a76-70bb-4801-9936-8cd5d7f49214","Type":"ContainerDied","Data":"8221e54dc92c3e2c443d3801b477e48355a0f09e3f2c47417caebfb306839569"}
Sep 11 20:01:38.361128 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:38.361088    2578 scope.go:117] "RemoveContainer" containerID="a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6"
Sep 11 20:01:38.370558 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:38.370536    2578 scope.go:117] "RemoveContainer" containerID="a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6"
Sep 11 20:01:38.370894 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:01:38.370860    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6\": container with ID starting with a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6 not found: ID does not exist" containerID="a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6"
Sep 11 20:01:38.370974 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:38.370912    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6"} err="failed to get container status \"a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6\": rpc error: code = NotFound desc = could not find container \"a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6\": container with ID starting with a329a708f2b4dc8ed88b24f5c38fc99738ab677ca4f082fb113b4e107c485ef6 not found: ID does not exist"
Sep 11 20:01:38.378476 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:38.378455    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"]
Sep 11 20:01:38.386894 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:38.386862    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-a8ee95/distinct-2-w4-a8ee95-kserve-6fd655d54f-6zx6n"]
Sep 11 20:01:40.258944 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:40.258862    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64400a76-70bb-4801-9936-8cd5d7f49214" path="/var/lib/kubelet/pods/64400a76-70bb-4801-9936-8cd5d7f49214/volumes"
Sep 11 20:01:43.052847 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.052815    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"]
Sep 11 20:01:43.053334 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.053065    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz" podUID="3814bba3-2869-4672-b099-a25e90d2d1fb" containerName="maas-api" containerID="cri-o://dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef" gracePeriod=30
Sep 11 20:01:43.313645 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.313623    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 20:01:43.392528 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.392490    2578 generic.go:356] "Generic (PLEG): container finished" podID="3814bba3-2869-4672-b099-a25e90d2d1fb" containerID="dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef" exitCode=0
Sep 11 20:01:43.392730 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.392565    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"
Sep 11 20:01:43.392730 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.392575    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz" event={"ID":"3814bba3-2869-4672-b099-a25e90d2d1fb","Type":"ContainerDied","Data":"dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef"}
Sep 11 20:01:43.392730 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.392670    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz" event={"ID":"3814bba3-2869-4672-b099-a25e90d2d1fb","Type":"ContainerDied","Data":"54bf0ff060bd86eaecc769ac26bae26b3046c22893f377204d62fc24db586eb6"}
Sep 11 20:01:43.392915 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.392734    2578 scope.go:117] "RemoveContainer" containerID="dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef"
Sep 11 20:01:43.403165 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.403146    2578 scope.go:117] "RemoveContainer" containerID="dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef"
Sep 11 20:01:43.403510 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:01:43.403479    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef\": container with ID starting with dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef not found: ID does not exist" containerID="dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef"
Sep 11 20:01:43.403649 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.403510    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef"} err="failed to get container status \"dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef\": rpc error: code = NotFound desc = could not find container \"dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef\": container with ID starting with dee5a180a730c3c9488357b94a647d3bfdf2852870b573f1a09f51851a7f86ef not found: ID does not exist"
Sep 11 20:01:43.418886 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.418843    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-metrics-certs\") pod \"3814bba3-2869-4672-b099-a25e90d2d1fb\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") "
Sep 11 20:01:43.419022 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.418967    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-maas-api-tls\") pod \"3814bba3-2869-4672-b099-a25e90d2d1fb\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") "
Sep 11 20:01:43.419094 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.419022    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdgkz\" (UniqueName: \"kubernetes.io/projected/3814bba3-2869-4672-b099-a25e90d2d1fb-kube-api-access-mdgkz\") pod \"3814bba3-2869-4672-b099-a25e90d2d1fb\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") "
Sep 11 20:01:43.419158 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.419125    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3814bba3-2869-4672-b099-a25e90d2d1fb-openshift-service-ca\") pod \"3814bba3-2869-4672-b099-a25e90d2d1fb\" (UID: \"3814bba3-2869-4672-b099-a25e90d2d1fb\") "
Sep 11 20:01:43.419850 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.419533    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3814bba3-2869-4672-b099-a25e90d2d1fb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3814bba3-2869-4672-b099-a25e90d2d1fb" (UID: "3814bba3-2869-4672-b099-a25e90d2d1fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:01:43.421703 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.421678    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3814bba3-2869-4672-b099-a25e90d2d1fb" (UID: "3814bba3-2869-4672-b099-a25e90d2d1fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:01:43.421795 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.421699    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3814bba3-2869-4672-b099-a25e90d2d1fb" (UID: "3814bba3-2869-4672-b099-a25e90d2d1fb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:01:43.421795 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.421723    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3814bba3-2869-4672-b099-a25e90d2d1fb-kube-api-access-mdgkz" (OuterVolumeSpecName: "kube-api-access-mdgkz") pod "3814bba3-2869-4672-b099-a25e90d2d1fb" (UID: "3814bba3-2869-4672-b099-a25e90d2d1fb"). InnerVolumeSpecName "kube-api-access-mdgkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:01:43.520352 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.520312    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:43.520352 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.520346    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdgkz\" (UniqueName: \"kubernetes.io/projected/3814bba3-2869-4672-b099-a25e90d2d1fb-kube-api-access-mdgkz\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:43.520565 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.520361    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3814bba3-2869-4672-b099-a25e90d2d1fb-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:43.520565 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.520373    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3814bba3-2869-4672-b099-a25e90d2d1fb-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:01:43.718435 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.718409    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"]
Sep 11 20:01:43.722706 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:43.722683    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e8cfcf-978dc8554-2q8dz"]
Sep 11 20:01:44.258800 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:01:44.258767    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3814bba3-2869-4672-b099-a25e90d2d1fb" path="/var/lib/kubelet/pods/3814bba3-2869-4672-b099-a25e90d2d1fb/volumes"
Sep 11 20:02:00.455742 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.455707    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"]
Sep 11 20:02:00.457114 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.457043    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65" podUID="0e693e03-b69b-43db-ba21-651eb5bab081" containerName="maas-api" containerID="cri-o://36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd" gracePeriod=30
Sep 11 20:02:00.725693 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.725668    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 20:02:00.790662 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.789428    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-metrics-certs\") pod \"0e693e03-b69b-43db-ba21-651eb5bab081\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") "
Sep 11 20:02:00.790662 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.789477    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-maas-api-tls\") pod \"0e693e03-b69b-43db-ba21-651eb5bab081\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") "
Sep 11 20:02:00.790662 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.789541    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e693e03-b69b-43db-ba21-651eb5bab081-openshift-service-ca\") pod \"0e693e03-b69b-43db-ba21-651eb5bab081\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") "
Sep 11 20:02:00.790662 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.789611    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvrrb\" (UniqueName: \"kubernetes.io/projected/0e693e03-b69b-43db-ba21-651eb5bab081-kube-api-access-bvrrb\") pod \"0e693e03-b69b-43db-ba21-651eb5bab081\" (UID: \"0e693e03-b69b-43db-ba21-651eb5bab081\") "
Sep 11 20:02:00.791334 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.791253    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e693e03-b69b-43db-ba21-651eb5bab081-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e693e03-b69b-43db-ba21-651eb5bab081" (UID: "0e693e03-b69b-43db-ba21-651eb5bab081"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:02:00.793798 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.793766    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0e693e03-b69b-43db-ba21-651eb5bab081" (UID: "0e693e03-b69b-43db-ba21-651eb5bab081"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:02:00.795686 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.795644    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e693e03-b69b-43db-ba21-651eb5bab081" (UID: "0e693e03-b69b-43db-ba21-651eb5bab081"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:02:00.796761 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.796739    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e693e03-b69b-43db-ba21-651eb5bab081-kube-api-access-bvrrb" (OuterVolumeSpecName: "kube-api-access-bvrrb") pod "0e693e03-b69b-43db-ba21-651eb5bab081" (UID: "0e693e03-b69b-43db-ba21-651eb5bab081"). InnerVolumeSpecName "kube-api-access-bvrrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:02:00.891601 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.891559    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e693e03-b69b-43db-ba21-651eb5bab081-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:02:00.891601 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.891599    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvrrb\" (UniqueName: \"kubernetes.io/projected/0e693e03-b69b-43db-ba21-651eb5bab081-kube-api-access-bvrrb\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:02:00.891775 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.891614    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:02:00.891775 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:00.891626    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e693e03-b69b-43db-ba21-651eb5bab081-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:02:01.497584 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:01.497547    2578 generic.go:356] "Generic (PLEG): container finished" podID="0e693e03-b69b-43db-ba21-651eb5bab081" containerID="36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd" exitCode=0
Sep 11 20:02:01.498071 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:01.497590    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"
Sep 11 20:02:01.498071 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:01.497599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65" event={"ID":"0e693e03-b69b-43db-ba21-651eb5bab081","Type":"ContainerDied","Data":"36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd"}
Sep 11 20:02:01.498071 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:01.497639    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65" event={"ID":"0e693e03-b69b-43db-ba21-651eb5bab081","Type":"ContainerDied","Data":"6993c25e8415d24dd3052e874ba887a0f95462046b1fd82be5a08240a7708f20"}
Sep 11 20:02:01.498071 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:01.497660    2578 scope.go:117] "RemoveContainer" containerID="36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd"
Sep 11 20:02:01.508578 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:01.508560    2578 scope.go:117] "RemoveContainer" containerID="36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd"
Sep 11 20:02:01.508861 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:02:01.508841    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd\": container with ID starting with 36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd not found: ID does not exist" containerID="36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd"
Sep 11 20:02:01.508918 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:01.508871    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd"} err="failed to get container status \"36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd\": rpc error: code = NotFound desc = could not find container \"36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd\": container with ID starting with 36a4eb2903b30a0042593a8704f6983c61276f00fa20cf789f92597292c330bd not found: ID does not exist"
Sep 11 20:02:01.521417 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:01.521393    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"]
Sep 11 20:02:01.525467 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:01.525444    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f7fd24-67c55764bc-t2g65"]
Sep 11 20:02:02.262285 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:02:02.260089    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e693e03-b69b-43db-ba21-651eb5bab081" path="/var/lib/kubelet/pods/0e693e03-b69b-43db-ba21-651eb5bab081/volumes"
Sep 11 20:03:27.463010 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.462974    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7500-8a407e"]
Sep 11 20:03:27.463459 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463429    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d70fc8ee-0d49-488a-a94e-a7c4414ebd7c" containerName="maas-api"
Sep 11 20:03:27.463459 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463441    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d70fc8ee-0d49-488a-a94e-a7c4414ebd7c" containerName="maas-api"
Sep 11 20:03:27.463532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463466    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64400a76-70bb-4801-9936-8cd5d7f49214" containerName="main"
Sep 11 20:03:27.463532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463471    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64400a76-70bb-4801-9936-8cd5d7f49214" containerName="main"
Sep 11 20:03:27.463532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463479    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed728c08-26fb-44d9-ae79-229901b95603" containerName="maas-api"
Sep 11 20:03:27.463532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463485    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed728c08-26fb-44d9-ae79-229901b95603" containerName="maas-api"
Sep 11 20:03:27.463532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463495    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e04a092-67d4-4574-bfb0-0e43b603d396" containerName="maas-api"
Sep 11 20:03:27.463532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463500    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e04a092-67d4-4574-bfb0-0e43b603d396" containerName="maas-api"
Sep 11 20:03:27.463532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463506    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy"
Sep 11 20:03:27.463532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463512    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy"
Sep 11 20:03:27.463532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463518    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a655538b-e97a-4f48-bff2-ab99032b03f4" containerName="main"
Sep 11 20:03:27.463532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463523    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a655538b-e97a-4f48-bff2-ab99032b03f4" containerName="main"
Sep 11 20:03:27.463532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463533    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463538    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463545    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e693e03-b69b-43db-ba21-651eb5bab081" containerName="maas-api"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463550    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e693e03-b69b-43db-ba21-651eb5bab081" containerName="maas-api"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463558    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3814bba3-2869-4672-b099-a25e90d2d1fb" containerName="maas-api"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463563    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3814bba3-2869-4672-b099-a25e90d2d1fb" containerName="maas-api"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463619    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3814bba3-2869-4672-b099-a25e90d2d1fb" containerName="maas-api"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463629    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463635    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a655538b-e97a-4f48-bff2-ab99032b03f4" containerName="main"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463639    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e693e03-b69b-43db-ba21-651eb5bab081" containerName="maas-api"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463644    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64400a76-70bb-4801-9936-8cd5d7f49214" containerName="main"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463651    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e04a092-67d4-4574-bfb0-0e43b603d396" containerName="maas-api"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463657    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d70fc8ee-0d49-488a-a94e-a7c4414ebd7c" containerName="maas-api"
Sep 11 20:03:27.463866 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.463662    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed728c08-26fb-44d9-ae79-229901b95603" containerName="maas-api"
Sep 11 20:03:27.466831 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.466816    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7500-8a407e"
Sep 11 20:03:27.469353 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.469332    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-76rlb\""
Sep 11 20:03:27.472583 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.472553    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7500-8a407e"]
Sep 11 20:03:27.620534 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.620499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9jl\" (UniqueName: \"kubernetes.io/projected/71c90eda-0a8d-4d5a-903f-daba8f9471a2-kube-api-access-6l9jl\") pod \"test-curl-7500-8a407e\" (UID: \"71c90eda-0a8d-4d5a-903f-daba8f9471a2\") " pod="opendatahub/test-curl-7500-8a407e"
Sep 11 20:03:27.721858 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.721766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9jl\" (UniqueName: \"kubernetes.io/projected/71c90eda-0a8d-4d5a-903f-daba8f9471a2-kube-api-access-6l9jl\") pod \"test-curl-7500-8a407e\" (UID: \"71c90eda-0a8d-4d5a-903f-daba8f9471a2\") " pod="opendatahub/test-curl-7500-8a407e"
Sep 11 20:03:27.729512 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.729478    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9jl\" (UniqueName: \"kubernetes.io/projected/71c90eda-0a8d-4d5a-903f-daba8f9471a2-kube-api-access-6l9jl\") pod \"test-curl-7500-8a407e\" (UID: \"71c90eda-0a8d-4d5a-903f-daba8f9471a2\") " pod="opendatahub/test-curl-7500-8a407e"
Sep 11 20:03:27.777647 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:27.777617    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7500-8a407e"
Sep 11 20:03:28.050185 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:28.050159    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7500-8a407e"]
Sep 11 20:03:28.052428 ip-10-0-139-38 kubenswrapper[2578]: W0911 20:03:28.052397    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71c90eda_0a8d_4d5a_903f_daba8f9471a2.slice/crio-557cc0756088beb804343e31ac4bcc0b2780735b4f6f8cc892960d81ff60b69f WatchSource:0}: Error finding container 557cc0756088beb804343e31ac4bcc0b2780735b4f6f8cc892960d81ff60b69f: Status 404 returned error can't find the container with id 557cc0756088beb804343e31ac4bcc0b2780735b4f6f8cc892960d81ff60b69f
Sep 11 20:03:28.993667 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:28.993625    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7500-8a407e" event={"ID":"71c90eda-0a8d-4d5a-903f-daba8f9471a2","Type":"ContainerStarted","Data":"0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2"}
Sep 11 20:03:28.994106 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:28.993680    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7500-8a407e" event={"ID":"71c90eda-0a8d-4d5a-903f-daba8f9471a2","Type":"ContainerStarted","Data":"557cc0756088beb804343e31ac4bcc0b2780735b4f6f8cc892960d81ff60b69f"}
Sep 11 20:03:29.010591 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:29.010543    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7500-8a407e" podStartSLOduration=2.01052673 podStartE2EDuration="2.01052673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:03:29.008812076 +0000 UTC m=+2043.242885496" watchObservedRunningTime="2026-09-11 20:03:29.01052673 +0000 UTC m=+2043.244600152"
Sep 11 20:03:29.558540 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:29.558502    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7500-8a407e"]
Sep 11 20:03:29.562808 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:29.562781    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7500-8a407e"]
Sep 11 20:03:29.998866 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:03:29.998836    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7500-8a407e" container="test-curl-7500-8a407e"
Sep 11 20:03:31.004171 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:31.004124    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7500-8a407e" podUID="71c90eda-0a8d-4d5a-903f-daba8f9471a2" containerName="test-curl-7500-8a407e" containerID="cri-o://0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2" gracePeriod=2
Sep 11 20:03:33.179956 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:33.179933    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7500-8a407e"
Sep 11 20:03:33.272765 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:33.272666    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l9jl\" (UniqueName: \"kubernetes.io/projected/71c90eda-0a8d-4d5a-903f-daba8f9471a2-kube-api-access-6l9jl\") pod \"71c90eda-0a8d-4d5a-903f-daba8f9471a2\" (UID: \"71c90eda-0a8d-4d5a-903f-daba8f9471a2\") "
Sep 11 20:03:33.274853 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:33.274823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71c90eda-0a8d-4d5a-903f-daba8f9471a2-kube-api-access-6l9jl" (OuterVolumeSpecName: "kube-api-access-6l9jl") pod "71c90eda-0a8d-4d5a-903f-daba8f9471a2" (UID: "71c90eda-0a8d-4d5a-903f-daba8f9471a2"). InnerVolumeSpecName "kube-api-access-6l9jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:03:33.374666 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:33.374391    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l9jl\" (UniqueName: \"kubernetes.io/projected/71c90eda-0a8d-4d5a-903f-daba8f9471a2-kube-api-access-6l9jl\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:03:34.021916 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:34.021882    2578 generic.go:356] "Generic (PLEG): container finished" podID="71c90eda-0a8d-4d5a-903f-daba8f9471a2" containerID="0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2" exitCode=137
Sep 11 20:03:34.022104 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:34.021931    2578 scope.go:117] "RemoveContainer" containerID="0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2"
Sep 11 20:03:34.022104 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:34.021941    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7500-8a407e"
Sep 11 20:03:34.031587 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:34.031570    2578 scope.go:117] "RemoveContainer" containerID="0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2"
Sep 11 20:03:34.031886 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:03:34.031865    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2\": container with ID starting with 0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2 not found: ID does not exist" containerID="0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2"
Sep 11 20:03:34.031939 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:34.031896    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2"} err="failed to get container status \"0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2\": rpc error: code = NotFound desc = could not find container \"0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2\": container with ID starting with 0f041a220e4a659505a151d63078325d91ea2dee17a1d577f973b0f0d53814a2 not found: ID does not exist"
Sep 11 20:03:34.032404 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:03:34.032379    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7500-8a407e\" is forbidden: User \"system:node:ip-10-0-139-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-38.ec2.internal' and this object" podUID="71c90eda-0a8d-4d5a-903f-daba8f9471a2" pod="opendatahub/test-curl-7500-8a407e"
Sep 11 20:03:34.257717 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:03:34.257682    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71c90eda-0a8d-4d5a-903f-daba8f9471a2" path="/var/lib/kubelet/pods/71c90eda-0a8d-4d5a-903f-daba8f9471a2/volumes"
Sep 11 20:04:26.717414 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:26.717376    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 20:04:26.723050 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:26.723027    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 20:04:52.671193 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.671163    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"]
Sep 11 20:04:52.671631 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.671617    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c90eda-0a8d-4d5a-903f-daba8f9471a2" containerName="test-curl-7500-8a407e"
Sep 11 20:04:52.671677 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.671633    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c90eda-0a8d-4d5a-903f-daba8f9471a2" containerName="test-curl-7500-8a407e"
Sep 11 20:04:52.671720 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.671711    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="273e9337-5ab2-42c3-b053-033dcc6e4ac5" containerName="istio-proxy"
Sep 11 20:04:52.671755 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.671722    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="71c90eda-0a8d-4d5a-903f-daba8f9471a2" containerName="test-curl-7500-8a407e"
Sep 11 20:04:52.675059 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.675039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:52.678428 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.678412    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-96e341-serving-cert\""
Sep 11 20:04:52.694144 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.694120    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"]
Sep 11 20:04:52.846987 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.846954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:52.846987 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.846992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c41cf308-775f-47bc-8733-3e7740366e5b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:52.847210 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.847059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkdls\" (UniqueName: \"kubernetes.io/projected/c41cf308-775f-47bc-8733-3e7740366e5b-kube-api-access-vkdls\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:52.847210 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.847177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-metrics-certs\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:52.948761 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.948670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkdls\" (UniqueName: \"kubernetes.io/projected/c41cf308-775f-47bc-8733-3e7740366e5b-kube-api-access-vkdls\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:52.948944 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.948775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-metrics-certs\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:52.948944 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.948815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:52.948944 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.948839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c41cf308-775f-47bc-8733-3e7740366e5b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:52.948944 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:04:52.948931    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-serving-cert: secret "maas-api-e2e-ipp-a-96e341-serving-cert" not found
Sep 11 20:04:52.949176 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:04:52.949041    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-maas-api-tls podName:c41cf308-775f-47bc-8733-3e7740366e5b nodeName:}" failed. No retries permitted until 2026-09-11 20:04:53.449021029 +0000 UTC m=+2127.683094434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-maas-api-tls") pod "maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc" (UID: "c41cf308-775f-47bc-8733-3e7740366e5b") : secret "maas-api-e2e-ipp-a-96e341-serving-cert" not found
Sep 11 20:04:52.949544 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.949522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c41cf308-775f-47bc-8733-3e7740366e5b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:52.951508 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.951488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-metrics-certs\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:52.958476 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:52.958455    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkdls\" (UniqueName: \"kubernetes.io/projected/c41cf308-775f-47bc-8733-3e7740366e5b-kube-api-access-vkdls\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:53.454341 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:53.454302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:53.456902 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:53.456874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:53.585563 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:53.585523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:53.870055 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:53.870034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"]
Sep 11 20:04:53.872895 ip-10-0-139-38 kubenswrapper[2578]: W0911 20:04:53.872856    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41cf308_775f_47bc_8733_3e7740366e5b.slice/crio-62ed04126b387d5eccd022a1d14b91ee8dd59590145136334e233a473f51b476 WatchSource:0}: Error finding container 62ed04126b387d5eccd022a1d14b91ee8dd59590145136334e233a473f51b476: Status 404 returned error can't find the container with id 62ed04126b387d5eccd022a1d14b91ee8dd59590145136334e233a473f51b476
Sep 11 20:04:53.874306 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:53.874290    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 20:04:54.472857 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:54.472828    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc" event={"ID":"c41cf308-775f-47bc-8733-3e7740366e5b","Type":"ContainerStarted","Data":"e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e"}
Sep 11 20:04:54.473008 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:54.472883    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc" event={"ID":"c41cf308-775f-47bc-8733-3e7740366e5b","Type":"ContainerStarted","Data":"62ed04126b387d5eccd022a1d14b91ee8dd59590145136334e233a473f51b476"}
Sep 11 20:04:54.473008 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:54.472911    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:04:54.495905 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:04:54.495855    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc" podStartSLOduration=1.970630356 podStartE2EDuration="2.495839322s" totalImagesPullingTime="525.208966ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:04:54.493977682 +0000 UTC m=+2128.728051104" watchObservedRunningTime="2026-09-11 20:04:54.495839322 +0000 UTC m=+2128.729912742"
Sep 11 20:05:00.483433 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:00.483404    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:05:22.980279 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:22.980184    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"]
Sep 11 20:05:22.983660 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:22.983641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:22.986215 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:22.986195    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-df1a8a-serving-cert\""
Sep 11 20:05:22.998073 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:22.998051    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"]
Sep 11 20:05:23.148250 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.148215    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/983cebeb-5b13-4726-a878-f0bb6f58e493-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.148432 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.148313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj69k\" (UniqueName: \"kubernetes.io/projected/983cebeb-5b13-4726-a878-f0bb6f58e493-kube-api-access-xj69k\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.148475 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.148444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-metrics-certs\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.148511 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.148488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-maas-api-tls\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.250008 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.249912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/983cebeb-5b13-4726-a878-f0bb6f58e493-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.250008 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.249960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj69k\" (UniqueName: \"kubernetes.io/projected/983cebeb-5b13-4726-a878-f0bb6f58e493-kube-api-access-xj69k\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.250252 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.250038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-metrics-certs\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.250252 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.250081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-maas-api-tls\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.250252 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:05:23.250201    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-serving-cert: secret "maas-api-e2e-ipp-b-df1a8a-serving-cert" not found
Sep 11 20:05:23.250443 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:05:23.250292    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-maas-api-tls podName:983cebeb-5b13-4726-a878-f0bb6f58e493 nodeName:}" failed. No retries permitted until 2026-09-11 20:05:23.750250005 +0000 UTC m=+2157.984323410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-maas-api-tls") pod "maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5" (UID: "983cebeb-5b13-4726-a878-f0bb6f58e493") : secret "maas-api-e2e-ipp-b-df1a8a-serving-cert" not found
Sep 11 20:05:23.250748 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.250717    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/983cebeb-5b13-4726-a878-f0bb6f58e493-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.252706 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.252685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-metrics-certs\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.259066 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.259046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj69k\" (UniqueName: \"kubernetes.io/projected/983cebeb-5b13-4726-a878-f0bb6f58e493-kube-api-access-xj69k\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.756586 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.756553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-maas-api-tls\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.759163 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.759138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-maas-api-tls\") pod \"maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:23.895664 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:23.895624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:24.170300 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:24.170276    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"]
Sep 11 20:05:24.172417 ip-10-0-139-38 kubenswrapper[2578]: W0911 20:05:24.172391    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983cebeb_5b13_4726_a878_f0bb6f58e493.slice/crio-95aa912bdfc23f7fae29f2ca1c04dca02edf9fe35242161331b92b0faeaa098a WatchSource:0}: Error finding container 95aa912bdfc23f7fae29f2ca1c04dca02edf9fe35242161331b92b0faeaa098a: Status 404 returned error can't find the container with id 95aa912bdfc23f7fae29f2ca1c04dca02edf9fe35242161331b92b0faeaa098a
Sep 11 20:05:24.633413 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:24.633381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5" event={"ID":"983cebeb-5b13-4726-a878-f0bb6f58e493","Type":"ContainerStarted","Data":"2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30"}
Sep 11 20:05:24.633579 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:24.633432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5" event={"ID":"983cebeb-5b13-4726-a878-f0bb6f58e493","Type":"ContainerStarted","Data":"95aa912bdfc23f7fae29f2ca1c04dca02edf9fe35242161331b92b0faeaa098a"}
Sep 11 20:05:24.633579 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:24.633506    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:05:24.659404 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:24.659351    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5" podStartSLOduration=2.34499796 podStartE2EDuration="2.659335287s" totalImagesPullingTime="314.337327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:05:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:05:24.657037618 +0000 UTC m=+2158.891111065" watchObservedRunningTime="2026-09-11 20:05:24.659335287 +0000 UTC m=+2158.893408708"
Sep 11 20:05:30.643755 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:05:30.643730    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:06:28.441848 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.441816    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"]
Sep 11 20:06:28.445907 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.445883    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.448921 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.448898    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-2f8fd9-serving-cert\""
Sep 11 20:06:28.459164 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.459142    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"]
Sep 11 20:06:28.590311 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.590277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nxqf\" (UniqueName: \"kubernetes.io/projected/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-kube-api-access-9nxqf\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.590487 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.590331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.590487 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.590363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.590487 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.590408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.690930 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.690899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.690930 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.690943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.691158 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.691083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.691242 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.691223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nxqf\" (UniqueName: \"kubernetes.io/projected/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-kube-api-access-9nxqf\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.691899 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.691735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.693553 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.693529    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.693672 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.693642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.700019 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.699990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nxqf\" (UniqueName: \"kubernetes.io/projected/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-kube-api-access-9nxqf\") pod \"maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:28.760986 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:28.760955    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:29.063612 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:29.063582    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"]
Sep 11 20:06:29.066794 ip-10-0-139-38 kubenswrapper[2578]: W0911 20:06:29.066767    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a40e9b_430e_4dc7_b50e_833ddef1fd76.slice/crio-45f4e712745d34daa3835f6c3804b2041fb1bea0b4422231530f03b09fa014b7 WatchSource:0}: Error finding container 45f4e712745d34daa3835f6c3804b2041fb1bea0b4422231530f03b09fa014b7: Status 404 returned error can't find the container with id 45f4e712745d34daa3835f6c3804b2041fb1bea0b4422231530f03b09fa014b7
Sep 11 20:06:29.991680 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:29.991639    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df" event={"ID":"f8a40e9b-430e-4dc7-b50e-833ddef1fd76","Type":"ContainerStarted","Data":"626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc"}
Sep 11 20:06:29.992170 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:29.991707    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df" event={"ID":"f8a40e9b-430e-4dc7-b50e-833ddef1fd76","Type":"ContainerStarted","Data":"45f4e712745d34daa3835f6c3804b2041fb1bea0b4422231530f03b09fa014b7"}
Sep 11 20:06:29.992170 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:29.991752    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:06:30.009961 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:30.009908    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df" podStartSLOduration=1.606437443 podStartE2EDuration="2.009892452s" totalImagesPullingTime="403.455009ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:06:30.008387834 +0000 UTC m=+2224.242461256" watchObservedRunningTime="2026-09-11 20:06:30.009892452 +0000 UTC m=+2224.243965872"
Sep 11 20:06:36.004150 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:06:36.004123    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:07:06.773267 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:06.773234    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"]
Sep 11 20:07:06.773727 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:06.773459    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df" podUID="f8a40e9b-430e-4dc7-b50e-833ddef1fd76" containerName="maas-api" containerID="cri-o://626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc" gracePeriod=30
Sep 11 20:07:07.033420 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.033359    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:07:07.174911 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.174881    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-openshift-service-ca\") pod \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") "
Sep 11 20:07:07.175073 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.175017    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-maas-api-tls\") pod \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") "
Sep 11 20:07:07.175073 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.175039    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-metrics-certs\") pod \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") "
Sep 11 20:07:07.175073 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.175068    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nxqf\" (UniqueName: \"kubernetes.io/projected/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-kube-api-access-9nxqf\") pod \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\" (UID: \"f8a40e9b-430e-4dc7-b50e-833ddef1fd76\") "
Sep 11 20:07:07.175299 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.175240    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8a40e9b-430e-4dc7-b50e-833ddef1fd76" (UID: "f8a40e9b-430e-4dc7-b50e-833ddef1fd76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:07:07.177323 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.177296    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f8a40e9b-430e-4dc7-b50e-833ddef1fd76" (UID: "f8a40e9b-430e-4dc7-b50e-833ddef1fd76"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:07:07.177427 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.177375    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8a40e9b-430e-4dc7-b50e-833ddef1fd76" (UID: "f8a40e9b-430e-4dc7-b50e-833ddef1fd76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:07:07.177427 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.177378    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-kube-api-access-9nxqf" (OuterVolumeSpecName: "kube-api-access-9nxqf") pod "f8a40e9b-430e-4dc7-b50e-833ddef1fd76" (UID: "f8a40e9b-430e-4dc7-b50e-833ddef1fd76"). InnerVolumeSpecName "kube-api-access-9nxqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:07:07.200185 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.200153    2578 generic.go:356] "Generic (PLEG): container finished" podID="f8a40e9b-430e-4dc7-b50e-833ddef1fd76" containerID="626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc" exitCode=0
Sep 11 20:07:07.200358 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.200198    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"
Sep 11 20:07:07.200358 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.200244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df" event={"ID":"f8a40e9b-430e-4dc7-b50e-833ddef1fd76","Type":"ContainerDied","Data":"626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc"}
Sep 11 20:07:07.200358 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.200340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df" event={"ID":"f8a40e9b-430e-4dc7-b50e-833ddef1fd76","Type":"ContainerDied","Data":"45f4e712745d34daa3835f6c3804b2041fb1bea0b4422231530f03b09fa014b7"}
Sep 11 20:07:07.200534 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.200373    2578 scope.go:117] "RemoveContainer" containerID="626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc"
Sep 11 20:07:07.213126 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.213093    2578 scope.go:117] "RemoveContainer" containerID="626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc"
Sep 11 20:07:07.213437 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:07:07.213416    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc\": container with ID starting with 626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc not found: ID does not exist" containerID="626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc"
Sep 11 20:07:07.213537 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.213444    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc"} err="failed to get container status \"626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc\": rpc error: code = NotFound desc = could not find container \"626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc\": container with ID starting with 626f055dfcd344ec20ec870d7f34664c7fc018f631d67d5757ab3db2ecd414cc not found: ID does not exist"
Sep 11 20:07:07.228018 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.227994    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"]
Sep 11 20:07:07.232138 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.232119    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2f8fd9-c9b5695f9-lx2df"]
Sep 11 20:07:07.275772 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.275741    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:07:07.275772 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.275767    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:07:07.275772 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.275777    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nxqf\" (UniqueName: \"kubernetes.io/projected/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-kube-api-access-9nxqf\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:07:07.275971 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:07.275785    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a40e9b-430e-4dc7-b50e-833ddef1fd76-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:07:08.262317 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:08.262288    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8a40e9b-430e-4dc7-b50e-833ddef1fd76" path="/var/lib/kubelet/pods/f8a40e9b-430e-4dc7-b50e-833ddef1fd76/volumes"
Sep 11 20:07:32.666648 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:32.666613    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"]
Sep 11 20:07:32.667092 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:32.666840    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc" podUID="c41cf308-775f-47bc-8733-3e7740366e5b" containerName="maas-api" containerID="cri-o://e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e" gracePeriod=30
Sep 11 20:07:32.936519 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:32.936487    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:07:33.039441 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.039409    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c41cf308-775f-47bc-8733-3e7740366e5b-openshift-service-ca\") pod \"c41cf308-775f-47bc-8733-3e7740366e5b\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") "
Sep 11 20:07:33.039628 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.039467    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-maas-api-tls\") pod \"c41cf308-775f-47bc-8733-3e7740366e5b\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") "
Sep 11 20:07:33.039628 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.039540    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-metrics-certs\") pod \"c41cf308-775f-47bc-8733-3e7740366e5b\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") "
Sep 11 20:07:33.039628 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.039581    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkdls\" (UniqueName: \"kubernetes.io/projected/c41cf308-775f-47bc-8733-3e7740366e5b-kube-api-access-vkdls\") pod \"c41cf308-775f-47bc-8733-3e7740366e5b\" (UID: \"c41cf308-775f-47bc-8733-3e7740366e5b\") "
Sep 11 20:07:33.039850 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.039824    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c41cf308-775f-47bc-8733-3e7740366e5b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c41cf308-775f-47bc-8733-3e7740366e5b" (UID: "c41cf308-775f-47bc-8733-3e7740366e5b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:07:33.039935 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.039921    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c41cf308-775f-47bc-8733-3e7740366e5b-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:07:33.041900 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.041868    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c41cf308-775f-47bc-8733-3e7740366e5b" (UID: "c41cf308-775f-47bc-8733-3e7740366e5b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:07:33.042014 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.041907    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c41cf308-775f-47bc-8733-3e7740366e5b" (UID: "c41cf308-775f-47bc-8733-3e7740366e5b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:07:33.042014 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.041925    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c41cf308-775f-47bc-8733-3e7740366e5b-kube-api-access-vkdls" (OuterVolumeSpecName: "kube-api-access-vkdls") pod "c41cf308-775f-47bc-8733-3e7740366e5b" (UID: "c41cf308-775f-47bc-8733-3e7740366e5b"). InnerVolumeSpecName "kube-api-access-vkdls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:07:33.140583 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.140549    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:07:33.140583 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.140575    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c41cf308-775f-47bc-8733-3e7740366e5b-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:07:33.140583 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.140585    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkdls\" (UniqueName: \"kubernetes.io/projected/c41cf308-775f-47bc-8733-3e7740366e5b-kube-api-access-vkdls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:07:33.344517 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.344481    2578 generic.go:356] "Generic (PLEG): container finished" podID="c41cf308-775f-47bc-8733-3e7740366e5b" containerID="e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e" exitCode=0
Sep 11 20:07:33.344688 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.344526    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"
Sep 11 20:07:33.344688 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.344574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc" event={"ID":"c41cf308-775f-47bc-8733-3e7740366e5b","Type":"ContainerDied","Data":"e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e"}
Sep 11 20:07:33.344688 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.344620    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc" event={"ID":"c41cf308-775f-47bc-8733-3e7740366e5b","Type":"ContainerDied","Data":"62ed04126b387d5eccd022a1d14b91ee8dd59590145136334e233a473f51b476"}
Sep 11 20:07:33.344688 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.344641    2578 scope.go:117] "RemoveContainer" containerID="e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e"
Sep 11 20:07:33.355162 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.355139    2578 scope.go:117] "RemoveContainer" containerID="e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e"
Sep 11 20:07:33.355519 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:07:33.355499    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e\": container with ID starting with e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e not found: ID does not exist" containerID="e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e"
Sep 11 20:07:33.355598 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.355526    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e"} err="failed to get container status \"e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e\": rpc error: code = NotFound desc = could not find container \"e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e\": container with ID starting with e0170adc48e457dab624d7ce94aa65ea950c2177759f361d00082f450611988e not found: ID does not exist"
Sep 11 20:07:33.367086 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.367060    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"]
Sep 11 20:07:33.370932 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:33.370911    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-96e341-d8b9df96c-xzklc"]
Sep 11 20:07:34.258485 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:07:34.258453    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c41cf308-775f-47bc-8733-3e7740366e5b" path="/var/lib/kubelet/pods/c41cf308-775f-47bc-8733-3e7740366e5b/volumes"
Sep 11 20:08:32.633192 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:32.633149    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"]
Sep 11 20:08:32.633669 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:32.633422    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5" podUID="983cebeb-5b13-4726-a878-f0bb6f58e493" containerName="maas-api" containerID="cri-o://2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30" gracePeriod=30
Sep 11 20:08:32.892917 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:32.892856    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:08:32.930986 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:32.930955    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-maas-api-tls\") pod \"983cebeb-5b13-4726-a878-f0bb6f58e493\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") "
Sep 11 20:08:32.931142 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:32.931013    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/983cebeb-5b13-4726-a878-f0bb6f58e493-openshift-service-ca\") pod \"983cebeb-5b13-4726-a878-f0bb6f58e493\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") "
Sep 11 20:08:32.931142 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:32.931041    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-metrics-certs\") pod \"983cebeb-5b13-4726-a878-f0bb6f58e493\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") "
Sep 11 20:08:32.931142 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:32.931135    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj69k\" (UniqueName: \"kubernetes.io/projected/983cebeb-5b13-4726-a878-f0bb6f58e493-kube-api-access-xj69k\") pod \"983cebeb-5b13-4726-a878-f0bb6f58e493\" (UID: \"983cebeb-5b13-4726-a878-f0bb6f58e493\") "
Sep 11 20:08:32.931529 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:32.931439    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/983cebeb-5b13-4726-a878-f0bb6f58e493-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "983cebeb-5b13-4726-a878-f0bb6f58e493" (UID: "983cebeb-5b13-4726-a878-f0bb6f58e493"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:08:32.933324 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:32.933292    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "983cebeb-5b13-4726-a878-f0bb6f58e493" (UID: "983cebeb-5b13-4726-a878-f0bb6f58e493"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:08:32.933498 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:32.933480    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "983cebeb-5b13-4726-a878-f0bb6f58e493" (UID: "983cebeb-5b13-4726-a878-f0bb6f58e493"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:08:32.933746 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:32.933715    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/983cebeb-5b13-4726-a878-f0bb6f58e493-kube-api-access-xj69k" (OuterVolumeSpecName: "kube-api-access-xj69k") pod "983cebeb-5b13-4726-a878-f0bb6f58e493" (UID: "983cebeb-5b13-4726-a878-f0bb6f58e493"). InnerVolumeSpecName "kube-api-access-xj69k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:08:33.032020 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.031992    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:08:33.032020 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.032018    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/983cebeb-5b13-4726-a878-f0bb6f58e493-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:08:33.032222 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.032029    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/983cebeb-5b13-4726-a878-f0bb6f58e493-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:08:33.032222 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.032038    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj69k\" (UniqueName: \"kubernetes.io/projected/983cebeb-5b13-4726-a878-f0bb6f58e493-kube-api-access-xj69k\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:08:33.674441 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.674408    2578 generic.go:356] "Generic (PLEG): container finished" podID="983cebeb-5b13-4726-a878-f0bb6f58e493" containerID="2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30" exitCode=0
Sep 11 20:08:33.674982 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.674464    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"
Sep 11 20:08:33.674982 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.674481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5" event={"ID":"983cebeb-5b13-4726-a878-f0bb6f58e493","Type":"ContainerDied","Data":"2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30"}
Sep 11 20:08:33.674982 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.674522    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5" event={"ID":"983cebeb-5b13-4726-a878-f0bb6f58e493","Type":"ContainerDied","Data":"95aa912bdfc23f7fae29f2ca1c04dca02edf9fe35242161331b92b0faeaa098a"}
Sep 11 20:08:33.674982 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.674543    2578 scope.go:117] "RemoveContainer" containerID="2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30"
Sep 11 20:08:33.685052 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.685034    2578 scope.go:117] "RemoveContainer" containerID="2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30"
Sep 11 20:08:33.685351 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:08:33.685331    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30\": container with ID starting with 2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30 not found: ID does not exist" containerID="2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30"
Sep 11 20:08:33.685406 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.685363    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30"} err="failed to get container status \"2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30\": rpc error: code = NotFound desc = could not find container \"2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30\": container with ID starting with 2017fd852aca6968c3470cdd7e373d8177af55a26f23acd68b62c97e7badde30 not found: ID does not exist"
Sep 11 20:08:33.698086 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.698058    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"]
Sep 11 20:08:33.703119 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:33.703097    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-df1a8a-f7f8b8f67-4c8p5"]
Sep 11 20:08:34.258295 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:34.258221    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="983cebeb-5b13-4726-a878-f0bb6f58e493" path="/var/lib/kubelet/pods/983cebeb-5b13-4726-a878-f0bb6f58e493/volumes"
Sep 11 20:08:50.292731 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.292698    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"]
Sep 11 20:08:50.293453 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.292957    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t" podUID="6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf" containerName="maas-api" containerID="cri-o://969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0" gracePeriod=30
Sep 11 20:08:50.552734 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.552672    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 20:08:50.596434 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.596402    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcjgz\" (UniqueName: \"kubernetes.io/projected/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-kube-api-access-fcjgz\") pod \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") "
Sep 11 20:08:50.596588 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.596439    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-maas-api-tls\") pod \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") "
Sep 11 20:08:50.596660 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.596587    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-metrics-certs\") pod \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") "
Sep 11 20:08:50.596660 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.596653    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-openshift-service-ca\") pod \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\" (UID: \"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf\") "
Sep 11 20:08:50.597138 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.597083    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf" (UID: "6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:08:50.598954 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.598931    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf" (UID: "6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:08:50.599075 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.599032    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-kube-api-access-fcjgz" (OuterVolumeSpecName: "kube-api-access-fcjgz") pod "6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf" (UID: "6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf"). InnerVolumeSpecName "kube-api-access-fcjgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:08:50.599172 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.599151    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf" (UID: "6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:08:50.697788 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.697750    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcjgz\" (UniqueName: \"kubernetes.io/projected/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-kube-api-access-fcjgz\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:08:50.697788 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.697791    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:08:50.697995 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.697803    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:08:50.697995 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.697816    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:08:50.768965 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.768933    2578 generic.go:356] "Generic (PLEG): container finished" podID="6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf" containerID="969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0" exitCode=0
Sep 11 20:08:50.769144 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.768982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t" event={"ID":"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf","Type":"ContainerDied","Data":"969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0"}
Sep 11 20:08:50.769144 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.768989    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"
Sep 11 20:08:50.769144 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.769023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t" event={"ID":"6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf","Type":"ContainerDied","Data":"362e3f39f4e5d2d14932bd054f71d30c5529e125bcec6e69d5f588419f0b64b7"}
Sep 11 20:08:50.769144 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.769043    2578 scope.go:117] "RemoveContainer" containerID="969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0"
Sep 11 20:08:50.778987 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.778971    2578 scope.go:117] "RemoveContainer" containerID="969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0"
Sep 11 20:08:50.779251 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:08:50.779234    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0\": container with ID starting with 969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0 not found: ID does not exist" containerID="969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0"
Sep 11 20:08:50.779328 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.779283    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0"} err="failed to get container status \"969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0\": rpc error: code = NotFound desc = could not find container \"969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0\": container with ID starting with 969f8a7f36dae180e722ee86cd4e9ee6485de2240f767558b6d7e625d78664f0 not found: ID does not exist"
Sep 11 20:08:50.791042 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.791016    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"]
Sep 11 20:08:50.794616 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:50.794593    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57d97d-6f6954c7c8-nb55t"]
Sep 11 20:08:52.259377 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:08:52.259348    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf" path="/var/lib/kubelet/pods/6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf/volumes"
Sep 11 20:09:07.960781 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:07.960744    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"]
Sep 11 20:09:07.961374 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:07.960997    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms" podUID="cbcf4174-30ec-4bd9-b748-4445cbef4970" containerName="maas-api" containerID="cri-o://cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc" gracePeriod=30
Sep 11 20:09:08.025415 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.025372    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms" podUID="cbcf4174-30ec-4bd9-b748-4445cbef4970" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.76:8443/health\": dial tcp 10.133.0.76:8443: connect: connection refused"
Sep 11 20:09:08.211749 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.211680    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 20:09:08.368671 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.368642    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrx92\" (UniqueName: \"kubernetes.io/projected/cbcf4174-30ec-4bd9-b748-4445cbef4970-kube-api-access-hrx92\") pod \"cbcf4174-30ec-4bd9-b748-4445cbef4970\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") "
Sep 11 20:09:08.368671 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.368678    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-maas-api-tls\") pod \"cbcf4174-30ec-4bd9-b748-4445cbef4970\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") "
Sep 11 20:09:08.368889 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.368709    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-metrics-certs\") pod \"cbcf4174-30ec-4bd9-b748-4445cbef4970\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") "
Sep 11 20:09:08.368889 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.368732    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbcf4174-30ec-4bd9-b748-4445cbef4970-openshift-service-ca\") pod \"cbcf4174-30ec-4bd9-b748-4445cbef4970\" (UID: \"cbcf4174-30ec-4bd9-b748-4445cbef4970\") "
Sep 11 20:09:08.369229 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.369193    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbcf4174-30ec-4bd9-b748-4445cbef4970-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cbcf4174-30ec-4bd9-b748-4445cbef4970" (UID: "cbcf4174-30ec-4bd9-b748-4445cbef4970"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:09:08.371041 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.371011    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbcf4174-30ec-4bd9-b748-4445cbef4970-kube-api-access-hrx92" (OuterVolumeSpecName: "kube-api-access-hrx92") pod "cbcf4174-30ec-4bd9-b748-4445cbef4970" (UID: "cbcf4174-30ec-4bd9-b748-4445cbef4970"). InnerVolumeSpecName "kube-api-access-hrx92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:09:08.371041 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.371033    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cbcf4174-30ec-4bd9-b748-4445cbef4970" (UID: "cbcf4174-30ec-4bd9-b748-4445cbef4970"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:09:08.371179 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.371099    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cbcf4174-30ec-4bd9-b748-4445cbef4970" (UID: "cbcf4174-30ec-4bd9-b748-4445cbef4970"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:09:08.469873 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.469796    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrx92\" (UniqueName: \"kubernetes.io/projected/cbcf4174-30ec-4bd9-b748-4445cbef4970-kube-api-access-hrx92\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:09:08.469873 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.469826    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:09:08.469873 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.469835    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbcf4174-30ec-4bd9-b748-4445cbef4970-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:09:08.469873 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.469843    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbcf4174-30ec-4bd9-b748-4445cbef4970-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:09:08.870381 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.870346    2578 generic.go:356] "Generic (PLEG): container finished" podID="cbcf4174-30ec-4bd9-b748-4445cbef4970" containerID="cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc" exitCode=0
Sep 11 20:09:08.870589 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.870398    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"
Sep 11 20:09:08.870589 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.870411    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms" event={"ID":"cbcf4174-30ec-4bd9-b748-4445cbef4970","Type":"ContainerDied","Data":"cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc"}
Sep 11 20:09:08.870589 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.870453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms" event={"ID":"cbcf4174-30ec-4bd9-b748-4445cbef4970","Type":"ContainerDied","Data":"da153c68991bf5666ef92a6761f1851c6e4b75e0cb463421c665c3ca0d0c6a97"}
Sep 11 20:09:08.870589 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.870474    2578 scope.go:117] "RemoveContainer" containerID="cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc"
Sep 11 20:09:08.880536 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.880518    2578 scope.go:117] "RemoveContainer" containerID="cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc"
Sep 11 20:09:08.880809 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:09:08.880791    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc\": container with ID starting with cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc not found: ID does not exist" containerID="cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc"
Sep 11 20:09:08.880849 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.880818    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc"} err="failed to get container status \"cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc\": rpc error: code = NotFound desc = could not find container \"cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc\": container with ID starting with cb63379c724b3ce8bc6364a402cf1f97a613a1101896bb56571bc867de96b0cc not found: ID does not exist"
Sep 11 20:09:08.894331 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.894299    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"]
Sep 11 20:09:08.897401 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:08.897378    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8a4eb7-6bdfcc5dd4-zpwms"]
Sep 11 20:09:10.257903 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:10.257873    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbcf4174-30ec-4bd9-b748-4445cbef4970" path="/var/lib/kubelet/pods/cbcf4174-30ec-4bd9-b748-4445cbef4970/volumes"
Sep 11 20:09:17.713284 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:17.713231    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77545c6848-qfcm2"]
Sep 11 20:09:17.713767 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:17.713495    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-77545c6848-qfcm2" podUID="a613fa4a-f550-490f-abc9-318be05f8f29" containerName="manager" containerID="cri-o://070a04ef9caceac63329699617a0f8b82ee18d6d4629e6820b187dd2a11b15c9" gracePeriod=30
Sep 11 20:09:17.922467 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:17.922436    2578 generic.go:356] "Generic (PLEG): container finished" podID="a613fa4a-f550-490f-abc9-318be05f8f29" containerID="070a04ef9caceac63329699617a0f8b82ee18d6d4629e6820b187dd2a11b15c9" exitCode=0
Sep 11 20:09:17.922613 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:17.922504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77545c6848-qfcm2" event={"ID":"a613fa4a-f550-490f-abc9-318be05f8f29","Type":"ContainerDied","Data":"070a04ef9caceac63329699617a0f8b82ee18d6d4629e6820b187dd2a11b15c9"}
Sep 11 20:09:17.967617 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:17.967559    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 20:09:18.160045 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.160003    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsb6c\" (UniqueName: \"kubernetes.io/projected/a613fa4a-f550-490f-abc9-318be05f8f29-kube-api-access-zsb6c\") pod \"a613fa4a-f550-490f-abc9-318be05f8f29\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") "
Sep 11 20:09:18.160231 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.160076    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-metrics-certs\") pod \"a613fa4a-f550-490f-abc9-318be05f8f29\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") "
Sep 11 20:09:18.160231 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.160169    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-webhook-cert\") pod \"a613fa4a-f550-490f-abc9-318be05f8f29\" (UID: \"a613fa4a-f550-490f-abc9-318be05f8f29\") "
Sep 11 20:09:18.162314 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.162290    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a613fa4a-f550-490f-abc9-318be05f8f29" (UID: "a613fa4a-f550-490f-abc9-318be05f8f29"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:09:18.162700 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.162681    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a613fa4a-f550-490f-abc9-318be05f8f29-kube-api-access-zsb6c" (OuterVolumeSpecName: "kube-api-access-zsb6c") pod "a613fa4a-f550-490f-abc9-318be05f8f29" (UID: "a613fa4a-f550-490f-abc9-318be05f8f29"). InnerVolumeSpecName "kube-api-access-zsb6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:09:18.162764 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.162678    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a613fa4a-f550-490f-abc9-318be05f8f29" (UID: "a613fa4a-f550-490f-abc9-318be05f8f29"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:09:18.260871 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.260793    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsb6c\" (UniqueName: \"kubernetes.io/projected/a613fa4a-f550-490f-abc9-318be05f8f29-kube-api-access-zsb6c\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:09:18.260871 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.260818    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:09:18.260871 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.260828    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a613fa4a-f550-490f-abc9-318be05f8f29-webhook-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:09:18.929635 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.929601    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77545c6848-qfcm2"
Sep 11 20:09:18.930117 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.929597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77545c6848-qfcm2" event={"ID":"a613fa4a-f550-490f-abc9-318be05f8f29","Type":"ContainerDied","Data":"710df428acee74b78ad5c3dc319f5681edd29fff85ca86acf93dab05703772e1"}
Sep 11 20:09:18.930117 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.929758    2578 scope.go:117] "RemoveContainer" containerID="070a04ef9caceac63329699617a0f8b82ee18d6d4629e6820b187dd2a11b15c9"
Sep 11 20:09:18.950421 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.950399    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77545c6848-qfcm2"]
Sep 11 20:09:18.954492 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:18.954468    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77545c6848-qfcm2"]
Sep 11 20:09:20.258076 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:20.258044    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a613fa4a-f550-490f-abc9-318be05f8f29" path="/var/lib/kubelet/pods/a613fa4a-f550-490f-abc9-318be05f8f29/volumes"
Sep 11 20:09:26.751470 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:26.751432    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 20:09:26.758546 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:09:26.758520    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 20:10:19.705121 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705087    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77545c6848-vjsl7"]
Sep 11 20:10:19.705613 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705547    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a613fa4a-f550-490f-abc9-318be05f8f29" containerName="manager"
Sep 11 20:10:19.705613 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705560    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a613fa4a-f550-490f-abc9-318be05f8f29" containerName="manager"
Sep 11 20:10:19.705613 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705569    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8a40e9b-430e-4dc7-b50e-833ddef1fd76" containerName="maas-api"
Sep 11 20:10:19.705613 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705575    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8a40e9b-430e-4dc7-b50e-833ddef1fd76" containerName="maas-api"
Sep 11 20:10:19.705613 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705586    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="983cebeb-5b13-4726-a878-f0bb6f58e493" containerName="maas-api"
Sep 11 20:10:19.705613 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705592    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="983cebeb-5b13-4726-a878-f0bb6f58e493" containerName="maas-api"
Sep 11 20:10:19.705613 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705604    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c41cf308-775f-47bc-8733-3e7740366e5b" containerName="maas-api"
Sep 11 20:10:19.705613 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705609    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c41cf308-775f-47bc-8733-3e7740366e5b" containerName="maas-api"
Sep 11 20:10:19.706174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705622    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbcf4174-30ec-4bd9-b748-4445cbef4970" containerName="maas-api"
Sep 11 20:10:19.706174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705627    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbcf4174-30ec-4bd9-b748-4445cbef4970" containerName="maas-api"
Sep 11 20:10:19.706174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705637    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf" containerName="maas-api"
Sep 11 20:10:19.706174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705641    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf" containerName="maas-api"
Sep 11 20:10:19.706174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705717    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c41cf308-775f-47bc-8733-3e7740366e5b" containerName="maas-api"
Sep 11 20:10:19.706174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705727    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a613fa4a-f550-490f-abc9-318be05f8f29" containerName="manager"
Sep 11 20:10:19.706174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705739    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbcf4174-30ec-4bd9-b748-4445cbef4970" containerName="maas-api"
Sep 11 20:10:19.706174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705746    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="983cebeb-5b13-4726-a878-f0bb6f58e493" containerName="maas-api"
Sep 11 20:10:19.706174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705754    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8a40e9b-430e-4dc7-b50e-833ddef1fd76" containerName="maas-api"
Sep 11 20:10:19.706174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.705760    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f70d0b1-dacf-4bf1-a9e8-50bd4dba5dbf" containerName="maas-api"
Sep 11 20:10:19.709380 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.709362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:19.713479 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.713456    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 20:10:19.713609 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.713478    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-msw5f\""
Sep 11 20:10:19.713609 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.713466    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 20:10:19.713699 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.713612    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 20:10:19.717756 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.717732    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77545c6848-vjsl7"]
Sep 11 20:10:19.828146 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.828106    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-webhook-cert\") pod \"maas-controller-77545c6848-vjsl7\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") " pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:19.828380 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.828176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-metrics-certs\") pod \"maas-controller-77545c6848-vjsl7\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") " pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:19.828380 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.828232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjm74\" (UniqueName: \"kubernetes.io/projected/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-kube-api-access-cjm74\") pod \"maas-controller-77545c6848-vjsl7\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") " pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:19.928734 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.928701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-metrics-certs\") pod \"maas-controller-77545c6848-vjsl7\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") " pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:19.928913 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.928757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjm74\" (UniqueName: \"kubernetes.io/projected/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-kube-api-access-cjm74\") pod \"maas-controller-77545c6848-vjsl7\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") " pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:19.928913 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.928806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-webhook-cert\") pod \"maas-controller-77545c6848-vjsl7\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") " pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:19.931450 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.931426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-metrics-certs\") pod \"maas-controller-77545c6848-vjsl7\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") " pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:19.931570 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.931469    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-webhook-cert\") pod \"maas-controller-77545c6848-vjsl7\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") " pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:19.936619 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:19.936592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjm74\" (UniqueName: \"kubernetes.io/projected/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-kube-api-access-cjm74\") pod \"maas-controller-77545c6848-vjsl7\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") " pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:20.020646 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:20.020566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:20.325151 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:20.325128    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77545c6848-vjsl7"]
Sep 11 20:10:20.327622 ip-10-0-139-38 kubenswrapper[2578]: W0911 20:10:20.327600    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231bdfe4_ae31_4771_b4b6_ee8bc13a7e48.slice/crio-07cb76dce8f62c939e391b82a98213fa952ef60534188f00d1fd9a2ceb179567 WatchSource:0}: Error finding container 07cb76dce8f62c939e391b82a98213fa952ef60534188f00d1fd9a2ceb179567: Status 404 returned error can't find the container with id 07cb76dce8f62c939e391b82a98213fa952ef60534188f00d1fd9a2ceb179567
Sep 11 20:10:20.328932 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:20.328913    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 20:10:21.263586 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:21.263504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77545c6848-vjsl7" event={"ID":"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48","Type":"ContainerStarted","Data":"f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2"}
Sep 11 20:10:21.263586 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:21.263558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77545c6848-vjsl7" event={"ID":"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48","Type":"ContainerStarted","Data":"07cb76dce8f62c939e391b82a98213fa952ef60534188f00d1fd9a2ceb179567"}
Sep 11 20:10:21.263981 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:21.263651    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:21.284751 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:21.284706    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77545c6848-vjsl7" podStartSLOduration=1.67437802 podStartE2EDuration="2.284691444s" totalImagesPullingTime="610.313424ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:10:21.281849255 +0000 UTC m=+2455.515922685" watchObservedRunningTime="2026-09-11 20:10:21.284691444 +0000 UTC m=+2455.518764866"
Sep 11 20:10:32.270769 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:32.270732    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:39.417720 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.417680    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77545c6848-vjsl7"]
Sep 11 20:10:39.418292 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.417883    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-77545c6848-vjsl7" podUID="231bdfe4-ae31-4771-b4b6-ee8bc13a7e48" containerName="manager" containerID="cri-o://f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2" gracePeriod=30
Sep 11 20:10:39.670184 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.670123    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:39.820850 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.820814    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-metrics-certs\") pod \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") "
Sep 11 20:10:39.821002 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.820921    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjm74\" (UniqueName: \"kubernetes.io/projected/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-kube-api-access-cjm74\") pod \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") "
Sep 11 20:10:39.821002 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.820952    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-webhook-cert\") pod \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\" (UID: \"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48\") "
Sep 11 20:10:39.823235 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.823202    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-kube-api-access-cjm74" (OuterVolumeSpecName: "kube-api-access-cjm74") pod "231bdfe4-ae31-4771-b4b6-ee8bc13a7e48" (UID: "231bdfe4-ae31-4771-b4b6-ee8bc13a7e48"). InnerVolumeSpecName "kube-api-access-cjm74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:10:39.823385 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.823364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "231bdfe4-ae31-4771-b4b6-ee8bc13a7e48" (UID: "231bdfe4-ae31-4771-b4b6-ee8bc13a7e48"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:10:39.823467 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.823445    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "231bdfe4-ae31-4771-b4b6-ee8bc13a7e48" (UID: "231bdfe4-ae31-4771-b4b6-ee8bc13a7e48"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:10:39.921878 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.921779    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjm74\" (UniqueName: \"kubernetes.io/projected/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-kube-api-access-cjm74\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:10:39.921878 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.921824    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-webhook-cert\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:10:39.921878 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:39.921854    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:10:40.362738 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:40.362706    2578 generic.go:356] "Generic (PLEG): container finished" podID="231bdfe4-ae31-4771-b4b6-ee8bc13a7e48" containerID="f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2" exitCode=0
Sep 11 20:10:40.362916 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:40.362751    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77545c6848-vjsl7"
Sep 11 20:10:40.362916 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:40.362797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77545c6848-vjsl7" event={"ID":"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48","Type":"ContainerDied","Data":"f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2"}
Sep 11 20:10:40.362916 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:40.362845    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77545c6848-vjsl7" event={"ID":"231bdfe4-ae31-4771-b4b6-ee8bc13a7e48","Type":"ContainerDied","Data":"07cb76dce8f62c939e391b82a98213fa952ef60534188f00d1fd9a2ceb179567"}
Sep 11 20:10:40.362916 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:40.362882    2578 scope.go:117] "RemoveContainer" containerID="f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2"
Sep 11 20:10:40.371781 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:40.371756    2578 scope.go:117] "RemoveContainer" containerID="f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2"
Sep 11 20:10:40.372062 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:10:40.372044    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2\": container with ID starting with f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2 not found: ID does not exist" containerID="f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2"
Sep 11 20:10:40.372121 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:40.372072    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2"} err="failed to get container status \"f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2\": rpc error: code = NotFound desc = could not find container \"f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2\": container with ID starting with f620ede30f9c60c04a61899553876c49b135b09c569c9da0d0613a0f68100cb2 not found: ID does not exist"
Sep 11 20:10:40.380755 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:40.380729    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77545c6848-vjsl7"]
Sep 11 20:10:40.386639 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:40.386619    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77545c6848-vjsl7"]
Sep 11 20:10:41.171868 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.171832    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77545c6848-x82wb"]
Sep 11 20:10:41.172420 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.172393    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="231bdfe4-ae31-4771-b4b6-ee8bc13a7e48" containerName="manager"
Sep 11 20:10:41.172420 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.172412    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="231bdfe4-ae31-4771-b4b6-ee8bc13a7e48" containerName="manager"
Sep 11 20:10:41.172518 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.172511    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="231bdfe4-ae31-4771-b4b6-ee8bc13a7e48" containerName="manager"
Sep 11 20:10:41.176862 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.176847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:41.181073 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.181052    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 20:10:41.181227 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.181085    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 20:10:41.181227 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.181124    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-msw5f\""
Sep 11 20:10:41.181405 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.181379    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 20:10:41.186382 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.186359    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77545c6848-x82wb"]
Sep 11 20:10:41.335435 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.335405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ace7d7b-9716-4f9e-96f9-f3cd27053a42-metrics-certs\") pod \"maas-controller-77545c6848-x82wb\" (UID: \"7ace7d7b-9716-4f9e-96f9-f3cd27053a42\") " pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:41.335609 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.335467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ace7d7b-9716-4f9e-96f9-f3cd27053a42-webhook-cert\") pod \"maas-controller-77545c6848-x82wb\" (UID: \"7ace7d7b-9716-4f9e-96f9-f3cd27053a42\") " pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:41.335609 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.335491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzxrm\" (UniqueName: \"kubernetes.io/projected/7ace7d7b-9716-4f9e-96f9-f3cd27053a42-kube-api-access-dzxrm\") pod \"maas-controller-77545c6848-x82wb\" (UID: \"7ace7d7b-9716-4f9e-96f9-f3cd27053a42\") " pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:41.436055 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.435968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ace7d7b-9716-4f9e-96f9-f3cd27053a42-metrics-certs\") pod \"maas-controller-77545c6848-x82wb\" (UID: \"7ace7d7b-9716-4f9e-96f9-f3cd27053a42\") " pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:41.436055 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.436037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ace7d7b-9716-4f9e-96f9-f3cd27053a42-webhook-cert\") pod \"maas-controller-77545c6848-x82wb\" (UID: \"7ace7d7b-9716-4f9e-96f9-f3cd27053a42\") " pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:41.436244 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.436058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzxrm\" (UniqueName: \"kubernetes.io/projected/7ace7d7b-9716-4f9e-96f9-f3cd27053a42-kube-api-access-dzxrm\") pod \"maas-controller-77545c6848-x82wb\" (UID: \"7ace7d7b-9716-4f9e-96f9-f3cd27053a42\") " pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:41.438669 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.438643    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ace7d7b-9716-4f9e-96f9-f3cd27053a42-webhook-cert\") pod \"maas-controller-77545c6848-x82wb\" (UID: \"7ace7d7b-9716-4f9e-96f9-f3cd27053a42\") " pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:41.438815 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.438743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ace7d7b-9716-4f9e-96f9-f3cd27053a42-metrics-certs\") pod \"maas-controller-77545c6848-x82wb\" (UID: \"7ace7d7b-9716-4f9e-96f9-f3cd27053a42\") " pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:41.444595 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.444568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzxrm\" (UniqueName: \"kubernetes.io/projected/7ace7d7b-9716-4f9e-96f9-f3cd27053a42-kube-api-access-dzxrm\") pod \"maas-controller-77545c6848-x82wb\" (UID: \"7ace7d7b-9716-4f9e-96f9-f3cd27053a42\") " pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:41.488129 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.488097    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:41.765785 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:41.765760    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77545c6848-x82wb"]
Sep 11 20:10:41.767872 ip-10-0-139-38 kubenswrapper[2578]: W0911 20:10:41.767845    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ace7d7b_9716_4f9e_96f9_f3cd27053a42.slice/crio-99cdc4c46dcf41b458655e969e6ef22d921f74c01d67d76e23db75fa7ab6dfae WatchSource:0}: Error finding container 99cdc4c46dcf41b458655e969e6ef22d921f74c01d67d76e23db75fa7ab6dfae: Status 404 returned error can't find the container with id 99cdc4c46dcf41b458655e969e6ef22d921f74c01d67d76e23db75fa7ab6dfae
Sep 11 20:10:42.257874 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:42.257842    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="231bdfe4-ae31-4771-b4b6-ee8bc13a7e48" path="/var/lib/kubelet/pods/231bdfe4-ae31-4771-b4b6-ee8bc13a7e48/volumes"
Sep 11 20:10:42.375784 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:42.375748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77545c6848-x82wb" event={"ID":"7ace7d7b-9716-4f9e-96f9-f3cd27053a42","Type":"ContainerStarted","Data":"c77ddd10cc82cbc5a24aa341721396c804747606f35cf94baea3391bfaf25238"}
Sep 11 20:10:42.376294 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:42.376171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77545c6848-x82wb" event={"ID":"7ace7d7b-9716-4f9e-96f9-f3cd27053a42","Type":"ContainerStarted","Data":"99cdc4c46dcf41b458655e969e6ef22d921f74c01d67d76e23db75fa7ab6dfae"}
Sep 11 20:10:42.380285 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:42.377308    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:10:42.395752 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:42.395691    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77545c6848-x82wb" podStartSLOduration=0.981594441 podStartE2EDuration="1.395670524s" totalImagesPullingTime="414.076083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:10:42.394447615 +0000 UTC m=+2476.628521040" watchObservedRunningTime="2026-09-11 20:10:42.395670524 +0000 UTC m=+2476.629743946"
Sep 11 20:10:54.387920 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:10:54.387893    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77545c6848-x82wb"
Sep 11 20:11:49.521721 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:49.521691    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"]
Sep 11 20:11:49.751793 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:49.751735    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4" podUID="c5dccc1d-02cf-4490-99fb-8d53da95c80c" containerName="manager" containerID="cri-o://54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc" gracePeriod=10
Sep 11 20:11:50.202457 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.202436    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 20:11:50.282914 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.282816    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5dccc1d-02cf-4490-99fb-8d53da95c80c-extensions-socket-volume\") pod \"c5dccc1d-02cf-4490-99fb-8d53da95c80c\" (UID: \"c5dccc1d-02cf-4490-99fb-8d53da95c80c\") "
Sep 11 20:11:50.282914 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.282885    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv7r8\" (UniqueName: \"kubernetes.io/projected/c5dccc1d-02cf-4490-99fb-8d53da95c80c-kube-api-access-wv7r8\") pod \"c5dccc1d-02cf-4490-99fb-8d53da95c80c\" (UID: \"c5dccc1d-02cf-4490-99fb-8d53da95c80c\") "
Sep 11 20:11:50.283235 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.283215    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5dccc1d-02cf-4490-99fb-8d53da95c80c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c5dccc1d-02cf-4490-99fb-8d53da95c80c" (UID: "c5dccc1d-02cf-4490-99fb-8d53da95c80c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:11:50.284996 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.284956    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5dccc1d-02cf-4490-99fb-8d53da95c80c-kube-api-access-wv7r8" (OuterVolumeSpecName: "kube-api-access-wv7r8") pod "c5dccc1d-02cf-4490-99fb-8d53da95c80c" (UID: "c5dccc1d-02cf-4490-99fb-8d53da95c80c"). InnerVolumeSpecName "kube-api-access-wv7r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:11:50.384164 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.384122    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5dccc1d-02cf-4490-99fb-8d53da95c80c-extensions-socket-volume\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:11:50.384164 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.384157    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv7r8\" (UniqueName: \"kubernetes.io/projected/c5dccc1d-02cf-4490-99fb-8d53da95c80c-kube-api-access-wv7r8\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:11:50.758751 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.758719    2578 generic.go:356] "Generic (PLEG): container finished" podID="c5dccc1d-02cf-4490-99fb-8d53da95c80c" containerID="54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc" exitCode=0
Sep 11 20:11:50.759169 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.758780    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"
Sep 11 20:11:50.759169 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.758804    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4" event={"ID":"c5dccc1d-02cf-4490-99fb-8d53da95c80c","Type":"ContainerDied","Data":"54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc"}
Sep 11 20:11:50.759169 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.758901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4" event={"ID":"c5dccc1d-02cf-4490-99fb-8d53da95c80c","Type":"ContainerDied","Data":"077609dc9517f8ba5e16e839d0aecbbf4edd136ad1ea5a9cc83d5283391e0132"}
Sep 11 20:11:50.759169 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.758929    2578 scope.go:117] "RemoveContainer" containerID="54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc"
Sep 11 20:11:50.768369 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.768349    2578 scope.go:117] "RemoveContainer" containerID="9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf"
Sep 11 20:11:50.776590 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.776568    2578 scope.go:117] "RemoveContainer" containerID="54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc"
Sep 11 20:11:50.776856 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:11:50.776836    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc\": container with ID starting with 54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc not found: ID does not exist" containerID="54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc"
Sep 11 20:11:50.776934 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.776869    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc"} err="failed to get container status \"54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc\": rpc error: code = NotFound desc = could not find container \"54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc\": container with ID starting with 54db824fd8f50edd4024d02fd3d9c4210c0e6297a8eec43f0a867865cee201dc not found: ID does not exist"
Sep 11 20:11:50.776934 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.776893    2578 scope.go:117] "RemoveContainer" containerID="9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf"
Sep 11 20:11:50.777158 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:11:50.777141    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf\": container with ID starting with 9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf not found: ID does not exist" containerID="9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf"
Sep 11 20:11:50.777197 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.777165    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf"} err="failed to get container status \"9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf\": rpc error: code = NotFound desc = could not find container \"9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf\": container with ID starting with 9ca3e1c1e4c60ec7d2d664654553f25ee802c43859daf63865fcab92cfbdeecf not found: ID does not exist"
Sep 11 20:11:50.780920 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.780900    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"]
Sep 11 20:11:50.784610 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:50.784592    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-frqz4"]
Sep 11 20:11:52.258086 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:11:52.258057    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5dccc1d-02cf-4490-99fb-8d53da95c80c" path="/var/lib/kubelet/pods/c5dccc1d-02cf-4490-99fb-8d53da95c80c/volumes"
Sep 11 20:12:50.179225 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.179139    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"]
Sep 11 20:12:50.179732 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.179603    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5dccc1d-02cf-4490-99fb-8d53da95c80c" containerName="manager"
Sep 11 20:12:50.179732 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.179616    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5dccc1d-02cf-4490-99fb-8d53da95c80c" containerName="manager"
Sep 11 20:12:50.179732 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.179635    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5dccc1d-02cf-4490-99fb-8d53da95c80c" containerName="manager"
Sep 11 20:12:50.179732 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.179640    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5dccc1d-02cf-4490-99fb-8d53da95c80c" containerName="manager"
Sep 11 20:12:50.179732 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.179703    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5dccc1d-02cf-4490-99fb-8d53da95c80c" containerName="manager"
Sep 11 20:12:50.179732 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.179712    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5dccc1d-02cf-4490-99fb-8d53da95c80c" containerName="manager"
Sep 11 20:12:50.182981 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.182966    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"
Sep 11 20:12:50.185667 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.185645    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pt62h\""
Sep 11 20:12:50.195491 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.195469    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"]
Sep 11 20:12:50.327768 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.327735    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0377923-535e-4968-903a-b6735c18e553-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5fz29\" (UID: \"d0377923-535e-4968-903a-b6735c18e553\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"
Sep 11 20:12:50.327970 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.327807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jddc\" (UniqueName: \"kubernetes.io/projected/d0377923-535e-4968-903a-b6735c18e553-kube-api-access-6jddc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5fz29\" (UID: \"d0377923-535e-4968-903a-b6735c18e553\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"
Sep 11 20:12:50.428617 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.428571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jddc\" (UniqueName: \"kubernetes.io/projected/d0377923-535e-4968-903a-b6735c18e553-kube-api-access-6jddc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5fz29\" (UID: \"d0377923-535e-4968-903a-b6735c18e553\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"
Sep 11 20:12:50.428805 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.428693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0377923-535e-4968-903a-b6735c18e553-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5fz29\" (UID: \"d0377923-535e-4968-903a-b6735c18e553\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"
Sep 11 20:12:50.429076 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.429057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0377923-535e-4968-903a-b6735c18e553-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5fz29\" (UID: \"d0377923-535e-4968-903a-b6735c18e553\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"
Sep 11 20:12:50.441793 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.441728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jddc\" (UniqueName: \"kubernetes.io/projected/d0377923-535e-4968-903a-b6735c18e553-kube-api-access-6jddc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5fz29\" (UID: \"d0377923-535e-4968-903a-b6735c18e553\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"
Sep 11 20:12:50.493507 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.493469    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"
Sep 11 20:12:50.770575 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:50.770546    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"]
Sep 11 20:12:50.771462 ip-10-0-139-38 kubenswrapper[2578]: W0911 20:12:50.771438    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0377923_535e_4968_903a_b6735c18e553.slice/crio-dc39b5fcfdfe2655b4e51642fd8259ed0d995109f86a7c3b15d00cd3ef0c46fa WatchSource:0}: Error finding container dc39b5fcfdfe2655b4e51642fd8259ed0d995109f86a7c3b15d00cd3ef0c46fa: Status 404 returned error can't find the container with id dc39b5fcfdfe2655b4e51642fd8259ed0d995109f86a7c3b15d00cd3ef0c46fa
Sep 11 20:12:51.067652 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:51.067613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29" event={"ID":"d0377923-535e-4968-903a-b6735c18e553","Type":"ContainerStarted","Data":"84c0782f7300d6005b54495c4af49106e8383555bd489321d47e3a7cd29be441"}
Sep 11 20:12:51.067865 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:51.067675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29" event={"ID":"d0377923-535e-4968-903a-b6735c18e553","Type":"ContainerStarted","Data":"dc39b5fcfdfe2655b4e51642fd8259ed0d995109f86a7c3b15d00cd3ef0c46fa"}
Sep 11 20:12:51.067865 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:51.067742    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"
Sep 11 20:12:51.090800 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:12:51.090746    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29" podStartSLOduration=1.090728602 podStartE2EDuration="1.090728602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:12:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:12:51.089215598 +0000 UTC m=+2605.323289021" watchObservedRunningTime="2026-09-11 20:12:51.090728602 +0000 UTC m=+2605.324802023"
Sep 11 20:13:02.075755 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:13:02.075728    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5fz29"
Sep 11 20:14:25.084213 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.084130    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"]
Sep 11 20:14:25.088504 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.088481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.097174 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.097148    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"]
Sep 11 20:14:25.232162 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.232128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-openshift-service-ca\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.232388 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.232187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmwbx\" (UniqueName: \"kubernetes.io/projected/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-kube-api-access-gmwbx\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.232388 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.232231    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-metrics-certs\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.232388 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.232272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-maas-api-tls\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.333522 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.333485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmwbx\" (UniqueName: \"kubernetes.io/projected/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-kube-api-access-gmwbx\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.333728 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.333537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-metrics-certs\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.333728 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.333573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-maas-api-tls\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.333728 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.333661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-openshift-service-ca\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.334383 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.334329    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-openshift-service-ca\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.336234 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.336213    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-metrics-certs\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.336492 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.336470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-maas-api-tls\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.341719 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.341698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmwbx\" (UniqueName: \"kubernetes.io/projected/cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8-kube-api-access-gmwbx\") pod \"maas-api-5f698fdf-k6z2g\" (UID: \"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8\") " pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.403829 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.403787    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:25.681773 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:25.681745    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"]
Sep 11 20:14:25.683366 ip-10-0-139-38 kubenswrapper[2578]: W0911 20:14:25.683337    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd19b1c4_4f2c_46d2_aaec_f17fd4396ff8.slice/crio-5b6021fd6c7d3a44c67660deb98d8a526d5cc80ad57a690638ef7cce8c14474b WatchSource:0}: Error finding container 5b6021fd6c7d3a44c67660deb98d8a526d5cc80ad57a690638ef7cce8c14474b: Status 404 returned error can't find the container with id 5b6021fd6c7d3a44c67660deb98d8a526d5cc80ad57a690638ef7cce8c14474b
Sep 11 20:14:26.565744 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:26.565696    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g" event={"ID":"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8","Type":"ContainerStarted","Data":"b7031734a147d176372fa7e79faf7cd4bbc2ba90ddac1bea6dd49eef69370c92"}
Sep 11 20:14:26.566229 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:26.565757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g" event={"ID":"cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8","Type":"ContainerStarted","Data":"5b6021fd6c7d3a44c67660deb98d8a526d5cc80ad57a690638ef7cce8c14474b"}
Sep 11 20:14:26.566229 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:26.565830    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:26.584808 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:26.584763    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g" podStartSLOduration=1.171591021 podStartE2EDuration="1.584746624s" totalImagesPullingTime="413.155603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:14:26.58374953 +0000 UTC m=+2700.817822951" watchObservedRunningTime="2026-09-11 20:14:26.584746624 +0000 UTC m=+2700.818820084"
Sep 11 20:14:26.786201 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:26.786175    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 20:14:26.795108 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:26.795080    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 20:14:32.577089 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:32.577060    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5f698fdf-k6z2g"
Sep 11 20:14:32.625788 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:32.625757    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"]
Sep 11 20:14:32.626320 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:32.626243    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs" podUID="b50ded27-e876-4d24-8286-8cc6e3f96989" containerName="maas-api" containerID="cri-o://a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b" gracePeriod=30
Sep 11 20:14:32.932316 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:32.932220    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs" podUID="b50ded27-e876-4d24-8286-8cc6e3f96989" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.51:8443/health\": dial tcp 10.133.0.51:8443: connect: connection refused"
Sep 11 20:14:33.882959 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:33.882936    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 20:14:33.910242 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:33.910208    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-metrics-certs\") pod \"b50ded27-e876-4d24-8286-8cc6e3f96989\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") "
Sep 11 20:14:33.910439 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:33.910269    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b50ded27-e876-4d24-8286-8cc6e3f96989-openshift-service-ca\") pod \"b50ded27-e876-4d24-8286-8cc6e3f96989\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") "
Sep 11 20:14:33.910439 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:33.910314    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cr6q\" (UniqueName: \"kubernetes.io/projected/b50ded27-e876-4d24-8286-8cc6e3f96989-kube-api-access-7cr6q\") pod \"b50ded27-e876-4d24-8286-8cc6e3f96989\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") "
Sep 11 20:14:33.910566 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:33.910455    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-maas-api-tls\") pod \"b50ded27-e876-4d24-8286-8cc6e3f96989\" (UID: \"b50ded27-e876-4d24-8286-8cc6e3f96989\") "
Sep 11 20:14:33.910729 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:33.910704    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b50ded27-e876-4d24-8286-8cc6e3f96989-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b50ded27-e876-4d24-8286-8cc6e3f96989" (UID: "b50ded27-e876-4d24-8286-8cc6e3f96989"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:14:33.910864 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:33.910826    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b50ded27-e876-4d24-8286-8cc6e3f96989-openshift-service-ca\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:14:33.912652 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:33.912625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b50ded27-e876-4d24-8286-8cc6e3f96989" (UID: "b50ded27-e876-4d24-8286-8cc6e3f96989"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:14:33.912775 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:33.912704    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b50ded27-e876-4d24-8286-8cc6e3f96989-kube-api-access-7cr6q" (OuterVolumeSpecName: "kube-api-access-7cr6q") pod "b50ded27-e876-4d24-8286-8cc6e3f96989" (UID: "b50ded27-e876-4d24-8286-8cc6e3f96989"). InnerVolumeSpecName "kube-api-access-7cr6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:14:33.912917 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:33.912893    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b50ded27-e876-4d24-8286-8cc6e3f96989" (UID: "b50ded27-e876-4d24-8286-8cc6e3f96989"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:14:34.011423 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.011341    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-maas-api-tls\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:14:34.011423 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.011370    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b50ded27-e876-4d24-8286-8cc6e3f96989-metrics-certs\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:14:34.011423 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.011378    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cr6q\" (UniqueName: \"kubernetes.io/projected/b50ded27-e876-4d24-8286-8cc6e3f96989-kube-api-access-7cr6q\") on node \"ip-10-0-139-38.ec2.internal\" DevicePath \"\""
Sep 11 20:14:34.610442 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.610410    2578 generic.go:356] "Generic (PLEG): container finished" podID="b50ded27-e876-4d24-8286-8cc6e3f96989" containerID="a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b" exitCode=0
Sep 11 20:14:34.610593 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.610451    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs" event={"ID":"b50ded27-e876-4d24-8286-8cc6e3f96989","Type":"ContainerDied","Data":"a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b"}
Sep 11 20:14:34.610593 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.610456    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"
Sep 11 20:14:34.610593 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.610502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5787449d97-bvkzs" event={"ID":"b50ded27-e876-4d24-8286-8cc6e3f96989","Type":"ContainerDied","Data":"a4a9f280652baeeecbb0ea0e890a58cd6c74d4a72eda976f0fe50efccd172a0c"}
Sep 11 20:14:34.610593 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.610525    2578 scope.go:117] "RemoveContainer" containerID="a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b"
Sep 11 20:14:34.619235 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.619218    2578 scope.go:117] "RemoveContainer" containerID="a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b"
Sep 11 20:14:34.619530 ip-10-0-139-38 kubenswrapper[2578]: E0911 20:14:34.619510    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b\": container with ID starting with a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b not found: ID does not exist" containerID="a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b"
Sep 11 20:14:34.619580 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.619538    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b"} err="failed to get container status \"a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b\": rpc error: code = NotFound desc = could not find container \"a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b\": container with ID starting with a16d3c717b80eaf1a984b74cc29e9a9364a490591ae3edaa3cdc4dbfbff1561b not found: ID does not exist"
Sep 11 20:14:34.649173 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.649139    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"]
Sep 11 20:14:34.664069 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:34.664043    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5787449d97-bvkzs"]
Sep 11 20:14:36.257782 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:36.257750    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b50ded27-e876-4d24-8286-8cc6e3f96989" path="/var/lib/kubelet/pods/b50ded27-e876-4d24-8286-8cc6e3f96989/volumes"
Sep 11 20:14:55.723949 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:14:55.723911    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5db8864bb9-tffkl_a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd/authorino/0.log"
Sep 11 20:15:00.830048 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:00.830014    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nnj8n_4514493c-badd-4bf0-aad9-6f9b1561d45b/manager/0.log"
Sep 11 20:15:00.940784 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:00.940750    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bjr5k_f0438961-484c-4373-915f-876376264315/manager/0.log"
Sep 11 20:15:01.078901 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:01.078871    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77545c6848-x82wb_7ace7d7b-9716-4f9e-96f9-f3cd27053a42/manager/0.log"
Sep 11 20:15:01.672294 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:01.672251    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cccd5967-t9f5k_3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f/copy-manifests/0.log"
Sep 11 20:15:01.684026 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:01.684001    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cccd5967-t9f5k_3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f/manager/1.log"
Sep 11 20:15:02.119954 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:02.119920    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5f698fdf-k6z2g_cd19b1c4-4f2c-46d2-aaec-f17fd4396ff8/maas-api/0.log"
Sep 11 20:15:02.554546 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:02.554451    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-wcfnq_57149d4e-110c-4128-a7b4-52f0a4784274/postgres/0.log"
Sep 11 20:15:03.275399 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:03.275354    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5db8864bb9-tffkl_a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd/authorino/0.log"
Sep 11 20:15:03.401097 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:03.401067    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-zcmvw_d28f57b4-d701-4deb-9d1a-2fac325c8766/manager/0.log"
Sep 11 20:15:03.507987 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:03.507959    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-rwwhq_4d173d20-f015-442e-9bbd-0a6eb77a24a8/manager/0.log"
Sep 11 20:15:03.618025 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:03.618000    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-l8hc5_0e1ca10d-1813-41b1-9865-b2f79a49938b/kuadrant-console-plugin/0.log"
Sep 11 20:15:03.736814 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:03.736781    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-5fz29_d0377923-535e-4968-903a-b6735c18e553/manager/0.log"
Sep 11 20:15:03.977892 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:03.977816    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-6j9nt_ce362fb8-9592-4faf-b501-b6937f4c3c9a/manager/0.log"
Sep 11 20:15:04.645302 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:04.645251    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d55d58b74-z2fdn_64bd7522-4040-4b66-9d06-4b464f925695/kube-auth-proxy/0.log"
Sep 11 20:15:04.859674 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:04.859651    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-c6zmp_c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e/payload-pre-processing/0.log"
Sep 11 20:15:05.078212 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:05.078189    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57b5479c4b-82pb9_c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f/router/0.log"
Sep 11 20:15:05.397786 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:05.397708    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hngd2_69c019cb-b0b3-4fec-939e-8a77072cd0c9/main/0.log"
Sep 11 20:15:05.729128 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:05.729043    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-s4dtm_f8e5e06f-3402-44d8-aec8-5932f20d6c60/main/0.log"
Sep 11 20:15:11.371503 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.371469    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-89mbl/must-gather-kkfzc"]
Sep 11 20:15:11.371920 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.371885    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b50ded27-e876-4d24-8286-8cc6e3f96989" containerName="maas-api"
Sep 11 20:15:11.371920 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.371896    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b50ded27-e876-4d24-8286-8cc6e3f96989" containerName="maas-api"
Sep 11 20:15:11.371994 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.371971    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b50ded27-e876-4d24-8286-8cc6e3f96989" containerName="maas-api"
Sep 11 20:15:11.374707 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.374690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89mbl/must-gather-kkfzc"
Sep 11 20:15:11.379441 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.379420    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-89mbl\"/\"kube-root-ca.crt\""
Sep 11 20:15:11.379690 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.379667    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-89mbl\"/\"openshift-service-ca.crt\""
Sep 11 20:15:11.380658 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.380639    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-89mbl\"/\"default-dockercfg-xmf8z\""
Sep 11 20:15:11.405829 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.405795    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89mbl/must-gather-kkfzc"]
Sep 11 20:15:11.446993 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.446960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gbvb\" (UniqueName: \"kubernetes.io/projected/76d45db6-8343-4e20-bc04-445e8f05f236-kube-api-access-7gbvb\") pod \"must-gather-kkfzc\" (UID: \"76d45db6-8343-4e20-bc04-445e8f05f236\") " pod="openshift-must-gather-89mbl/must-gather-kkfzc"
Sep 11 20:15:11.447182 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.447034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/76d45db6-8343-4e20-bc04-445e8f05f236-must-gather-output\") pod \"must-gather-kkfzc\" (UID: \"76d45db6-8343-4e20-bc04-445e8f05f236\") " pod="openshift-must-gather-89mbl/must-gather-kkfzc"
Sep 11 20:15:11.548353 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.548319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gbvb\" (UniqueName: \"kubernetes.io/projected/76d45db6-8343-4e20-bc04-445e8f05f236-kube-api-access-7gbvb\") pod \"must-gather-kkfzc\" (UID: \"76d45db6-8343-4e20-bc04-445e8f05f236\") " pod="openshift-must-gather-89mbl/must-gather-kkfzc"
Sep 11 20:15:11.548521 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.548386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/76d45db6-8343-4e20-bc04-445e8f05f236-must-gather-output\") pod \"must-gather-kkfzc\" (UID: \"76d45db6-8343-4e20-bc04-445e8f05f236\") " pod="openshift-must-gather-89mbl/must-gather-kkfzc"
Sep 11 20:15:11.548696 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.548681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/76d45db6-8343-4e20-bc04-445e8f05f236-must-gather-output\") pod \"must-gather-kkfzc\" (UID: \"76d45db6-8343-4e20-bc04-445e8f05f236\") " pod="openshift-must-gather-89mbl/must-gather-kkfzc"
Sep 11 20:15:11.557590 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.557570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gbvb\" (UniqueName: \"kubernetes.io/projected/76d45db6-8343-4e20-bc04-445e8f05f236-kube-api-access-7gbvb\") pod \"must-gather-kkfzc\" (UID: \"76d45db6-8343-4e20-bc04-445e8f05f236\") " pod="openshift-must-gather-89mbl/must-gather-kkfzc"
Sep 11 20:15:11.684806 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.684728    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89mbl/must-gather-kkfzc"
Sep 11 20:15:11.954314 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:11.954289    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89mbl/must-gather-kkfzc"]
Sep 11 20:15:11.956699 ip-10-0-139-38 kubenswrapper[2578]: W0911 20:15:11.956669    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76d45db6_8343_4e20_bc04_445e8f05f236.slice/crio-ea19e50dd66a93779419ffba59c1380200efdbdca8ca0715d8f102ebda049ae4 WatchSource:0}: Error finding container ea19e50dd66a93779419ffba59c1380200efdbdca8ca0715d8f102ebda049ae4: Status 404 returned error can't find the container with id ea19e50dd66a93779419ffba59c1380200efdbdca8ca0715d8f102ebda049ae4
Sep 11 20:15:12.829910 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:12.829879    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89mbl/must-gather-kkfzc" event={"ID":"76d45db6-8343-4e20-bc04-445e8f05f236","Type":"ContainerStarted","Data":"ea19e50dd66a93779419ffba59c1380200efdbdca8ca0715d8f102ebda049ae4"}
Sep 11 20:15:13.839685 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:13.839646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89mbl/must-gather-kkfzc" event={"ID":"76d45db6-8343-4e20-bc04-445e8f05f236","Type":"ContainerStarted","Data":"b9e9b9e234ff98cea7019fe48a263ada28f75304c61aa1045571e5e050442495"}
Sep 11 20:15:13.840101 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:13.839701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89mbl/must-gather-kkfzc" event={"ID":"76d45db6-8343-4e20-bc04-445e8f05f236","Type":"ContainerStarted","Data":"bedd9ea7f0971e548a1e2814fc8a0cd2c6ccf1dce061aff4bf5da11640c0d270"}
Sep 11 20:15:13.859762 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:13.859710    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-89mbl/must-gather-kkfzc" podStartSLOduration=2.073415008 podStartE2EDuration="2.859694341s" totalImagesPullingTime="786.279333ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:15:13.855564718 +0000 UTC m=+2748.089638139" watchObservedRunningTime="2026-09-11 20:15:13.859694341 +0000 UTC m=+2748.093767762"
Sep 11 20:15:14.279367 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:14.279223    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8fjjd_456845ab-9551-431f-8431-d833f553beef/global-pull-secret-syncer/0.log"
Sep 11 20:15:14.436079 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:14.436050    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nclnv_ce38776a-dcda-4329-a228-ea8834cdb008/konnectivity-agent/0.log"
Sep 11 20:15:14.509643 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:14.509612    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-38.ec2.internal_9a4e57d2e889ae916c1f1beebb193bc0/haproxy/0.log"
Sep 11 20:15:19.195521 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:19.195487    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5db8864bb9-tffkl_a66dd4e5-6b02-4e7c-9d07-db540a5dd0dd/authorino/0.log"
Sep 11 20:15:19.221785 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:19.221753    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-zcmvw_d28f57b4-d701-4deb-9d1a-2fac325c8766/manager/0.log"
Sep 11 20:15:19.246169 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:19.246142    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-rwwhq_4d173d20-f015-442e-9bbd-0a6eb77a24a8/manager/0.log"
Sep 11 20:15:19.274842 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:19.274815    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-l8hc5_0e1ca10d-1813-41b1-9865-b2f79a49938b/kuadrant-console-plugin/0.log"
Sep 11 20:15:19.337026 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:19.336913    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-5fz29_d0377923-535e-4968-903a-b6735c18e553/manager/0.log"
Sep 11 20:15:19.435389 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:19.435358    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-6j9nt_ce362fb8-9592-4faf-b501-b6937f4c3c9a/manager/0.log"
Sep 11 20:15:20.833990 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:20.833961    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01b996fb-a303-4812-be1c-d9c908024e84/alertmanager/0.log"
Sep 11 20:15:20.856805 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:20.856779    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01b996fb-a303-4812-be1c-d9c908024e84/config-reloader/0.log"
Sep 11 20:15:20.887489 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:20.887462    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01b996fb-a303-4812-be1c-d9c908024e84/kube-rbac-proxy-web/0.log"
Sep 11 20:15:20.913310 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:20.913278    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01b996fb-a303-4812-be1c-d9c908024e84/kube-rbac-proxy/0.log"
Sep 11 20:15:20.938907 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:20.938869    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01b996fb-a303-4812-be1c-d9c908024e84/kube-rbac-proxy-metric/0.log"
Sep 11 20:15:20.961615 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:20.961582    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01b996fb-a303-4812-be1c-d9c908024e84/prom-label-proxy/0.log"
Sep 11 20:15:20.984596 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:20.984568    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01b996fb-a303-4812-be1c-d9c908024e84/init-config-reloader/0.log"
Sep 11 20:15:21.046452 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:21.046422    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-2ftt4_f6188ee1-7af8-498b-8361-0733f5531394/cluster-monitoring-operator/0.log"
Sep 11 20:15:21.178360 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:21.178242    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-jls84_90a0938b-6206-4ac6-9125-86c3fc255d7d/monitoring-plugin/0.log"
Sep 11 20:15:21.408079 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:21.407563    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tnn2z_42aea996-aa20-4104-8165-53908543c58e/node-exporter/0.log"
Sep 11 20:15:21.429231 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:21.429132    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tnn2z_42aea996-aa20-4104-8165-53908543c58e/kube-rbac-proxy/0.log"
Sep 11 20:15:21.457350 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:21.457291    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tnn2z_42aea996-aa20-4104-8165-53908543c58e/init-textfile/0.log"
Sep 11 20:15:22.134662 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:22.134635    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bcd6f-bkmmn_b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b/telemeter-client/0.log"
Sep 11 20:15:22.165486 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:22.165461    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bcd6f-bkmmn_b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b/reload/0.log"
Sep 11 20:15:22.188987 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:22.188960    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bcd6f-bkmmn_b5ed1793-1dfb-4cd4-9946-fed8cc80cd8b/kube-rbac-proxy/0.log"
Sep 11 20:15:22.231852 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:22.231816    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854b59dffc-b5pmx_d9dec28a-2042-484e-8cbc-2d48b8e4aaa2/thanos-query/0.log"
Sep 11 20:15:22.270356 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:22.270331    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854b59dffc-b5pmx_d9dec28a-2042-484e-8cbc-2d48b8e4aaa2/kube-rbac-proxy-web/0.log"
Sep 11 20:15:22.290716 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:22.290683    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854b59dffc-b5pmx_d9dec28a-2042-484e-8cbc-2d48b8e4aaa2/kube-rbac-proxy/0.log"
Sep 11 20:15:22.309193 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:22.309167    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854b59dffc-b5pmx_d9dec28a-2042-484e-8cbc-2d48b8e4aaa2/prom-label-proxy/0.log"
Sep 11 20:15:22.331532 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:22.331492    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854b59dffc-b5pmx_d9dec28a-2042-484e-8cbc-2d48b8e4aaa2/kube-rbac-proxy-rules/0.log"
Sep 11 20:15:22.356801 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:22.356771    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854b59dffc-b5pmx_d9dec28a-2042-484e-8cbc-2d48b8e4aaa2/kube-rbac-proxy-metrics/0.log"
Sep 11 20:15:24.217609 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.217546    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/2.log"
Sep 11 20:15:24.224085 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.224058    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kcmtv_82e402d8-49e7-48bb-9d9c-b64ff6b64e9e/console-operator/3.log"
Sep 11 20:15:24.663792 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.663735    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"]
Sep 11 20:15:24.672081 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.672050    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.678130 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.678102    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"]
Sep 11 20:15:24.709824 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.709782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-proc\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.710131 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.710112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-podres\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.710275 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.710243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-sys\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.710396 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.710381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzgzg\" (UniqueName: \"kubernetes.io/projected/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-kube-api-access-lzgzg\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.710507 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.710494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-lib-modules\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.799483 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.799454    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6986d97c98-rg6pg_fe1899d1-c74a-4967-81fb-5f373c374ed9/console/0.log"
Sep 11 20:15:24.811331 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.811291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-proc\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.811513 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.811389    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-podres\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.811513 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.811439    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-sys\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.811513 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.811470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzgzg\" (UniqueName: \"kubernetes.io/projected/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-kube-api-access-lzgzg\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.812012 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.811511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-lib-modules\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.812012 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.811533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-podres\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.812012 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.811585    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-proc\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.812012 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.811678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-sys\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.812012 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.811781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-lib-modules\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.820418 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.820357    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzgzg\" (UniqueName: \"kubernetes.io/projected/d54f8ba8-2a1e-41f3-afb4-037d7008cc01-kube-api-access-lzgzg\") pod \"perf-node-gather-daemonset-xbhrg\" (UID: \"d54f8ba8-2a1e-41f3-afb4-037d7008cc01\") " pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:24.835056 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.835027    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-cv8cv_2022384e-6b81-4d04-a091-44e464490a58/download-server/0.log"
Sep 11 20:15:24.986348 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:24.986253    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:25.269704 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:25.269677    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"]
Sep 11 20:15:25.518465 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:25.518435    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-lvd8b_69bfd8d1-1e43-4168-b4f0-b67f1351dfc4/volume-data-source-validator/0.log"
Sep 11 20:15:25.941101 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:25.941066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg" event={"ID":"d54f8ba8-2a1e-41f3-afb4-037d7008cc01","Type":"ContainerStarted","Data":"fd1c9ecbd835cf870cdab7e29a0fee07232de272762e0eaf62c802c284332f1b"}
Sep 11 20:15:25.941456 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:25.941430    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg" event={"ID":"d54f8ba8-2a1e-41f3-afb4-037d7008cc01","Type":"ContainerStarted","Data":"f5098caf16d7200ac99bf09153aaec55d0521fce37b02d48fe55c2c5c4b2f9ba"}
Sep 11 20:15:25.941787 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:25.941770    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:25.959644 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:25.959599    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg" podStartSLOduration=1.9595833580000002 podStartE2EDuration="1.959583358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:15:25.958093976 +0000 UTC m=+2760.192167395" watchObservedRunningTime="2026-09-11 20:15:25.959583358 +0000 UTC m=+2760.193656779"
Sep 11 20:15:26.746733 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:26.746702    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6gvkd_33a886a5-12de-4d3a-a526-be3331fdc058/dns/0.log"
Sep 11 20:15:26.765691 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:26.765669    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6gvkd_33a886a5-12de-4d3a-a526-be3331fdc058/kube-rbac-proxy/0.log"
Sep 11 20:15:26.827309 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:26.827280    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-csxbt_5872393d-579f-412d-8edc-bfb8b84c2492/dns-node-resolver/0.log"
Sep 11 20:15:27.463165 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:27.463132    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d5f659b96-k46cs_dcab1ffc-45e4-48e4-8d9b-65ecb68e9d89/registry/0.log"
Sep 11 20:15:27.553765 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:27.553741    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rq2xf_2cd6a92e-3d43-4c3b-bbc6-fb145c5adfcc/node-ca/0.log"
Sep 11 20:15:29.065452 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:29.065428    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d55d58b74-z2fdn_64bd7522-4040-4b66-9d06-4b464f925695/kube-auth-proxy/0.log"
Sep 11 20:15:29.130451 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:29.130423    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-c6zmp_c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e/payload-pre-processing/0.log"
Sep 11 20:15:29.190656 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:29.190627    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57b5479c4b-82pb9_c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f/router/0.log"
Sep 11 20:15:30.086481 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:30.086452    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqj7n_05887d0c-30a1-4f39-a721-349343bcd827/serve-healthcheck-canary/0.log"
Sep 11 20:15:30.812839 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:30.812811    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n2tfr_aa43f2be-8cbd-4298-afc6-7d829039738e/kube-rbac-proxy/0.log"
Sep 11 20:15:30.854088 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:30.854064    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n2tfr_aa43f2be-8cbd-4298-afc6-7d829039738e/exporter/0.log"
Sep 11 20:15:30.875781 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:30.875757    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n2tfr_aa43f2be-8cbd-4298-afc6-7d829039738e/extractor/0.log"
Sep 11 20:15:31.962393 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:31.962362    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-89mbl/perf-node-gather-daemonset-xbhrg"
Sep 11 20:15:33.052885 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:33.052859    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nnj8n_4514493c-badd-4bf0-aad9-6f9b1561d45b/manager/0.log"
Sep 11 20:15:33.416063 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:33.416033    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bjr5k_f0438961-484c-4373-915f-876376264315/manager/0.log"
Sep 11 20:15:33.486968 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:33.486925    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77545c6848-x82wb_7ace7d7b-9716-4f9e-96f9-f3cd27053a42/manager/0.log"
Sep 11 20:15:33.724342 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:33.724206    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cccd5967-t9f5k_3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f/manager/0.log"
Sep 11 20:15:33.791309 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:33.791251    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cccd5967-t9f5k_3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f/manager/1.log"
Sep 11 20:15:33.809412 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:33.809378    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cccd5967-t9f5k_3b0bc630-d0bf-4f2f-87c4-26adf3cf9a0f/copy-manifests/0.log"
Sep 11 20:15:35.461039 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:35.461010    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d55d58b74-z2fdn_64bd7522-4040-4b66-9d06-4b464f925695/kube-auth-proxy/0.log"
Sep 11 20:15:35.508926 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:35.508892    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-c6zmp_c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e/payload-pre-processing/0.log"
Sep 11 20:15:35.546439 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:35.546409    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57b5479c4b-82pb9_c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f/router/0.log"
Sep 11 20:15:37.580314 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:37.580281    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d55d58b74-z2fdn_64bd7522-4040-4b66-9d06-4b464f925695/kube-auth-proxy/0.log"
Sep 11 20:15:37.634874 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:37.634849    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-c6zmp_c1ac95a9-d377-4ebc-a8ba-6e1ce653c04e/payload-pre-processing/0.log"
Sep 11 20:15:37.672653 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:37.672621    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57b5479c4b-82pb9_c6ccfd5b-fb8a-40d5-81fb-a8cfe305e10f/router/0.log"
Sep 11 20:15:40.233991 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:40.233960    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-7mmwb_cf231fad-024c-4086-97f1-144d81d4f4b8/migrator/0.log"
Sep 11 20:15:40.251885 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:40.251857    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-7mmwb_cf231fad-024c-4086-97f1-144d81d4f4b8/graceful-termination/0.log"
Sep 11 20:15:40.584393 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:40.584363    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-pnqh4_bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e/kube-storage-version-migrator-operator/1.log"
Sep 11 20:15:40.585323 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:40.585305    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-pnqh4_bdf5ef96-5c81-4d9e-bac4-fb2ebad0201e/kube-storage-version-migrator-operator/0.log"
Sep 11 20:15:41.697219 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:41.697172    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-98w86_b0c17656-4b24-4f0a-b0a9-10276727ab3b/kube-multus/0.log"
Sep 11 20:15:41.991569 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:41.991497    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zbz_ebf7726b-4997-49d9-8caf-0f2996bef34b/kube-multus-additional-cni-plugins/0.log"
Sep 11 20:15:42.009675 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:42.009643    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zbz_ebf7726b-4997-49d9-8caf-0f2996bef34b/egress-router-binary-copy/0.log"
Sep 11 20:15:42.028427 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:42.028394    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zbz_ebf7726b-4997-49d9-8caf-0f2996bef34b/cni-plugins/0.log"
Sep 11 20:15:42.046511 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:42.046483    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zbz_ebf7726b-4997-49d9-8caf-0f2996bef34b/bond-cni-plugin/0.log"
Sep 11 20:15:42.065616 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:42.065592    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zbz_ebf7726b-4997-49d9-8caf-0f2996bef34b/routeoverride-cni/0.log"
Sep 11 20:15:42.084554 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:42.084519    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zbz_ebf7726b-4997-49d9-8caf-0f2996bef34b/whereabouts-cni-bincopy/0.log"
Sep 11 20:15:42.103992 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:42.103964    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zbz_ebf7726b-4997-49d9-8caf-0f2996bef34b/whereabouts-cni/0.log"
Sep 11 20:15:42.133569 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:42.133536    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bw2r8_d3883618-051d-4804-aa8d-222af6c1e9f7/network-metrics-daemon/0.log"
Sep 11 20:15:42.147763 ip-10-0-139-38 kubenswrapper[2578]: I0911 20:15:42.147737    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bw2r8_d3883618-051d-4804-aa8d-222af6c1e9f7/kube-rbac-proxy/0.log"