Sep 11 14:15:01.343130 ip-10-0-134-221 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 14:15:01.743560 ip-10-0-134-221 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:01.743560 ip-10-0-134-221 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 14:15:01.743560 ip-10-0-134-221 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:01.743560 ip-10-0-134-221 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 14:15:01.743560 ip-10-0-134-221 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:01.745334 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.745232    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 14:15:01.751768 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751747    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:01.751768 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751764    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:01.751768 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751769    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:01.751768 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751773    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751776    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751780    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751783    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751786    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751789    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751791    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751794    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751797    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751799    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751802    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751805    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751807    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751810    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751812    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751816    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751818    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751821    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751824    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:01.751958 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751826    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751829    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751831    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751847    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751852    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751854    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751857    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751859    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751862    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751864    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751867    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751870    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751873    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751875    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751878    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751882    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751885    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751887    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751890    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751892    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:01.752425 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751895    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751898    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751901    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751903    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751906    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751909    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751911    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751914    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751917    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751920    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751923    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751927    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751930    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751933    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751936    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751939    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751942    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751944    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751948    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751953    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:01.752962 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751956    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751960    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751963    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751966    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751969    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751972    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751975    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751978    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751981    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751984    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751987    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751989    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751992    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751994    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751997    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.751999    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752002    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752004    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752007    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752010    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:01.753452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752012    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752015    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752018    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752020    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752023    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752026    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752028    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752031    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752033    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752035    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752038    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752040    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752043    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752045    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752049    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752053    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752057    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752734    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752741    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:01.753998 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752745    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752747    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752750    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752753    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752756    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752758    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752763    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752766    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752770    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752773    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752776    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752779    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752781    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752784    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752786    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752790    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752793    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752795    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752798    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752800    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:01.754452 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752803    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752806    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752808    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752811    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752813    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752816    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752819    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752821    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752824    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752826    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752829    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752831    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752856    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752860    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752863    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752866    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752869    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752871    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752874    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752877    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:01.754964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752879    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752882    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752885    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752888    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752890    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752893    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752895    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752898    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752903    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752905    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752908    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752910    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752913    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752915    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752918    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752921    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752923    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752930    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752933    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:01.755490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752935    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752938    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752940    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752943    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752947    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752951    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752955    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752958    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752961    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752964    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752968    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752972    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752974    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752977    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752981    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752984    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752986    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752989    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752992    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:01.755967 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752994    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752997    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.752999    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753002    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753005    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753007    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753010    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753012    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753016    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753018    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753021    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753025    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753028    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753030    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753033    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753036    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753038    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753041    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753043    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753393    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:01.756426 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753397    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753400    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753403    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753406    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753408    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753411    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753413    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753416    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753419    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753421    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753424    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753426    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753429    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753431    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753434    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753437    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753439    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753442    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753445    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753447    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:01.756925 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753450    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753453    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753456    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753461    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753463    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753466    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753469    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753471    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753474    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753476    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753479    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753482    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753484    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753487    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753491    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753494    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753497    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753499    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753502    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753504    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:01.757408 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753507    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753509    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753512    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753514    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753517    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753519    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753522    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753524    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753528    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753531    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753534    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753536    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753539    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753542    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753544    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753548    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753551    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753553    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753555    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753558    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:01.757900 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753560    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753563    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753565    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753568    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753570    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753573    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753576    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753579    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753581    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753584    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753586    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753589    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753592    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753596    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753599    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753602    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753605    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753608    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753611    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:01.758383 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753614    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753616    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753619    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753622    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753624    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753627    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753629    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753634    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753638    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753641    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753644    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753647    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753649    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753652    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753655    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753657    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753660    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753662    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.753665    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753733    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 14:15:01.758858 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753770    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753777    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753784    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753789    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753792    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753796    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753801    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753804    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753807    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753810    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753814    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753817    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753820    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753823    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753826    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753829    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753832    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753856    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753860    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753863    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753867    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753871    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753875    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 14:15:01.759343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753878    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753881    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753885    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753888    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753891    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753894    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753897    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753900    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753904    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753914    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753918    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753921    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753924    2581 flags.go:64] FLAG: --enable-server="true"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753927    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753933    2581 flags.go:64] FLAG: --event-burst="100"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753936    2581 flags.go:64] FLAG: --event-qps="50"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753939    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753942    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753945    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753949    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753952    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753955    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753958    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753961    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753963    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 14:15:01.759906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753967    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753973    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753976    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753979    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753983    2581 flags.go:64] FLAG: --feature-gates=""
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753987    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753990    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753993    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753996    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.753999    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754003    2581 flags.go:64] FLAG: --help="false"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754005    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-134-221.ec2.internal"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754009    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754012    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754015    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754018    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754021    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754024    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754027    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754030    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754033    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754036    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754039    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754042    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 11 14:15:01.760545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754045    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754047    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754050    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754053    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754056    2581 flags.go:64] FLAG: --lock-file=""
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754059    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754062    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754065    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754070    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754074    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754077    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754080    2581 flags.go:64] FLAG: --logging-format="text"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754084    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754087    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754090    2581 flags.go:64] FLAG: --manifest-url=""
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754093    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754097    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754100    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754104    2581 flags.go:64] FLAG: --max-pods="110"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754107    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754110    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754113    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754116    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754119    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754122    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 14:15:01.761174 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754125    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754134    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754137    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754140    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754143    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754145    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754151    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754154    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754157    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754160    2581 flags.go:64] FLAG: --port="10250"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754163    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754166    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-076231f0f1ab3b0b9"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754169    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754172    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754175    2581 flags.go:64] FLAG: --register-node="true"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754178    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754183    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754186    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754189    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754192    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754197    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754200    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754203    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754206    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754209    2581 flags.go:64] FLAG: --runonce="false"
Sep 11 14:15:01.761782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754211    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754214    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754218    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754220    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754223    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754226    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754229    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754233    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754235    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754239    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754241    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754244    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754247    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754250    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754253    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754258    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754261    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754263    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754267    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754270    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754273    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754275    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754278    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754282    2581 flags.go:64] FLAG: --v="2"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754286    2581 flags.go:64] FLAG: --version="false"
Sep 11 14:15:01.762414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754290    2581 flags.go:64] FLAG: --vmodule=""
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754295    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754300    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754416    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754420    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754423    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754425    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754428    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754431    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754434    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754436    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754439    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754442    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754445    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754448    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754450    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754453    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754456    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754459    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:01.763016 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754462    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754464    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754467    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754469    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754472    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754476    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754480    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754482    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754485    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754489    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754493    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754497    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754500    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754502    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754505    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754510    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754512    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754515    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754518    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:01.763491 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754520    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754523    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754526    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754529    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754531    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754534    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754536    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754539    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754542    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754544    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754547    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754550    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754552    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754555    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754558    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754560    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754563    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754565    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754568    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754571    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:01.764009 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754573    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754576    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754578    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754581    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754584    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754587    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754589    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754592    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754596    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754599    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754601    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754604    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754606    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754609    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754612    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754614    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754617    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754619    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754622    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754625    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:01.764523 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754627    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754630    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754632    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754635    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754637    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754640    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754644    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754647    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754651    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754653    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754656    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754659    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754661    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754664    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754667    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754669    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754673    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754676    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754679    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:01.765112 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754681    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754686    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754689    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754692    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.754694    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.754700    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.762330    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.762344    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.762364    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.762370    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762424    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762428    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762432    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762435    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762438    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:01.765579 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762441    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762444    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762447    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762449    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762452    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762455    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762458    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762461    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762463    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762466    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762469    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762471    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762474    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762477    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762480    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762482    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762485    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762487    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762490    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762492    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:01.765988 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762495    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762498    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762500    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762503    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762507    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762510    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762512    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762515    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762517    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762520    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762523    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762525    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762528    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762530    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762533    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762535    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762539    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762543    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762546    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762549    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:01.766490 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762551    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762554    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762557    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762559    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762562    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762565    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762567    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762571    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762575    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762578    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762581    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762583    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762586    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762590    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762593    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762597    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762601    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762604    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762607    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:01.767034 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762610    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762613    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762616    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762619    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762621    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762623    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762626    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762629    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762631    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762634    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762637    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762639    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762641    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762644    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762647    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762649    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762652    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762654    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762657    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762659    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:01.767528 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762662    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762664    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762667    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762669    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762672    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762675    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762677    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762680    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762683    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762685    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762688    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762691    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762693    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762696    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762699    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:01.768122 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.762703    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762814    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762819    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762822    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762824    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762827    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762830    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762832    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762851    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762854    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762857    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762859    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762863    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762867    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762870    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762873    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762875    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762878    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762880    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:01.768495 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762883    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762885    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762888    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762890    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762893    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762896    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762899    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762901    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762904    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762908    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762912    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762915    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762918    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762921    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762924    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762926    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762929    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762932    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762934    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762937    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:01.768994 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762939    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762942    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762944    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762948    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762951    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762954    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762956    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762960    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762963    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762965    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762968    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762971    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762974    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762977    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762979    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762982    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762985    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762988    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762991    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762993    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:01.769474 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762996    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.762998    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763001    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763007    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763010    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763012    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763015    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763017    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763020    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763023    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763025    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763028    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763031    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763033    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763036    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763039    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763041    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763044    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763047    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763049    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:01.770067 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763052    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763054    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763057    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763059    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763062    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763064    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763067    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763069    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763072    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763074    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763077    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763080    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763082    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763085    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763087    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763090    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763093    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763095    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763098    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:01.770624 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763100    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:01.771400 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:01.763103    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:01.771400 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.763107    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:01.771400 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.764101    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 14:15:01.771400 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.766343    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 14:15:01.771400 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.767393    2581 server.go:1019] "Starting client certificate rotation"
Sep 11 14:15:01.771400 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.767502    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 14:15:01.771400 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.767550    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 14:15:01.771400 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.770294    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 14:15:01.771649 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.771429    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 14:15:01.784489 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.784468    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 11 14:15:01.788620 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.788602    2581 log.go:25] "Validated CRI v1 image API"
Sep 11 14:15:01.789446 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.789431    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 14:15:01.793444 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.793426    2581 fs.go:135] Filesystem UUIDs: map[139793aa-2981-48f1-85a3-a995b63db5ad:/dev/nvme0n1p3 3562c3c7-4022-4588-aa34-3d2839fcb2ab:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 11 14:15:01.793501 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.793444    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 14:15:01.795810 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.795790    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 14:15:01.799574 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.799469    2581 manager.go:216] Machine: {Timestamp:2026-09-11 14:15:01.797157041 +0000 UTC m=+0.347209661 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3119976 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f02af82c739bae9e7fb89901db3c5 SystemUUID:ec2f02af-82c7-39ba-e9e7-fb89901db3c5 BootID:ec3af0ab-f432-4ca2-a2b4-47a1a054dfef Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:56:d1:b5:9e:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:56:d1:b5:9e:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:1d:15:0a:e8:46 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 14:15:01.799574 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.799575    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 14:15:01.799682 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.799649    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 14:15:01.802909 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.802887    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 14:15:01.803045 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.802912    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 14:15:01.803719 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.803710    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 14:15:01.803752 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.803722    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 14:15:01.803752 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.803730    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 14:15:01.804519 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.804508    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 14:15:01.805828 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.805819    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 14:15:01.810202 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.810191    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 14:15:01.810306 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.810297    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 14:15:01.810334 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.810324    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 14:15:01.810334 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.810334    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 14:15:01.810391 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.810352    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 14:15:01.810391 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.810361    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 11 14:15:01.810391 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.810370    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 14:15:01.810706 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.810695    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 14:15:01.810752 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.810713    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 14:15:01.813092 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.813074    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 14:15:01.815855 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.815827    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 14:15:01.815947 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.815880    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 14:15:01.817894 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.817879    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 14:15:01.817970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.817899    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 14:15:01.817970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.817914    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 14:15:01.817970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.817922    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 14:15:01.817970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.817935    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 14:15:01.817970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.817943    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 14:15:01.817970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.817963    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 14:15:01.817970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.817971    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 14:15:01.818185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.817981    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 14:15:01.818185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.817990    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 14:15:01.818185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.818002    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 14:15:01.818185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.818009    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 14:15:01.818972 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.818957    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 14:15:01.819029 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.818975    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 14:15:01.819855 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:01.819820    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 14:15:01.819937 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:01.819823    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 14:15:01.820903 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.820882    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 14:15:01.822716 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.822701    2581 server.go:1268] "Started kubelet"
Sep 11 14:15:01.822832 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.822783    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 14:15:01.823232 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.822777    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 14:15:01.823378 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.823333    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 14:15:01.823677 ip-10-0-134-221 systemd[1]: Started Kubernetes Kubelet.
Sep 11 14:15:01.827055 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.827030    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 14:15:01.827309 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.827217    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mvqhl"
Sep 11 14:15:01.830871 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.830827    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 14:15:01.831051 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:01.831033    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 14:15:01.833116 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:01.832030    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-221.ec2.internal.18d449ce2bf7ba13  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-221.ec2.internal,UID:ip-10-0-134-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-221.ec2.internal,},FirstTimestamp:2026-09-11 14:15:01.822675475 +0000 UTC m=+0.372728092,LastTimestamp:2026-09-11 14:15:01.822675475 +0000 UTC m=+0.372728092,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-221.ec2.internal,}"
Sep 11 14:15:01.834088 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.834072    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mvqhl"
Sep 11 14:15:01.835614 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.835598    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 14:15:01.837227 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.836715    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 14:15:01.837304 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:01.837273    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:01.838127 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838109    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 14:15:01.838127 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838111    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 14:15:01.838281 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838126    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 14:15:01.838281 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838164    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 14:15:01.838281 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838177    2581 factory.go:55] Registering systemd factory
Sep 11 14:15:01.838281 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838185    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 11 14:15:01.838453 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838307    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 14:15:01.838453 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838321    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 14:15:01.838533 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838477    2581 factory.go:153] Registering CRI-O factory
Sep 11 14:15:01.838533 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838493    2581 factory.go:223] Registration of the crio container factory successfully
Sep 11 14:15:01.838533 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838510    2581 factory.go:103] Registering Raw factory
Sep 11 14:15:01.838648 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.838547    2581 manager.go:1196] Started watching for new ooms in manager
Sep 11 14:15:01.839809 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.839794    2581 manager.go:349] Starting recovery of all containers
Sep 11 14:15:01.841701 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.841682    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:01.844854 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:01.844821    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-221.ec2.internal\" not found" node="ip-10-0-134-221.ec2.internal"
Sep 11 14:15:01.850492 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.850340    2581 manager.go:354] Recovery completed
Sep 11 14:15:01.852419 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:01.851969    2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 11 14:15:01.855048 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.855036    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:01.857593 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.857578    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:01.857684 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.857605    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:01.857684 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.857618    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:01.858256 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.858240    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 14:15:01.858256 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.858254    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 14:15:01.858375 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.858272    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 14:15:01.858733 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.858719    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:01.859648 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.859633    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:01.859704 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.859664    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:01.859704 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.859678    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:01.860369 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.860352    2581 policy_none.go:49] "None policy: Start"
Sep 11 14:15:01.860432 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.860375    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 14:15:01.860432 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.860388    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 14:15:01.862382 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.862369    2581 policy_none.go:47] "Start"
Sep 11 14:15:01.913409 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.902471    2581 manager.go:337] "Starting Device Plugin manager"
Sep 11 14:15:01.913409 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:01.902501    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 14:15:01.913409 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.902511    2581 server.go:87] "Starting device plugin registration server"
Sep 11 14:15:01.913409 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.902811    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 14:15:01.913409 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.902826    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 14:15:01.913409 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.902904    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 14:15:01.913409 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.902970    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 14:15:01.913409 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.902976    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 14:15:01.913409 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:01.904432    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 14:15:01.913409 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:01.904474    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:01.932009 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.931980    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 14:15:01.933187 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.933166    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 14:15:01.933244 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.933222    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 14:15:01.933288 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.933251    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 14:15:01.933336 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:01.933298    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 14:15:01.935740 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:01.935719    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:02.003128 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.003041    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:02.004062 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.004047    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:02.004131 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.004079    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:02.004131 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.004094    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:02.004131 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.004125    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.012385 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.012370    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.012429 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:02.012393    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-221.ec2.internal\": node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:02.030892 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:02.030866    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:02.033893 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.033875    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal"]
Sep 11 14:15:02.033951 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.033944    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:02.037135 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.037118    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:02.037215 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.037150    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:02.037215 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.037161    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:02.039311 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.039293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e208b9b44ef68d231c84be9a35fef8d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"e208b9b44ef68d231c84be9a35fef8d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.039387 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.039319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e208b9b44ef68d231c84be9a35fef8d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"e208b9b44ef68d231c84be9a35fef8d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.039478 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.039468    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:02.039637 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.039623    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.039672 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.039653    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:02.040258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.040236    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:02.040258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.040250    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:02.040366 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.040264    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:02.040366 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.040272    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:02.040366 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.040274    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:02.040366 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.040285    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:02.042418 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.042403    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.042459 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.042435    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:02.045815 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.045799    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:02.045935 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.045828    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:02.045935 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.045858    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:02.061409 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:02.061384    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-221.ec2.internal\" not found" node="ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.067097 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:02.067082    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-221.ec2.internal\" not found" node="ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.131901 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:02.131880    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:02.139415 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.139398    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e208b9b44ef68d231c84be9a35fef8d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"e208b9b44ef68d231c84be9a35fef8d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.139469 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.139419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e208b9b44ef68d231c84be9a35fef8d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"e208b9b44ef68d231c84be9a35fef8d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.139469 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.139440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf9210cb0f0acda6060912348c982576-config\") pod \"kube-apiserver-proxy-ip-10-0-134-221.ec2.internal\" (UID: \"cf9210cb0f0acda6060912348c982576\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.139533 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.139498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e208b9b44ef68d231c84be9a35fef8d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"e208b9b44ef68d231c84be9a35fef8d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.139533 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.139507    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e208b9b44ef68d231c84be9a35fef8d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"e208b9b44ef68d231c84be9a35fef8d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.232787 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:02.232766    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:02.240058 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.240040    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf9210cb0f0acda6060912348c982576-config\") pod \"kube-apiserver-proxy-ip-10-0-134-221.ec2.internal\" (UID: \"cf9210cb0f0acda6060912348c982576\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.240108 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.240086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf9210cb0f0acda6060912348c982576-config\") pod \"kube-apiserver-proxy-ip-10-0-134-221.ec2.internal\" (UID: \"cf9210cb0f0acda6060912348c982576\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.333482 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:02.333428    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:02.363926 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.363909    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.370782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:02.370766    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:02.434442 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:02.434422    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:02.534946 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:02.534930    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:02.635560 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:02.635488    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:04.655396 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:04.655376    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:04.686808 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.686782    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 14:15:04.687247 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.686913    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 14:15:04.687247 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.686913    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 14:15:04.755786 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:04.755764    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found"
Sep 11 14:15:04.756617 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.756591    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 14:10:03 +0000 UTC" deadline="2028-02-12 19:18:44.988285779 +0000 UTC"
Sep 11 14:15:04.756674 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.756618    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12461h3m40.231671009s"
Sep 11 14:15:04.840502 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:04.840470    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode208b9b44ef68d231c84be9a35fef8d8.slice/crio-3fa5affee83beb672e1bad813298fef6032916b9fe560d961a36aac2ed58dbd9 WatchSource:0}: Error finding container 3fa5affee83beb672e1bad813298fef6032916b9fe560d961a36aac2ed58dbd9: Status 404 returned error can't find the container with id 3fa5affee83beb672e1bad813298fef6032916b9fe560d961a36aac2ed58dbd9
Sep 11 14:15:04.841718 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.841700    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:04.843734 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.843722    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:15:04.856284 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.856249    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" event={"ID":"e208b9b44ef68d231c84be9a35fef8d8","Type":"ContainerStarted","Data":"3fa5affee83beb672e1bad813298fef6032916b9fe560d961a36aac2ed58dbd9"}
Sep 11 14:15:04.857664 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.857649    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:04.875231 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.875215    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 14:15:04.876782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.876770    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal"
Sep 11 14:15:04.891358 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:04.891343    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 14:15:05.335030 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.335009    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:05.675073 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.675012    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:05.725986 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:05.725959    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9210cb0f0acda6060912348c982576.slice/crio-1bee1d6cb5dc25ed6ddd1920a3ae50535c17c4f8bbd8537319ed683b524888a1 WatchSource:0}: Error finding container 1bee1d6cb5dc25ed6ddd1920a3ae50535c17c4f8bbd8537319ed683b524888a1: Status 404 returned error can't find the container with id 1bee1d6cb5dc25ed6ddd1920a3ae50535c17c4f8bbd8537319ed683b524888a1
Sep 11 14:15:05.730889 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.730871    2581 apiserver.go:52] "Watching apiserver"
Sep 11 14:15:05.738187 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.738167    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 14:15:05.738559 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.738537    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-hxhlm","kube-system/global-pull-secret-syncer-lltwm","kube-system/konnectivity-agent-xnwmb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd","openshift-dns/node-resolver-pc9xn","openshift-image-registry/node-ca-jr657","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal","openshift-multus/multus-2vdq7","openshift-multus/multus-additional-cni-plugins-7x7z9","kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal","openshift-cluster-node-tuning-operator/tuned-fs5bb","openshift-multus/network-metrics-daemon-spn95","openshift-network-diagnostics/network-check-target-k54nn","openshift-network-operator/iptables-alerter-2vm9z"]
Sep 11 14:15:05.741192 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.741172    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.743216 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.743199    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2vm9z"
Sep 11 14:15:05.743801 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.743782    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 14:15:05.743863 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.743814    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 14:15:05.743863 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.743851    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 14:15:05.743996 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.743983    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 14:15:05.744048 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.744035    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 14:15:05.744317 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.744304    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xqtkw\""
Sep 11 14:15:05.745308 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.745289    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:05.745404 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.745353    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:15:05.745461 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.745414    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 14:15:05.745640 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.745627    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 14:15:05.745704 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.745677    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qzrvc\""
Sep 11 14:15:05.747617 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.747371    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:05.747617 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:05.747436    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:05.747617 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.747509    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 14:15:05.747617 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.747535    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 14:15:05.747617 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.747543    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bmlww\""
Sep 11 14:15:05.749618 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.749601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.751678 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.751657    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jr657"
Sep 11 14:15:05.753113 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.752957    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dwfz2\""
Sep 11 14:15:05.753113 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.753050    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 14:15:05.753440 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.753421    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:15:05.753911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.753897    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.753967 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.753931    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 14:15:05.754398 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.754381    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 14:15:05.754496 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.754477    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hq7h7\""
Sep 11 14:15:05.755200 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.755183    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 14:15:05.755929 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.755913    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 14:15:05.756127 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.756099    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 14:15:05.756224 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.756170    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h65r4\""
Sep 11 14:15:05.756301 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.756285    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.758644 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.758628    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pc9xn"
Sep 11 14:15:05.758814 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.758743    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 14:15:05.758814 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.758778    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 14:15:05.759352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.759318    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 14:15:05.759352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.759344    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8qnb5\""
Sep 11 14:15:05.759508 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.759395    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 14:15:05.759619 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.759598    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 14:15:05.759692 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.759628    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 14:15:05.760752 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.760737    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 14:15:05.760930 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.760916    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.761967 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.761946    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 14:15:05.763237 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.763218    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z27gd\""
Sep 11 14:15:05.763323 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.763303    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 14:15:05.763549 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.763533    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 14:15:05.763769 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.763755    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g7f7b\""
Sep 11 14:15:05.764377 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.764356    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 14:15:05.764580 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.764565    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:05.765190 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:05.765105    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:05.767718 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.767697    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:05.767799 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:05.767748    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:05.770565 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9458942-9c62-4f2d-89b5-9ec9085f42ba-agent-certs\") pod \"konnectivity-agent-xnwmb\" (UID: \"a9458942-9c62-4f2d-89b5-9ec9085f42ba\") " pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:05.770632 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-var-lib-cni-multus\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.770632 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a535969-6d0a-496f-9320-ebfbc3108122-ovnkube-config\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.770632 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.770752 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrbmf\" (UniqueName: \"kubernetes.io/projected/6a3c4894-5f9b-4173-954e-e0b4d2eae548-kube-api-access-rrbmf\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:05.770752 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-sysctl-conf\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.770752 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twmsj\" (UniqueName: \"kubernetes.io/projected/97cb8fed-44a5-49b0-ac21-48934c52c2fb-kube-api-access-twmsj\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.770752 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-conf-dir\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.770752 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-run-netns\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.770949 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6-iptables-alerter-script\") pod \"iptables-alerter-2vm9z\" (UID: \"47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6\") " pod="openshift-network-operator/iptables-alerter-2vm9z"
Sep 11 14:15:05.770949 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6-host-slash\") pod \"iptables-alerter-2vm9z\" (UID: \"47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6\") " pod="openshift-network-operator/iptables-alerter-2vm9z"
Sep 11 14:15:05.770949 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2skk\" (UniqueName: \"kubernetes.io/projected/47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6-kube-api-access-q2skk\") pod \"iptables-alerter-2vm9z\" (UID: \"47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6\") " pod="openshift-network-operator/iptables-alerter-2vm9z"
Sep 11 14:15:05.770949 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-lib-modules\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.770949 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-run-netns\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.770949 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-run-systemd\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.770949 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-system-cni-dir\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.770949 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770912    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 14:15:05.770949 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.770949 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-run-openvswitch\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a535969-6d0a-496f-9320-ebfbc3108122-ovnkube-script-lib\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.770979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-run\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-slash\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771015    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-sysconfig\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-sysctl-d\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-sys\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-etc-kubernetes\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-systemd-units\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-modprobe-d\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h2p7\" (UniqueName: \"kubernetes.io/projected/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-kube-api-access-7h2p7\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-var-lib-openvswitch\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a535969-6d0a-496f-9320-ebfbc3108122-ovn-node-metrics-cert\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771258    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m8f7\" (UniqueName: \"kubernetes.io/projected/18888f5e-6492-4e3a-91f0-1df8358261ac-kube-api-access-9m8f7\") pod \"node-resolver-pc9xn\" (UID: \"18888f5e-6492-4e3a-91f0-1df8358261ac\") " pod="openshift-dns/node-resolver-pc9xn"
Sep 11 14:15:05.771339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771280    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-systemd\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-system-cni-dir\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqlp8\" (UniqueName: \"kubernetes.io/projected/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-kube-api-access-jqlp8\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-host\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-daemon-config\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-kubelet\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-cni-bin\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-var-lib-kubelet\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5a0754a-01e9-4d0e-8572-6bbd7143bc6b-host\") pod \"node-ca-jr657\" (UID: \"f5a0754a-01e9-4d0e-8572-6bbd7143bc6b\") " pod="openshift-image-registry/node-ca-jr657"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5a0754a-01e9-4d0e-8572-6bbd7143bc6b-serviceca\") pod \"node-ca-jr657\" (UID: \"f5a0754a-01e9-4d0e-8572-6bbd7143bc6b\") " pod="openshift-image-registry/node-ca-jr657"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-var-lib-kubelet\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771531    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-hostroot\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771548    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-run-multus-certs\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-run-ovn\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-log-socket\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771602    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-cni-binary-copy\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.771913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-run-k8s-cni-cncf-io\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztdbs\" (UniqueName: \"kubernetes.io/projected/5a535969-6d0a-496f-9320-ebfbc3108122-kube-api-access-ztdbs\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18888f5e-6492-4e3a-91f0-1df8358261ac-hosts-file\") pod \"node-resolver-pc9xn\" (UID: \"18888f5e-6492-4e3a-91f0-1df8358261ac\") " pod="openshift-dns/node-resolver-pc9xn"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-cnibin\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771696    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9458942-9c62-4f2d-89b5-9ec9085f42ba-konnectivity-ca\") pod \"konnectivity-agent-xnwmb\" (UID: \"a9458942-9c62-4f2d-89b5-9ec9085f42ba\") " pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771709    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a535969-6d0a-496f-9320-ebfbc3108122-env-overrides\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-kubernetes\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcsmz\" (UniqueName: \"kubernetes.io/projected/f5a0754a-01e9-4d0e-8572-6bbd7143bc6b-kube-api-access-xcsmz\") pod \"node-ca-jr657\" (UID: \"f5a0754a-01e9-4d0e-8572-6bbd7143bc6b\") " pod="openshift-image-registry/node-ca-jr657"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-cni-dir\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-var-lib-cni-bin\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-etc-openvswitch\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-node-log\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-cni-netd\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.771977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.772001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-cnibin\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.772445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.772022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-socket-dir-parent\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.773252 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.772056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18888f5e-6492-4e3a-91f0-1df8358261ac-tmp-dir\") pod \"node-resolver-pc9xn\" (UID: \"18888f5e-6492-4e3a-91f0-1df8358261ac\") " pod="openshift-dns/node-resolver-pc9xn"
Sep 11 14:15:05.773252 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.772076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-tuned\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.773252 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.772088    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97cb8fed-44a5-49b0-ac21-48934c52c2fb-tmp\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.792240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.792223    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gdls6"
Sep 11 14:15:05.806404 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.806390    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gdls6"
Sep 11 14:15:05.858063 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.858035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" event={"ID":"cf9210cb0f0acda6060912348c982576","Type":"ContainerStarted","Data":"1bee1d6cb5dc25ed6ddd1920a3ae50535c17c4f8bbd8537319ed683b524888a1"}
Sep 11 14:15:05.858309 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.858296    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 14:15:05.872394 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872373    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-cnibin\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.872476 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-socket-dir-parent\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.872476 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18888f5e-6492-4e3a-91f0-1df8358261ac-tmp-dir\") pod \"node-resolver-pc9xn\" (UID: \"18888f5e-6492-4e3a-91f0-1df8358261ac\") " pod="openshift-dns/node-resolver-pc9xn"
Sep 11 14:15:05.872476 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-tuned\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.872476 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97cb8fed-44a5-49b0-ac21-48934c52c2fb-tmp\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.872476 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9458942-9c62-4f2d-89b5-9ec9085f42ba-agent-certs\") pod \"konnectivity-agent-xnwmb\" (UID: \"a9458942-9c62-4f2d-89b5-9ec9085f42ba\") " pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:05.872701 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-var-lib-cni-multus\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.872701 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872492    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-socket-dir-parent\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.872701 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-cnibin\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.872701 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a535969-6d0a-496f-9320-ebfbc3108122-ovnkube-config\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.872701 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.872918 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrbmf\" (UniqueName: \"kubernetes.io/projected/6a3c4894-5f9b-4173-954e-e0b4d2eae548-kube-api-access-rrbmf\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:05.872918 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-var-lib-cni-multus\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.872918 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-sysctl-conf\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.872918 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18888f5e-6492-4e3a-91f0-1df8358261ac-tmp-dir\") pod \"node-resolver-pc9xn\" (UID: \"18888f5e-6492-4e3a-91f0-1df8358261ac\") " pod="openshift-dns/node-resolver-pc9xn"
Sep 11 14:15:05.872918 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twmsj\" (UniqueName: \"kubernetes.io/projected/97cb8fed-44a5-49b0-ac21-48934c52c2fb-kube-api-access-twmsj\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.872918 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-socket-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.873240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-conf-dir\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.873240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-run-netns\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.873240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6-iptables-alerter-script\") pod \"iptables-alerter-2vm9z\" (UID: \"47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6\") " pod="openshift-network-operator/iptables-alerter-2vm9z"
Sep 11 14:15:05.873240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6-host-slash\") pod \"iptables-alerter-2vm9z\" (UID: \"47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6\") " pod="openshift-network-operator/iptables-alerter-2vm9z"
Sep 11 14:15:05.873240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-conf-dir\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.873240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.872972    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-sysctl-conf\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.873240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2skk\" (UniqueName: \"kubernetes.io/projected/47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6-kube-api-access-q2skk\") pod \"iptables-alerter-2vm9z\" (UID: \"47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6\") " pod="openshift-network-operator/iptables-alerter-2vm9z"
Sep 11 14:15:05.873240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-lib-modules\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.873240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-run-netns\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-run-systemd\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873373    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-system-cni-dir\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xctxk\" (UniqueName: \"kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk\") pod \"network-check-target-k54nn\" (UID: \"9f331474-f7dc-42b4-b8c1-63e68e2ed181\") " pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-run-systemd\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-run-openvswitch\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873501    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-run-netns\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a535969-6d0a-496f-9320-ebfbc3108122-ovnkube-script-lib\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873522    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6-host-slash\") pod \"iptables-alerter-2vm9z\" (UID: \"47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6\") " pod="openshift-network-operator/iptables-alerter-2vm9z"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-run\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873553    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-system-cni-dir\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873560    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-lib-modules\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873607    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-slash\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873627    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.873666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873656    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-run-netns\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1066f894-f0db-4259-8508-dbd6d0bf8009-dbus\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873703    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-run\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-sysconfig\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873766    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-sysctl-d\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-sys\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-run-openvswitch\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873823    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6-iptables-alerter-script\") pod \"iptables-alerter-2vm9z\" (UID: \"47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6\") " pod="openshift-network-operator/iptables-alerter-2vm9z"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873843    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873893    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-slash\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfk2m\" (UniqueName: \"kubernetes.io/projected/7e9be165-959b-41e7-a80e-87a2c55c0f94-kube-api-access-rfk2m\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-sys\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-etc-kubernetes\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.873995    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-sysconfig\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874006    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-etc-kubernetes\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.874431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874007    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-systemd-units\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874053    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-sysctl-d\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-modprobe-d\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-systemd-units\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874115    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-sys-fs\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-modprobe-d\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h2p7\" (UniqueName: \"kubernetes.io/projected/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-kube-api-access-7h2p7\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-var-lib-openvswitch\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874279    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a535969-6d0a-496f-9320-ebfbc3108122-ovnkube-config\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-var-lib-openvswitch\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874280    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a535969-6d0a-496f-9320-ebfbc3108122-ovnkube-script-lib\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a535969-6d0a-496f-9320-ebfbc3108122-ovn-node-metrics-cert\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8f7\" (UniqueName: \"kubernetes.io/projected/18888f5e-6492-4e3a-91f0-1df8358261ac-kube-api-access-9m8f7\") pod \"node-resolver-pc9xn\" (UID: \"18888f5e-6492-4e3a-91f0-1df8358261ac\") " pod="openshift-dns/node-resolver-pc9xn"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-systemd\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.875246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-system-cni-dir\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqlp8\" (UniqueName: \"kubernetes.io/projected/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-kube-api-access-jqlp8\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-host\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-daemon-config\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:05.874596    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-kubelet\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-cni-bin\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874683    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-cni-bin\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-host\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:05.874782    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs podName:6a3c4894-5f9b-4173-954e-e0b4d2eae548 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:06.37463866 +0000 UTC m=+3.005389834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs") pod "network-metrics-daemon-spn95" (UID: "6a3c4894-5f9b-4173-954e-e0b4d2eae548") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-kubelet\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-systemd\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-var-lib-kubelet\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-system-cni-dir\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5a0754a-01e9-4d0e-8572-6bbd7143bc6b-host\") pod \"node-ca-jr657\" (UID: \"f5a0754a-01e9-4d0e-8572-6bbd7143bc6b\") " pod="openshift-image-registry/node-ca-jr657"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.874997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5a0754a-01e9-4d0e-8572-6bbd7143bc6b-serviceca\") pod \"node-ca-jr657\" (UID: \"f5a0754a-01e9-4d0e-8572-6bbd7143bc6b\") " pod="openshift-image-registry/node-ca-jr657"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-var-lib-kubelet\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875029    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-var-lib-kubelet\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.876023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5a0754a-01e9-4d0e-8572-6bbd7143bc6b-host\") pod \"node-ca-jr657\" (UID: \"f5a0754a-01e9-4d0e-8572-6bbd7143bc6b\") " pod="openshift-image-registry/node-ca-jr657"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875062    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-var-lib-kubelet\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-hostroot\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-run-multus-certs\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-run-ovn\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-log-socket\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-cni-binary-copy\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-run-k8s-cni-cncf-io\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztdbs\" (UniqueName: \"kubernetes.io/projected/5a535969-6d0a-496f-9320-ebfbc3108122-kube-api-access-ztdbs\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18888f5e-6492-4e3a-91f0-1df8358261ac-hosts-file\") pod \"node-resolver-pc9xn\" (UID: \"18888f5e-6492-4e3a-91f0-1df8358261ac\") " pod="openshift-dns/node-resolver-pc9xn"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-cnibin\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875349    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-log-socket\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1066f894-f0db-4259-8508-dbd6d0bf8009-kubelet-config\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9458942-9c62-4f2d-89b5-9ec9085f42ba-konnectivity-ca\") pod \"konnectivity-agent-xnwmb\" (UID: \"a9458942-9c62-4f2d-89b5-9ec9085f42ba\") " pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-registration-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.876796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-device-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875562    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a535969-6d0a-496f-9320-ebfbc3108122-env-overrides\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-run-multus-certs\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-daemon-config\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-kubernetes\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875686    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-kubernetes\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcsmz\" (UniqueName: \"kubernetes.io/projected/f5a0754a-01e9-4d0e-8572-6bbd7143bc6b-kube-api-access-xcsmz\") pod \"node-ca-jr657\" (UID: \"f5a0754a-01e9-4d0e-8572-6bbd7143bc6b\") " pod="openshift-image-registry/node-ca-jr657"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5a0754a-01e9-4d0e-8572-6bbd7143bc6b-serviceca\") pod \"node-ca-jr657\" (UID: \"f5a0754a-01e9-4d0e-8572-6bbd7143bc6b\") " pod="openshift-image-registry/node-ca-jr657"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-run-k8s-cni-cncf-io\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.875966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18888f5e-6492-4e3a-91f0-1df8358261ac-hosts-file\") pod \"node-resolver-pc9xn\" (UID: \"18888f5e-6492-4e3a-91f0-1df8358261ac\") " pod="openshift-dns/node-resolver-pc9xn"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876056    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-hostroot\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-cnibin\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876100    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-run-ovn\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876241    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-cni-binary-copy\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876281    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-cni-dir\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-var-lib-cni-bin\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-etc-openvswitch\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.877292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-node-log\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-cni-netd\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9458942-9c62-4f2d-89b5-9ec9085f42ba-konnectivity-ca\") pod \"konnectivity-agent-xnwmb\" (UID: \"a9458942-9c62-4f2d-89b5-9ec9085f42ba\") " pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876533    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876587    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-host-var-lib-cni-bin\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-node-log\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876611    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a535969-6d0a-496f-9320-ebfbc3108122-env-overrides\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876629    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-etc-openvswitch\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876639    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a535969-6d0a-496f-9320-ebfbc3108122-host-cni-netd\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-multus-cni-dir\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.876637    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.877897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.877856    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a535969-6d0a-496f-9320-ebfbc3108122-ovn-node-metrics-cert\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.878338 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.878035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9458942-9c62-4f2d-89b5-9ec9085f42ba-agent-certs\") pod \"konnectivity-agent-xnwmb\" (UID: \"a9458942-9c62-4f2d-89b5-9ec9085f42ba\") " pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:05.878338 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.878095    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/97cb8fed-44a5-49b0-ac21-48934c52c2fb-etc-tuned\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.878396 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.878348    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97cb8fed-44a5-49b0-ac21-48934c52c2fb-tmp\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.882076 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.882048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twmsj\" (UniqueName: \"kubernetes.io/projected/97cb8fed-44a5-49b0-ac21-48934c52c2fb-kube-api-access-twmsj\") pod \"tuned-fs5bb\" (UID: \"97cb8fed-44a5-49b0-ac21-48934c52c2fb\") " pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:05.883633 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.883610    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrbmf\" (UniqueName: \"kubernetes.io/projected/6a3c4894-5f9b-4173-954e-e0b4d2eae548-kube-api-access-rrbmf\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:05.883716 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.883652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2skk\" (UniqueName: \"kubernetes.io/projected/47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6-kube-api-access-q2skk\") pod \"iptables-alerter-2vm9z\" (UID: \"47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6\") " pod="openshift-network-operator/iptables-alerter-2vm9z"
Sep 11 14:15:05.885763 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.885740    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h2p7\" (UniqueName: \"kubernetes.io/projected/3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57-kube-api-access-7h2p7\") pod \"multus-2vdq7\" (UID: \"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57\") " pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:05.886569 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.886548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m8f7\" (UniqueName: \"kubernetes.io/projected/18888f5e-6492-4e3a-91f0-1df8358261ac-kube-api-access-9m8f7\") pod \"node-resolver-pc9xn\" (UID: \"18888f5e-6492-4e3a-91f0-1df8358261ac\") " pod="openshift-dns/node-resolver-pc9xn"
Sep 11 14:15:05.886813 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.886791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcsmz\" (UniqueName: \"kubernetes.io/projected/f5a0754a-01e9-4d0e-8572-6bbd7143bc6b-kube-api-access-xcsmz\") pod \"node-ca-jr657\" (UID: \"f5a0754a-01e9-4d0e-8572-6bbd7143bc6b\") " pod="openshift-image-registry/node-ca-jr657"
Sep 11 14:15:05.886912 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.886895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqlp8\" (UniqueName: \"kubernetes.io/projected/4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f-kube-api-access-jqlp8\") pod \"multus-additional-cni-plugins-7x7z9\" (UID: \"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f\") " pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:05.887258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.887243    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztdbs\" (UniqueName: \"kubernetes.io/projected/5a535969-6d0a-496f-9320-ebfbc3108122-kube-api-access-ztdbs\") pod \"ovnkube-node-hxhlm\" (UID: \"5a535969-6d0a-496f-9320-ebfbc3108122\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:05.976815 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1066f894-f0db-4259-8508-dbd6d0bf8009-dbus\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:05.976815 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.976958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976816    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfk2m\" (UniqueName: \"kubernetes.io/projected/7e9be165-959b-41e7-a80e-87a2c55c0f94-kube-api-access-rfk2m\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.976958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-sys-fs\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.976958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1066f894-f0db-4259-8508-dbd6d0bf8009-kubelet-config\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:05.976958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:05.976958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.976958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1066f894-f0db-4259-8508-dbd6d0bf8009-kubelet-config\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:05.976958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976940    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.976958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-registration-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.976958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1066f894-f0db-4259-8508-dbd6d0bf8009-dbus\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:05.976958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976946    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-sys-fs\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.977373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.976996    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.977373 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:05.977039    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:05.977373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.977042    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-registration-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.977373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.977061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-device-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.977373 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:05.977094    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret podName:1066f894-f0db-4259-8508-dbd6d0bf8009 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:06.477080587 +0000 UTC m=+3.107831765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret") pod "global-pull-secret-syncer-lltwm" (UID: "1066f894-f0db-4259-8508-dbd6d0bf8009") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:05.977373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.977130    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-device-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.977373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.977134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-socket-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.977373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.977200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctxk\" (UniqueName: \"kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk\") pod \"network-check-target-k54nn\" (UID: \"9f331474-f7dc-42b4-b8c1-63e68e2ed181\") " pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:05.977373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.977244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7e9be165-959b-41e7-a80e-87a2c55c0f94-socket-dir\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:05.984844 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:05.984828    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:05.984884 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:05.984848    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:05.984884 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:05.984858    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xctxk for pod openshift-network-diagnostics/network-check-target-k54nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:05.984952 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:05.984900    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk podName:9f331474-f7dc-42b4-b8c1-63e68e2ed181 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:06.484888658 +0000 UTC m=+3.115639846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xctxk" (UniqueName: "kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk") pod "network-check-target-k54nn" (UID: "9f331474-f7dc-42b4-b8c1-63e68e2ed181") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:05.986123 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:05.986107    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfk2m\" (UniqueName: \"kubernetes.io/projected/7e9be165-959b-41e7-a80e-87a2c55c0f94-kube-api-access-rfk2m\") pod \"aws-ebs-csi-driver-node-kqgxd\" (UID: \"7e9be165-959b-41e7-a80e-87a2c55c0f94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:06.050124 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.050104    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7x7z9"
Sep 11 14:15:06.057476 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.057460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2vm9z"
Sep 11 14:15:06.060047 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:06.060022    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a73d63c_d9e2_466f_a2ec_6ad0e9f1d26f.slice/crio-8f28c48a36d1cfdbdc1a82851e854580ceb5f8ce0f3b11f4a8b41622dd88f643 WatchSource:0}: Error finding container 8f28c48a36d1cfdbdc1a82851e854580ceb5f8ce0f3b11f4a8b41622dd88f643: Status 404 returned error can't find the container with id 8f28c48a36d1cfdbdc1a82851e854580ceb5f8ce0f3b11f4a8b41622dd88f643
Sep 11 14:15:06.060258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.060246    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:06.065289 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.065271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:06.065641 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:06.065617    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47257f0f_a9d3_4cbc_88a2_9b37c5dd6bd6.slice/crio-b5c3fe323998ca96335e73555f225e456fd7ac4a14236f08b8d0cecab499ddcc WatchSource:0}: Error finding container b5c3fe323998ca96335e73555f225e456fd7ac4a14236f08b8d0cecab499ddcc: Status 404 returned error can't find the container with id b5c3fe323998ca96335e73555f225e456fd7ac4a14236f08b8d0cecab499ddcc
Sep 11 14:15:06.069869 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.069849    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fs5bb"
Sep 11 14:15:06.075290 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.075270    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jr657"
Sep 11 14:15:06.075739 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:06.075718    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9458942_9c62_4f2d_89b5_9ec9085f42ba.slice/crio-86b648c86e530e0656f73c415b0db4c50a60e3bbd4ce7e82674b547cda7fdbf7 WatchSource:0}: Error finding container 86b648c86e530e0656f73c415b0db4c50a60e3bbd4ce7e82674b547cda7fdbf7: Status 404 returned error can't find the container with id 86b648c86e530e0656f73c415b0db4c50a60e3bbd4ce7e82674b547cda7fdbf7
Sep 11 14:15:06.078505 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:06.078307    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97cb8fed_44a5_49b0_ac21_48934c52c2fb.slice/crio-d7b2265dc1ef3cfc638968fec8a3078b50c1671c94ac25bfe6652d0d58cea8fd WatchSource:0}: Error finding container d7b2265dc1ef3cfc638968fec8a3078b50c1671c94ac25bfe6652d0d58cea8fd: Status 404 returned error can't find the container with id d7b2265dc1ef3cfc638968fec8a3078b50c1671c94ac25bfe6652d0d58cea8fd
Sep 11 14:15:06.081885 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.081865    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2vdq7"
Sep 11 14:15:06.083552 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:06.083534    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a0754a_01e9_4d0e_8572_6bbd7143bc6b.slice/crio-9775e9f43b947bc6ead85773f76f2e60be79e25ddb6bf2715b5be86e27140dfb WatchSource:0}: Error finding container 9775e9f43b947bc6ead85773f76f2e60be79e25ddb6bf2715b5be86e27140dfb: Status 404 returned error can't find the container with id 9775e9f43b947bc6ead85773f76f2e60be79e25ddb6bf2715b5be86e27140dfb
Sep 11 14:15:06.086511 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.086474    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:06.090385 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:06.090364    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3266cd1c_d2f4_48ea_a5a0_ec3cfd448e57.slice/crio-cd150b2352014e37f6ce9ed17105935ac4f0bbb4d91da450743ea37ddf98e390 WatchSource:0}: Error finding container cd150b2352014e37f6ce9ed17105935ac4f0bbb4d91da450743ea37ddf98e390: Status 404 returned error can't find the container with id cd150b2352014e37f6ce9ed17105935ac4f0bbb4d91da450743ea37ddf98e390
Sep 11 14:15:06.092205 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.092185    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pc9xn"
Sep 11 14:15:06.094729 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:06.094711    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a535969_6d0a_496f_9320_ebfbc3108122.slice/crio-53d19d116cd5a4158f35bac9b0aee3fd751521498452dd608f195434fee84d1e WatchSource:0}: Error finding container 53d19d116cd5a4158f35bac9b0aee3fd751521498452dd608f195434fee84d1e: Status 404 returned error can't find the container with id 53d19d116cd5a4158f35bac9b0aee3fd751521498452dd608f195434fee84d1e
Sep 11 14:15:06.096249 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.096236    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd"
Sep 11 14:15:06.100764 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:06.100747    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18888f5e_6492_4e3a_91f0_1df8358261ac.slice/crio-505202ee24d91df173deac6ce1ba084651f7b54c4ef3695f5e29984bc4855259 WatchSource:0}: Error finding container 505202ee24d91df173deac6ce1ba084651f7b54c4ef3695f5e29984bc4855259: Status 404 returned error can't find the container with id 505202ee24d91df173deac6ce1ba084651f7b54c4ef3695f5e29984bc4855259
Sep 11 14:15:06.104880 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:06.104862    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9be165_959b_41e7_a80e_87a2c55c0f94.slice/crio-886d595870489cb59c8b8990bb9d9220a335a2c57270358b64e7f046eebc46d1 WatchSource:0}: Error finding container 886d595870489cb59c8b8990bb9d9220a335a2c57270358b64e7f046eebc46d1: Status 404 returned error can't find the container with id 886d595870489cb59c8b8990bb9d9220a335a2c57270358b64e7f046eebc46d1
Sep 11 14:15:06.379098 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.379023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:06.379273 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:06.379196    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:06.379273 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:06.379268    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs podName:6a3c4894-5f9b-4173-954e-e0b4d2eae548 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:07.379249251 +0000 UTC m=+4.010000430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs") pod "network-metrics-daemon-spn95" (UID: "6a3c4894-5f9b-4173-954e-e0b4d2eae548") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:06.479762 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.479731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:06.479916 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:06.479880    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:06.479974 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:06.479941    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret podName:1066f894-f0db-4259-8508-dbd6d0bf8009 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:07.479922722 +0000 UTC m=+4.110673899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret") pod "global-pull-secret-syncer-lltwm" (UID: "1066f894-f0db-4259-8508-dbd6d0bf8009") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:06.580263 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.580229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctxk\" (UniqueName: \"kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk\") pod \"network-check-target-k54nn\" (UID: \"9f331474-f7dc-42b4-b8c1-63e68e2ed181\") " pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:06.580420 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:06.580399    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:06.580420 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:06.580417    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:06.580541 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:06.580432    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xctxk for pod openshift-network-diagnostics/network-check-target-k54nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:06.580541 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:06.580485    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk podName:9f331474-f7dc-42b4-b8c1-63e68e2ed181 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:07.580467653 +0000 UTC m=+4.211218831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xctxk" (UniqueName: "kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk") pod "network-check-target-k54nn" (UID: "9f331474-f7dc-42b4-b8c1-63e68e2ed181") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:06.809263 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.809069    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 14:10:05 +0000 UTC" deadline="2028-05-10 10:13:10.001472822 +0000 UTC"
Sep 11 14:15:06.809263 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.809105    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14563h58m3.192372589s"
Sep 11 14:15:06.902565 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.902522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2vdq7" event={"ID":"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57","Type":"ContainerStarted","Data":"cd150b2352014e37f6ce9ed17105935ac4f0bbb4d91da450743ea37ddf98e390"}
Sep 11 14:15:06.908990 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.908843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jr657" event={"ID":"f5a0754a-01e9-4d0e-8572-6bbd7143bc6b","Type":"ContainerStarted","Data":"9775e9f43b947bc6ead85773f76f2e60be79e25ddb6bf2715b5be86e27140dfb"}
Sep 11 14:15:06.928493 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.928462    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xnwmb" event={"ID":"a9458942-9c62-4f2d-89b5-9ec9085f42ba","Type":"ContainerStarted","Data":"86b648c86e530e0656f73c415b0db4c50a60e3bbd4ce7e82674b547cda7fdbf7"}
Sep 11 14:15:06.931381 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.931313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd" event={"ID":"7e9be165-959b-41e7-a80e-87a2c55c0f94","Type":"ContainerStarted","Data":"886d595870489cb59c8b8990bb9d9220a335a2c57270358b64e7f046eebc46d1"}
Sep 11 14:15:06.943103 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.943063    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pc9xn" event={"ID":"18888f5e-6492-4e3a-91f0-1df8358261ac","Type":"ContainerStarted","Data":"505202ee24d91df173deac6ce1ba084651f7b54c4ef3695f5e29984bc4855259"}
Sep 11 14:15:06.954979 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.954951    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm" event={"ID":"5a535969-6d0a-496f-9320-ebfbc3108122","Type":"ContainerStarted","Data":"53d19d116cd5a4158f35bac9b0aee3fd751521498452dd608f195434fee84d1e"}
Sep 11 14:15:06.971618 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.971587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fs5bb" event={"ID":"97cb8fed-44a5-49b0-ac21-48934c52c2fb","Type":"ContainerStarted","Data":"d7b2265dc1ef3cfc638968fec8a3078b50c1671c94ac25bfe6652d0d58cea8fd"}
Sep 11 14:15:06.982199 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.982173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2vm9z" event={"ID":"47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6","Type":"ContainerStarted","Data":"b5c3fe323998ca96335e73555f225e456fd7ac4a14236f08b8d0cecab499ddcc"}
Sep 11 14:15:06.992274 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:06.992246    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7x7z9" event={"ID":"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f","Type":"ContainerStarted","Data":"8f28c48a36d1cfdbdc1a82851e854580ceb5f8ce0f3b11f4a8b41622dd88f643"}
Sep 11 14:15:07.387706 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:07.387013    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:07.387706 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:07.387267    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:07.387706 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:07.387353    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs podName:6a3c4894-5f9b-4173-954e-e0b4d2eae548 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:09.3873292 +0000 UTC m=+6.018080396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs") pod "network-metrics-daemon-spn95" (UID: "6a3c4894-5f9b-4173-954e-e0b4d2eae548") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:07.487525 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:07.487463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:07.487711 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:07.487607    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:07.487711 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:07.487675    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret podName:1066f894-f0db-4259-8508-dbd6d0bf8009 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:09.487655937 +0000 UTC m=+6.118407114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret") pod "global-pull-secret-syncer-lltwm" (UID: "1066f894-f0db-4259-8508-dbd6d0bf8009") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:07.588464 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:07.588421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctxk\" (UniqueName: \"kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk\") pod \"network-check-target-k54nn\" (UID: \"9f331474-f7dc-42b4-b8c1-63e68e2ed181\") " pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:07.588630 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:07.588591    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:07.588630 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:07.588614    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:07.588630 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:07.588629    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xctxk for pod openshift-network-diagnostics/network-check-target-k54nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:07.588810 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:07.588689    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk podName:9f331474-f7dc-42b4-b8c1-63e68e2ed181 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:09.588670826 +0000 UTC m=+6.219422003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xctxk" (UniqueName: "kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk") pod "network-check-target-k54nn" (UID: "9f331474-f7dc-42b4-b8c1-63e68e2ed181") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:07.809684 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:07.809547    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 14:10:05 +0000 UTC" deadline="2028-03-06 19:47:42.010126199 +0000 UTC"
Sep 11 14:15:07.809684 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:07.809604    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13013h32m34.200525246s"
Sep 11 14:15:07.855826 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:07.855791    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:07.855966 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:07.855912    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:07.856375 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:07.856353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:07.856479 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:07.856460    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:07.856536 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:07.856521    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:07.856669 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:07.856646    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:09.402800 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:09.402665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:09.403460 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:09.402797    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:09.403460 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:09.402878    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs podName:6a3c4894-5f9b-4173-954e-e0b4d2eae548 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:13.402855143 +0000 UTC m=+10.033606320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs") pod "network-metrics-daemon-spn95" (UID: "6a3c4894-5f9b-4173-954e-e0b4d2eae548") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:09.503931 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:09.503369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:09.503931 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:09.503512    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:09.503931 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:09.503581    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret podName:1066f894-f0db-4259-8508-dbd6d0bf8009 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:13.50356355 +0000 UTC m=+10.134314727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret") pod "global-pull-secret-syncer-lltwm" (UID: "1066f894-f0db-4259-8508-dbd6d0bf8009") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:09.605029 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:09.604294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctxk\" (UniqueName: \"kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk\") pod \"network-check-target-k54nn\" (UID: \"9f331474-f7dc-42b4-b8c1-63e68e2ed181\") " pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:09.605029 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:09.604507    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:09.605029 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:09.604532    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:09.605029 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:09.604552    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xctxk for pod openshift-network-diagnostics/network-check-target-k54nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:09.605029 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:09.604626    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk podName:9f331474-f7dc-42b4-b8c1-63e68e2ed181 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:13.60459128 +0000 UTC m=+10.235342471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xctxk" (UniqueName: "kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk") pod "network-check-target-k54nn" (UID: "9f331474-f7dc-42b4-b8c1-63e68e2ed181") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:09.854422 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:09.854328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:09.854565 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:09.854458    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:09.854968 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:09.854329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:09.854968 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:09.854776    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:09.854968 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:09.854847    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:09.854968 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:09.854933    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:11.853170 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:11.853089    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:11.853170 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:11.853124    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:11.853675 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:11.853240    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:11.853675 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:11.853465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:11.853675 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:11.853593    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:11.853851 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:11.853678    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:13.435813 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:13.435737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:13.436315 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:13.435899    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:13.436315 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:13.435974    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs podName:6a3c4894-5f9b-4173-954e-e0b4d2eae548 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:21.435952332 +0000 UTC m=+18.066703528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs") pod "network-metrics-daemon-spn95" (UID: "6a3c4894-5f9b-4173-954e-e0b4d2eae548") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:13.537299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:13.536688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:13.537299 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:13.536858    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:13.537299 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:13.536923    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret podName:1066f894-f0db-4259-8508-dbd6d0bf8009 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:21.536904742 +0000 UTC m=+18.167655918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret") pod "global-pull-secret-syncer-lltwm" (UID: "1066f894-f0db-4259-8508-dbd6d0bf8009") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:13.638022 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:13.637984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctxk\" (UniqueName: \"kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk\") pod \"network-check-target-k54nn\" (UID: \"9f331474-f7dc-42b4-b8c1-63e68e2ed181\") " pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:13.638217 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:13.638173    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:13.638217 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:13.638190    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:13.638217 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:13.638199    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xctxk for pod openshift-network-diagnostics/network-check-target-k54nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:13.638354 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:13.638244    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk podName:9f331474-f7dc-42b4-b8c1-63e68e2ed181 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:21.638230738 +0000 UTC m=+18.268981912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xctxk" (UniqueName: "kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk") pod "network-check-target-k54nn" (UID: "9f331474-f7dc-42b4-b8c1-63e68e2ed181") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:13.856462 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:13.856427    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:13.856629 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:13.856549    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:13.856629 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:13.856617    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:13.856750 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:13.856700    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:13.856750 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:13.856749    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:13.856908 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:13.856807    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:15.853246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:15.853193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:15.853246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:15.853215    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:15.853731 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:15.853201    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:15.853731 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:15.853320    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:15.853731 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:15.853407    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:15.853731 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:15.853483    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:17.853738 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:17.853656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:17.853738 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:17.853675    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:17.854240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:17.853801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:17.854240 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:17.853801    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:17.854240 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:17.853918    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:17.854240 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:17.854008    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:19.853727 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:19.853685    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:19.853727 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:19.853702    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:19.854214 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:19.853815    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:19.854214 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:19.853876    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:19.854214 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:19.853902    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:19.854214 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:19.853996    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:21.498679 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:21.498643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:21.499227 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:21.498848    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:21.499227 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:21.498934    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs podName:6a3c4894-5f9b-4173-954e-e0b4d2eae548 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:37.498910668 +0000 UTC m=+34.129661848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs") pod "network-metrics-daemon-spn95" (UID: "6a3c4894-5f9b-4173-954e-e0b4d2eae548") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:21.599736 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:21.599703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:21.599887 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:21.599862    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:21.599943 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:21.599932    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret podName:1066f894-f0db-4259-8508-dbd6d0bf8009 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:37.599910752 +0000 UTC m=+34.230661927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret") pod "global-pull-secret-syncer-lltwm" (UID: "1066f894-f0db-4259-8508-dbd6d0bf8009") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:21.700216 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:21.700182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctxk\" (UniqueName: \"kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk\") pod \"network-check-target-k54nn\" (UID: \"9f331474-f7dc-42b4-b8c1-63e68e2ed181\") " pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:21.700395 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:21.700350    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:21.700395 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:21.700372    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:21.700395 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:21.700383    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xctxk for pod openshift-network-diagnostics/network-check-target-k54nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:21.700549 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:21.700441    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk podName:9f331474-f7dc-42b4-b8c1-63e68e2ed181 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:37.700423326 +0000 UTC m=+34.331174519 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xctxk" (UniqueName: "kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk") pod "network-check-target-k54nn" (UID: "9f331474-f7dc-42b4-b8c1-63e68e2ed181") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:21.853258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:21.853173    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:21.853399 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:21.853173    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:21.853399 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:21.853309    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:21.853399 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:21.853306    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:21.853552 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:21.853443    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:21.853552 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:21.853526    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:23.853912 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:23.853880    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:23.854384 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:23.853991    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:23.854384 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:23.854086    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:23.854384 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:23.854228    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:23.854384 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:23.854273    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:23.854384 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:23.854346    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:25.080109 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:25.079215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" event={"ID":"cf9210cb0f0acda6060912348c982576","Type":"ContainerStarted","Data":"94d4b28ae6c9e41887c3457222d8a90adcb25cd03200dfc59050a0b8b4228182"}
Sep 11 14:15:25.095786 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:25.095739    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" podStartSLOduration=21.095721518 podStartE2EDuration="21.095721518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:25.095094688 +0000 UTC m=+21.725845884" watchObservedRunningTime="2026-09-11 14:15:25.095721518 +0000 UTC m=+21.726472716"
Sep 11 14:15:25.853175 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:25.852996    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:25.853316 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:25.853017    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:25.853316 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:25.853261    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:25.853382 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:25.853057    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:25.853418 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:25.853332    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:25.853454 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:25.853436    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:26.083532 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.083501    2581 generic.go:356] "Generic (PLEG): container finished" podID="e208b9b44ef68d231c84be9a35fef8d8" containerID="7724d62e29c356efb513804c48f08f34908810b0b466f7a207633da6b095748c" exitCode=0
Sep 11 14:15:26.084253 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.083597    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" event={"ID":"e208b9b44ef68d231c84be9a35fef8d8","Type":"ContainerDied","Data":"7724d62e29c356efb513804c48f08f34908810b0b466f7a207633da6b095748c"}
Sep 11 14:15:26.086530 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.086470    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd" event={"ID":"7e9be165-959b-41e7-a80e-87a2c55c0f94","Type":"ContainerStarted","Data":"9a4452bc96a4d7bad0f6304de60338e3f99aa95a8d82bedba6804a95ba39171b"}
Sep 11 14:15:26.092641 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.092609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pc9xn" event={"ID":"18888f5e-6492-4e3a-91f0-1df8358261ac","Type":"ContainerStarted","Data":"b46575ec006347b292a886e4ea5e542f20b57b124e913f03b0cbd6693c6ed24a"}
Sep 11 14:15:26.096102 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.096077    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm" event={"ID":"5a535969-6d0a-496f-9320-ebfbc3108122","Type":"ContainerStarted","Data":"dc240b97a4e59c4bb8ddb148acdd0b18cdb1d6b28b4dd8e533f48f8541880fec"}
Sep 11 14:15:26.096222 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.096152    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm" event={"ID":"5a535969-6d0a-496f-9320-ebfbc3108122","Type":"ContainerStarted","Data":"5fa497e230d286736cb544d06dea679db1a58fa3738a52ff721ebb9227a03955"}
Sep 11 14:15:26.096278 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.096220    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm" event={"ID":"5a535969-6d0a-496f-9320-ebfbc3108122","Type":"ContainerStarted","Data":"1e65f9c98f32f514d413664fda100912130b09126c2b97c269dcc33bd4bf58e9"}
Sep 11 14:15:26.096278 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.096259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm" event={"ID":"5a535969-6d0a-496f-9320-ebfbc3108122","Type":"ContainerStarted","Data":"f6c693dead9c6585cef58076edf5bd64fdd372d8329a6e656526d22907c2f151"}
Sep 11 14:15:26.096373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.096295    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm" event={"ID":"5a535969-6d0a-496f-9320-ebfbc3108122","Type":"ContainerStarted","Data":"19a812a43e25a3bf43c0c4e4575787e233b1764662285828e582e8f891c39051"}
Sep 11 14:15:26.096373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.096343    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm" event={"ID":"5a535969-6d0a-496f-9320-ebfbc3108122","Type":"ContainerStarted","Data":"53491a5d5228411ac942932d1792d7f8392a0c8eae475cb1a00299210357481f"}
Sep 11 14:15:26.097861 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.097839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fs5bb" event={"ID":"97cb8fed-44a5-49b0-ac21-48934c52c2fb","Type":"ContainerStarted","Data":"ed375834c8c69d4f9b2795b856ce37d914d5bb982cac7d2c6e9ca1aa79b438b0"}
Sep 11 14:15:26.099607 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.099582    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f" containerID="297909c909d8c5c714576b97f6c27dbedf4ba8554a84b2b5ca4b49f38514f09c" exitCode=0
Sep 11 14:15:26.099715 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.099660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7x7z9" event={"ID":"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f","Type":"ContainerDied","Data":"297909c909d8c5c714576b97f6c27dbedf4ba8554a84b2b5ca4b49f38514f09c"}
Sep 11 14:15:26.101273 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.101249    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2vdq7" event={"ID":"3266cd1c-d2f4-48ea-a5a0-ec3cfd448e57","Type":"ContainerStarted","Data":"b8d498118bbef70003bd69ec4adbf185f32991b3b301fe4b998a05ee6742c384"}
Sep 11 14:15:26.103019 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.102994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jr657" event={"ID":"f5a0754a-01e9-4d0e-8572-6bbd7143bc6b","Type":"ContainerStarted","Data":"5139a166c86b2bed4a3e8e5170c9360d469e651d439636efac5fd3eca5fed7d3"}
Sep 11 14:15:26.104789 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.104659    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xnwmb" event={"ID":"a9458942-9c62-4f2d-89b5-9ec9085f42ba","Type":"ContainerStarted","Data":"85e9318448dfdc612e09122b2e15d30605818391fff5ae69f18fafc79c7c1982"}
Sep 11 14:15:26.174185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.174117    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fs5bb" podStartSLOduration=4.319185744 podStartE2EDuration="23.174102115s" totalImagesPullingTime="18.854916371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:26.173994957 +0000 UTC m=+22.804746152" watchObservedRunningTime="2026-09-11 14:15:26.174102115 +0000 UTC m=+22.804853312"
Sep 11 14:15:26.254153 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.254093    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jr657" podStartSLOduration=4.427161852 podStartE2EDuration="23.254070379s" totalImagesPullingTime="18.826908527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:26.214480842 +0000 UTC m=+22.845232039" watchObservedRunningTime="2026-09-11 14:15:26.254070379 +0000 UTC m=+22.884821577"
Sep 11 14:15:26.283319 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.283273    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pc9xn" podStartSLOduration=3.452919977 podStartE2EDuration="22.283253549s" totalImagesPullingTime="18.830333572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:26.25420975 +0000 UTC m=+22.884960947" watchObservedRunningTime="2026-09-11 14:15:26.283253549 +0000 UTC m=+22.914004746"
Sep 11 14:15:26.321251 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.321214    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xnwmb" podStartSLOduration=4.486651762 podStartE2EDuration="23.321194809s" totalImagesPullingTime="18.834543047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:26.283177801 +0000 UTC m=+22.913928998" watchObservedRunningTime="2026-09-11 14:15:26.321194809 +0000 UTC m=+22.951946005"
Sep 11 14:15:26.827310 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.827286    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 14:15:26.836268 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.836190    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T14:15:26.827307576Z","UUID":"a74f1fac-9986-4522-a4bf-8339ff441ef8","Handler":null,"Name":"","Endpoint":""}
Sep 11 14:15:26.837646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.837627    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 14:15:26.837789 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:26.837662    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 14:15:27.109402 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:27.109317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" event={"ID":"e208b9b44ef68d231c84be9a35fef8d8","Type":"ContainerStarted","Data":"96504aa775562e1e2109974e80720eac7455398f4e3ca537ca77536e13cd121f"}
Sep 11 14:15:27.111491 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:27.111460    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd" event={"ID":"7e9be165-959b-41e7-a80e-87a2c55c0f94","Type":"ContainerStarted","Data":"9fbf43805945e0fe6a6a2c6f39f223d29750ef6b79e0612b4929483dd8ca4be2"}
Sep 11 14:15:27.113089 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:27.113015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2vm9z" event={"ID":"47257f0f-a9d3-4cbc-88a2-9b37c5dd6bd6","Type":"ContainerStarted","Data":"326de5af023303e59f8d748b17e0a8996ef29225473c0987640b6b1695c4579f"}
Sep 11 14:15:27.148371 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:27.148330    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2vdq7" podStartSLOduration=4.243525455 podStartE2EDuration="23.148291831s" totalImagesPullingTime="18.904766376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:26.322644537 +0000 UTC m=+22.953395733" watchObservedRunningTime="2026-09-11 14:15:27.148291831 +0000 UTC m=+23.779043027"
Sep 11 14:15:27.196132 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:27.196090    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" podStartSLOduration=23.19607695 podStartE2EDuration="23.19607695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:27.148454345 +0000 UTC m=+23.779205530" watchObservedRunningTime="2026-09-11 14:15:27.19607695 +0000 UTC m=+23.826828145"
Sep 11 14:15:27.853550 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:27.853322    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:27.853700 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:27.853666    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:27.853700 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:27.853391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:27.853812 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:27.853755    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:27.853812 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:27.853322    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:27.853918 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:27.853829    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:28.118893 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:28.118860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm" event={"ID":"5a535969-6d0a-496f-9320-ebfbc3108122","Type":"ContainerStarted","Data":"43273acb1e67e913b64fcb37b3c58be20307aaea0161dce66e49864006f6704f"}
Sep 11 14:15:28.297131 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:28.297105    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:28.297706 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:28.297688    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:28.323778 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:28.323730    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2vm9z" podStartSLOduration=6.455266512 podStartE2EDuration="25.323710905s" totalImagesPullingTime="18.868444393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:27.197375497 +0000 UTC m=+23.828126695" watchObservedRunningTime="2026-09-11 14:15:28.323710905 +0000 UTC m=+24.954462102"
Sep 11 14:15:29.125284 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:29.125249    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd" event={"ID":"7e9be165-959b-41e7-a80e-87a2c55c0f94","Type":"ContainerStarted","Data":"9fb5d880c021f8cd0712f0775c45067b82c7f28e4181d7f0defd1cabf7464cdc"}
Sep 11 14:15:29.853354 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:29.853292    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:29.853523 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:29.853292    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:29.853523 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:29.853439    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:29.853523 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:29.853294    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:29.853523 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:29.853514    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:29.853703 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:29.853531    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:31.131582 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.131381    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f" containerID="748af78258bce10451f4ab3bb903953859336f59781b04a6beece541a4be2ac9" exitCode=0
Sep 11 14:15:31.132045 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.131463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7x7z9" event={"ID":"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f","Type":"ContainerDied","Data":"748af78258bce10451f4ab3bb903953859336f59781b04a6beece541a4be2ac9"}
Sep 11 14:15:31.135642 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.135618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm" event={"ID":"5a535969-6d0a-496f-9320-ebfbc3108122","Type":"ContainerStarted","Data":"f977630804b2e5d520346716db7a3df4c4777b9da9c8d68b33e4116c431ada76"}
Sep 11 14:15:31.135942 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.135918    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:31.136032 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.136001    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:31.136079 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.136046    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:31.151192 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.151172    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:31.151587 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.151573    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:15:31.156006 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.155972    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqgxd" podStartSLOduration=5.942036071 podStartE2EDuration="27.155960113s" totalImagesPullingTime="21.213924042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:29.161707718 +0000 UTC m=+25.792458918" watchObservedRunningTime="2026-09-11 14:15:31.155960113 +0000 UTC m=+27.786711351"
Sep 11 14:15:31.180940 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.180903    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm" podStartSLOduration=8.316300061 podStartE2EDuration="27.180892306s" totalImagesPullingTime="18.864592245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:31.180746099 +0000 UTC m=+27.811497297" watchObservedRunningTime="2026-09-11 14:15:31.180892306 +0000 UTC m=+27.811643501"
Sep 11 14:15:31.853537 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.853511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:31.853537 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.853529    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:31.853784 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:31.853635    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:31.853784 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:31.853668    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:31.853784 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:31.853703    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:31.853921 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:31.853797    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:32.065293 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:32.065262    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lltwm"]
Sep 11 14:15:32.068040 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:32.068013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k54nn"]
Sep 11 14:15:32.068687 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:32.068665    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-spn95"]
Sep 11 14:15:32.137915 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:32.137839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:32.138547 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:32.137839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:32.138547 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:32.137839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:32.138547 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:32.137957    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:32.138547 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:32.138023    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:32.138547 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:32.138096    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:33.141725 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:33.141636    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f" containerID="739b6d6b28814c7dce821433809b1aeb3bb2a8b87f62e0f7e371a912d616137f" exitCode=0
Sep 11 14:15:33.142162 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:33.141721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7x7z9" event={"ID":"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f","Type":"ContainerDied","Data":"739b6d6b28814c7dce821433809b1aeb3bb2a8b87f62e0f7e371a912d616137f"}
Sep 11 14:15:33.853522 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:33.853369    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:33.853718 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:33.853438    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:33.853718 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:33.853580    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:33.853718 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:33.853676    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:33.853718 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:33.853456    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:33.853997 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:33.853804    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:34.234439 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:34.234412    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:34.234801 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:34.234593    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 14:15:34.235412 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:34.235068    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xnwmb"
Sep 11 14:15:35.149264 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:35.149234    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f" containerID="b11c766b2e56c1a3e1aba1e26b4e867101d42c0649c58a2fcf5508999473d3cf" exitCode=0
Sep 11 14:15:35.149378 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:35.149323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7x7z9" event={"ID":"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f","Type":"ContainerDied","Data":"b11c766b2e56c1a3e1aba1e26b4e867101d42c0649c58a2fcf5508999473d3cf"}
Sep 11 14:15:35.853071 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:35.853040    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:35.853488 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:35.853040    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:35.853488 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:35.853172    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:35.853488 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:35.853209    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:35.853488 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:35.853283    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:35.853488 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:35.853370    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:37.516986 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:37.516948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:37.517422 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:37.517083    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:37.517422 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:37.517163    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs podName:6a3c4894-5f9b-4173-954e-e0b4d2eae548 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.517129751 +0000 UTC m=+66.147880948 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs") pod "network-metrics-daemon-spn95" (UID: "6a3c4894-5f9b-4173-954e-e0b4d2eae548") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:37.617940 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:37.617899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:37.618111 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:37.618042    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:37.618111 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:37.618104    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret podName:1066f894-f0db-4259-8508-dbd6d0bf8009 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.618087545 +0000 UTC m=+66.248838730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret") pod "global-pull-secret-syncer-lltwm" (UID: "1066f894-f0db-4259-8508-dbd6d0bf8009") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:37.718852 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:37.718817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctxk\" (UniqueName: \"kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk\") pod \"network-check-target-k54nn\" (UID: \"9f331474-f7dc-42b4-b8c1-63e68e2ed181\") " pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:37.719040 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:37.718978    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:37.719040 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:37.719007    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:37.719040 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:37.719022    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xctxk for pod openshift-network-diagnostics/network-check-target-k54nn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:37.719405 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:37.719355    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk podName:9f331474-f7dc-42b4-b8c1-63e68e2ed181 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.719322027 +0000 UTC m=+66.350073208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xctxk" (UniqueName: "kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk") pod "network-check-target-k54nn" (UID: "9f331474-f7dc-42b4-b8c1-63e68e2ed181") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:37.853440 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:37.853355    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:37.853594 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:37.853358    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:37.853594 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:37.853490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:37.853594 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:37.853489    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spn95" podUID="6a3c4894-5f9b-4173-954e-e0b4d2eae548"
Sep 11 14:15:37.853734 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:37.853600    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54nn" podUID="9f331474-f7dc-42b4-b8c1-63e68e2ed181"
Sep 11 14:15:37.853734 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:37.853682    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lltwm" podUID="1066f894-f0db-4259-8508-dbd6d0bf8009"
Sep 11 14:15:38.702069 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.701991    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeReady"
Sep 11 14:15:38.702503 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.702166    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 14:15:38.748819 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.748784    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z7zb8"]
Sep 11 14:15:38.752406 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.752386    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tx98m"]
Sep 11 14:15:38.752999 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.752976    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:38.755749 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.755732    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tx98m"
Sep 11 14:15:38.757275 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.757254    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xblvp\""
Sep 11 14:15:38.757275 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.757262    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 14:15:38.757674 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.757659    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 14:15:38.758409 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.758388    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 14:15:38.758515 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.758425    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 14:15:38.758676 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.758657    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 14:15:38.759155 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.759127    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bjq4z\""
Sep 11 14:15:38.763314 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.763158    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7zb8"]
Sep 11 14:15:38.767177 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.767120    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tx98m"]
Sep 11 14:15:38.928825 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.928797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/142fce86-4363-43cb-bd13-1e08a51edd69-tmp-dir\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:38.928924 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.928850    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:38.928924 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.928897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxtw8\" (UniqueName: \"kubernetes.io/projected/92d16529-45cb-49bf-9dc9-fcb18447e4f1-kube-api-access-kxtw8\") pod \"ingress-canary-tx98m\" (UID: \"92d16529-45cb-49bf-9dc9-fcb18447e4f1\") " pod="openshift-ingress-canary/ingress-canary-tx98m"
Sep 11 14:15:38.928924 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.928916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92d16529-45cb-49bf-9dc9-fcb18447e4f1-cert\") pod \"ingress-canary-tx98m\" (UID: \"92d16529-45cb-49bf-9dc9-fcb18447e4f1\") " pod="openshift-ingress-canary/ingress-canary-tx98m"
Sep 11 14:15:38.929067 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.928935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/142fce86-4363-43cb-bd13-1e08a51edd69-config-volume\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:38.929067 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:38.929037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwzch\" (UniqueName: \"kubernetes.io/projected/142fce86-4363-43cb-bd13-1e08a51edd69-kube-api-access-wwzch\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:39.030244 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.030214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxtw8\" (UniqueName: \"kubernetes.io/projected/92d16529-45cb-49bf-9dc9-fcb18447e4f1-kube-api-access-kxtw8\") pod \"ingress-canary-tx98m\" (UID: \"92d16529-45cb-49bf-9dc9-fcb18447e4f1\") " pod="openshift-ingress-canary/ingress-canary-tx98m"
Sep 11 14:15:39.030349 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.030255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92d16529-45cb-49bf-9dc9-fcb18447e4f1-cert\") pod \"ingress-canary-tx98m\" (UID: \"92d16529-45cb-49bf-9dc9-fcb18447e4f1\") " pod="openshift-ingress-canary/ingress-canary-tx98m"
Sep 11 14:15:39.030349 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.030274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/142fce86-4363-43cb-bd13-1e08a51edd69-config-volume\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:39.030349 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.030306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwzch\" (UniqueName: \"kubernetes.io/projected/142fce86-4363-43cb-bd13-1e08a51edd69-kube-api-access-wwzch\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:39.030494 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.030359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/142fce86-4363-43cb-bd13-1e08a51edd69-tmp-dir\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:39.030494 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.030388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:39.030581 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:39.030502    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:39.030581 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:39.030564    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls podName:142fce86-4363-43cb-bd13-1e08a51edd69 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:39.530545896 +0000 UTC m=+36.161297091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls") pod "dns-default-z7zb8" (UID: "142fce86-4363-43cb-bd13-1e08a51edd69") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:39.030740 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.030718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/142fce86-4363-43cb-bd13-1e08a51edd69-tmp-dir\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:39.030868 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.030846    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/142fce86-4363-43cb-bd13-1e08a51edd69-config-volume\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:39.034338 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.034315    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92d16529-45cb-49bf-9dc9-fcb18447e4f1-cert\") pod \"ingress-canary-tx98m\" (UID: \"92d16529-45cb-49bf-9dc9-fcb18447e4f1\") " pod="openshift-ingress-canary/ingress-canary-tx98m"
Sep 11 14:15:39.041853 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.041832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxtw8\" (UniqueName: \"kubernetes.io/projected/92d16529-45cb-49bf-9dc9-fcb18447e4f1-kube-api-access-kxtw8\") pod \"ingress-canary-tx98m\" (UID: \"92d16529-45cb-49bf-9dc9-fcb18447e4f1\") " pod="openshift-ingress-canary/ingress-canary-tx98m"
Sep 11 14:15:39.042041 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.042018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwzch\" (UniqueName: \"kubernetes.io/projected/142fce86-4363-43cb-bd13-1e08a51edd69-kube-api-access-wwzch\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:39.073049 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.073025    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tx98m"
Sep 11 14:15:39.161074 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.161050    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f" containerID="5dc480d30c732617dd76412bdd094ebd545b75097df76101cd8ab445d38a4f23" exitCode=0
Sep 11 14:15:39.161172 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.161084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7x7z9" event={"ID":"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f","Type":"ContainerDied","Data":"5dc480d30c732617dd76412bdd094ebd545b75097df76101cd8ab445d38a4f23"}
Sep 11 14:15:39.365749 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.365724    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tx98m"]
Sep 11 14:15:39.368576 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:15:39.368553    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d16529_45cb_49bf_9dc9_fcb18447e4f1.slice/crio-eb3d662c38b999584ab4c093bbaefb53937c10f85fd2c1fc332100d49fb62ca5 WatchSource:0}: Error finding container eb3d662c38b999584ab4c093bbaefb53937c10f85fd2c1fc332100d49fb62ca5: Status 404 returned error can't find the container with id eb3d662c38b999584ab4c093bbaefb53937c10f85fd2c1fc332100d49fb62ca5
Sep 11 14:15:39.534500 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.534448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:39.534599 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:39.534579    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:39.534659 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:39.534649    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls podName:142fce86-4363-43cb-bd13-1e08a51edd69 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:40.534634072 +0000 UTC m=+37.165385250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls") pod "dns-default-z7zb8" (UID: "142fce86-4363-43cb-bd13-1e08a51edd69") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:39.853885 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.853537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:15:39.853885 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.853590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:15:39.853885 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.853537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:15:39.856905 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.856879    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 14:15:39.857018 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.856986    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vtjb2\""
Sep 11 14:15:39.857183 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.857162    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 14:15:39.857543 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.857460    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 14:15:39.858051 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.857901    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lc92k\""
Sep 11 14:15:39.858051 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:39.857923    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 14:15:40.167778 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:40.167695    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f" containerID="16db1cafe367b2300ab29ab47cdd412d7727ca85301cc60ff2aafbc553327d41" exitCode=0
Sep 11 14:15:40.167908 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:40.167784    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7x7z9" event={"ID":"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f","Type":"ContainerDied","Data":"16db1cafe367b2300ab29ab47cdd412d7727ca85301cc60ff2aafbc553327d41"}
Sep 11 14:15:40.169455 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:40.169430    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tx98m" event={"ID":"92d16529-45cb-49bf-9dc9-fcb18447e4f1","Type":"ContainerStarted","Data":"eb3d662c38b999584ab4c093bbaefb53937c10f85fd2c1fc332100d49fb62ca5"}
Sep 11 14:15:40.541509 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:40.541477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:40.541689 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:40.541628    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:40.541735 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:40.541702    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls podName:142fce86-4363-43cb-bd13-1e08a51edd69 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:42.541684487 +0000 UTC m=+39.172435661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls") pod "dns-default-z7zb8" (UID: "142fce86-4363-43cb-bd13-1e08a51edd69") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:41.175370 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:41.175335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7x7z9" event={"ID":"4a73d63c-d9e2-466f-a2ec-6ad0e9f1d26f","Type":"ContainerStarted","Data":"1c04e5f102896b150bf17a7d9a5b4083eae0e76897cfaac8c7fca830dc46c2a3"}
Sep 11 14:15:41.198642 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:41.198590    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7x7z9" podStartSLOduration=8.67906207 podStartE2EDuration="38.198575205s" totalImagesPullingTime="29.519513135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:41.197471874 +0000 UTC m=+37.828223071" watchObservedRunningTime="2026-09-11 14:15:41.198575205 +0000 UTC m=+37.829326401"
Sep 11 14:15:42.179044 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:42.179008    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tx98m" event={"ID":"92d16529-45cb-49bf-9dc9-fcb18447e4f1","Type":"ContainerStarted","Data":"25e30fe731d6d253374cc0327e161649b6f0a2d16b8b84c58a451019a5736823"}
Sep 11 14:15:42.198178 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:42.198118    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tx98m" podStartSLOduration=1.8270047539999998 podStartE2EDuration="4.198106301s" totalImagesPullingTime="2.371101547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:42.19737222 +0000 UTC m=+38.828123417" watchObservedRunningTime="2026-09-11 14:15:42.198106301 +0000 UTC m=+38.828857497"
Sep 11 14:15:42.558249 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:42.558214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:42.558403 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:42.558355    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:42.558441 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:42.558416    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls podName:142fce86-4363-43cb-bd13-1e08a51edd69 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:46.558399301 +0000 UTC m=+43.189150479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls") pod "dns-default-z7zb8" (UID: "142fce86-4363-43cb-bd13-1e08a51edd69") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:46.582891 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:46.582685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:46.582891 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:46.582829    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:46.583328 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:46.582942    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls podName:142fce86-4363-43cb-bd13-1e08a51edd69 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:54.58292808 +0000 UTC m=+51.213679253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls") pod "dns-default-z7zb8" (UID: "142fce86-4363-43cb-bd13-1e08a51edd69") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:54.632899 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:15:54.632863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:15:54.633374 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:54.632982    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:54.633374 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:15:54.633031    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls podName:142fce86-4363-43cb-bd13-1e08a51edd69 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:10.633018331 +0000 UTC m=+67.263769505 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls") pod "dns-default-z7zb8" (UID: "142fce86-4363-43cb-bd13-1e08a51edd69") : secret "dns-default-metrics-tls" not found
Sep 11 14:16:01.671577 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.671544    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-r5wbk"]
Sep 11 14:16:01.673553 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.673526    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-r5wbk"
Sep 11 14:16:01.675836 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.675814    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:16:01.676084 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.676067    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 14:16:01.676149 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.676113    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jhdgb\""
Sep 11 14:16:01.677724 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.677708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhxvk\" (UniqueName: \"kubernetes.io/projected/faa554ea-ea88-4591-8954-eb1997352f84-kube-api-access-bhxvk\") pod \"volume-data-source-validator-86695b7cc7-r5wbk\" (UID: \"faa554ea-ea88-4591-8954-eb1997352f84\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-r5wbk"
Sep 11 14:16:01.680183 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.680023    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-wkp6k"]
Sep 11 14:16:01.681799 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.681781    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-dh7sx"]
Sep 11 14:16:01.681933 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.681915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.683650 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.683632    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-r5wbk"]
Sep 11 14:16:01.683752 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.683722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.684718 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.684702    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q6wrf\""
Sep 11 14:16:01.685291 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.685265    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 14:16:01.685647 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.685619    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 14:16:01.686166 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.686053    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 14:16:01.686166 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.686054    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 14:16:01.686968 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.686904    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 14:16:01.686968 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.686937    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 14:16:01.686968 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.686948    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 14:16:01.687210 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.687190    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:16:01.706397 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.706381    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 14:16:01.710871 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.710848    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qr6xl\""
Sep 11 14:16:01.710990 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.710960    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-dh7sx"]
Sep 11 14:16:01.711618 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.711602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-wkp6k"]
Sep 11 14:16:01.724376 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.724360    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 14:16:01.778370 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.778343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3068a765-444a-4f9c-9715-bec5001fd870-snapshots\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.778479 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.778380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhxvk\" (UniqueName: \"kubernetes.io/projected/faa554ea-ea88-4591-8954-eb1997352f84-kube-api-access-bhxvk\") pod \"volume-data-source-validator-86695b7cc7-r5wbk\" (UID: \"faa554ea-ea88-4591-8954-eb1997352f84\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-r5wbk"
Sep 11 14:16:01.778479 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.778406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b29ec053-9e8e-439d-87f4-e40e1aa71b09-config\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.778479 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.778427    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b29ec053-9e8e-439d-87f4-e40e1aa71b09-trusted-ca\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.778592 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.778491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3068a765-444a-4f9c-9715-bec5001fd870-serving-cert\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.778592 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.778525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b29ec053-9e8e-439d-87f4-e40e1aa71b09-serving-cert\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.778592 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.778541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3068a765-444a-4f9c-9715-bec5001fd870-tmp\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.778737 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.778589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skfh6\" (UniqueName: \"kubernetes.io/projected/b29ec053-9e8e-439d-87f4-e40e1aa71b09-kube-api-access-skfh6\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.778737 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.778628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3068a765-444a-4f9c-9715-bec5001fd870-trusted-ca-bundle\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.778737 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.778654    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt8lm\" (UniqueName: \"kubernetes.io/projected/3068a765-444a-4f9c-9715-bec5001fd870-kube-api-access-pt8lm\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.778737 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.778699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3068a765-444a-4f9c-9715-bec5001fd870-service-ca-bundle\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.791846 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.791826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhxvk\" (UniqueName: \"kubernetes.io/projected/faa554ea-ea88-4591-8954-eb1997352f84-kube-api-access-bhxvk\") pod \"volume-data-source-validator-86695b7cc7-r5wbk\" (UID: \"faa554ea-ea88-4591-8954-eb1997352f84\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-r5wbk"
Sep 11 14:16:01.879310 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3068a765-444a-4f9c-9715-bec5001fd870-service-ca-bundle\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.879405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3068a765-444a-4f9c-9715-bec5001fd870-snapshots\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.879405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b29ec053-9e8e-439d-87f4-e40e1aa71b09-config\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.879405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b29ec053-9e8e-439d-87f4-e40e1aa71b09-trusted-ca\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.879405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879394    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3068a765-444a-4f9c-9715-bec5001fd870-serving-cert\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.879606 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b29ec053-9e8e-439d-87f4-e40e1aa71b09-serving-cert\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.879606 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3068a765-444a-4f9c-9715-bec5001fd870-tmp\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.879606 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skfh6\" (UniqueName: \"kubernetes.io/projected/b29ec053-9e8e-439d-87f4-e40e1aa71b09-kube-api-access-skfh6\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.879759 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3068a765-444a-4f9c-9715-bec5001fd870-trusted-ca-bundle\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.879759 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt8lm\" (UniqueName: \"kubernetes.io/projected/3068a765-444a-4f9c-9715-bec5001fd870-kube-api-access-pt8lm\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.879931 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879889    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3068a765-444a-4f9c-9715-bec5001fd870-service-ca-bundle\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.880017 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.879965    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3068a765-444a-4f9c-9715-bec5001fd870-snapshots\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.880091 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.880077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b29ec053-9e8e-439d-87f4-e40e1aa71b09-config\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.880251 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.880231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b29ec053-9e8e-439d-87f4-e40e1aa71b09-trusted-ca\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.880322 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.880254    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3068a765-444a-4f9c-9715-bec5001fd870-tmp\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.881288 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.881267    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3068a765-444a-4f9c-9715-bec5001fd870-trusted-ca-bundle\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.881969 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.881947    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b29ec053-9e8e-439d-87f4-e40e1aa71b09-serving-cert\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.882052 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.882033    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3068a765-444a-4f9c-9715-bec5001fd870-serving-cert\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.883005 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.882986    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"]
Sep 11 14:16:01.885446 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.885431    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:01.887299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.887280    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c68498b8c-l8mt8"]
Sep 11 14:16:01.887664 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.887646    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jwfv2\""
Sep 11 14:16:01.889396 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.889379    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:01.897012 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.896996    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 14:16:01.897253 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.897228    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 14:16:01.897371 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.897253    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:16:01.897442 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.897266    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 14:16:01.897498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.897308    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 14:16:01.897498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.897314    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 14:16:01.897498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.897355    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jb4sz\""
Sep 11 14:16:01.899286 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.899261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skfh6\" (UniqueName: \"kubernetes.io/projected/b29ec053-9e8e-439d-87f4-e40e1aa71b09-kube-api-access-skfh6\") pod \"console-operator-696884fb9c-dh7sx\" (UID: \"b29ec053-9e8e-439d-87f4-e40e1aa71b09\") " pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:01.899961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.899934    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt8lm\" (UniqueName: \"kubernetes.io/projected/3068a765-444a-4f9c-9715-bec5001fd870-kube-api-access-pt8lm\") pod \"insights-operator-5844b856db-wkp6k\" (UID: \"3068a765-444a-4f9c-9715-bec5001fd870\") " pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.905304 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.905286    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"]
Sep 11 14:16:01.906746 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.906729    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 14:16:01.911239 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.911220    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c68498b8c-l8mt8"]
Sep 11 14:16:01.980847 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.980819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-trusted-ca\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:01.980943 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.980873    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xn7xm\" (UID: \"e3331a12-4c96-4c08-911e-28a97f06a61f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:01.980943 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.980932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-image-registry-private-configuration\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:01.981097 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.980968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-bound-sa-token\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:01.981097 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.980998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-certificates\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:01.981097 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.981013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-installation-pull-secrets\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:01.981097 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.981032    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s4b5\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-kube-api-access-4s4b5\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:01.981097 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.981083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bghjn\" (UniqueName: \"kubernetes.io/projected/e3331a12-4c96-4c08-911e-28a97f06a61f-kube-api-access-bghjn\") pod \"cluster-samples-operator-86499c89c4-xn7xm\" (UID: \"e3331a12-4c96-4c08-911e-28a97f06a61f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:01.981315 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.981105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:01.981315 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.981121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/66b50aea-bda6-4474-bd43-ab1d10056bb6-ca-trust-extracted\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:01.982829 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.982818    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-r5wbk"
Sep 11 14:16:01.991829 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.991809    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-wkp6k"
Sep 11 14:16:01.996463 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:01.996440    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:02.081821 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.081757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghjn\" (UniqueName: \"kubernetes.io/projected/e3331a12-4c96-4c08-911e-28a97f06a61f-kube-api-access-bghjn\") pod \"cluster-samples-operator-86499c89c4-xn7xm\" (UID: \"e3331a12-4c96-4c08-911e-28a97f06a61f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:02.081821 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.081800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.082006 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.081828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/66b50aea-bda6-4474-bd43-ab1d10056bb6-ca-trust-extracted\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.082006 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:02.081956    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 14:16:02.082006 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:02.081978    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c68498b8c-l8mt8: secret "image-registry-tls" not found
Sep 11 14:16:02.082228 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:02.082041    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls podName:66b50aea-bda6-4474-bd43-ab1d10056bb6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:02.582018048 +0000 UTC m=+59.212769235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls") pod "image-registry-7c68498b8c-l8mt8" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6") : secret "image-registry-tls" not found
Sep 11 14:16:02.082320 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.082232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/66b50aea-bda6-4474-bd43-ab1d10056bb6-ca-trust-extracted\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.082320 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.082233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-trusted-ca\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.082437 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.082322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xn7xm\" (UID: \"e3331a12-4c96-4c08-911e-28a97f06a61f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:02.082437 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.082372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-image-registry-private-configuration\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.082437 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.082414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-bound-sa-token\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.082593 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.082460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-certificates\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.082593 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.082483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-installation-pull-secrets\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.082593 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.082508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s4b5\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-kube-api-access-4s4b5\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.083804 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:02.082827    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 14:16:02.083804 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:02.082883    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls podName:e3331a12-4c96-4c08-911e-28a97f06a61f nodeName:}" failed. No retries permitted until 2026-09-11 14:16:02.582864196 +0000 UTC m=+59.213615374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xn7xm" (UID: "e3331a12-4c96-4c08-911e-28a97f06a61f") : secret "samples-operator-tls" not found
Sep 11 14:16:02.083804 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.083126    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-trusted-ca\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.083804 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.083599    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-certificates\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.085902 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.085868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-image-registry-private-configuration\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.085985 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.085965    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-installation-pull-secrets\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.091360 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.091342    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bghjn\" (UniqueName: \"kubernetes.io/projected/e3331a12-4c96-4c08-911e-28a97f06a61f-kube-api-access-bghjn\") pod \"cluster-samples-operator-86499c89c4-xn7xm\" (UID: \"e3331a12-4c96-4c08-911e-28a97f06a61f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:02.091526 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.091496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-bound-sa-token\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.091859 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.091844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s4b5\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-kube-api-access-4s4b5\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.260383 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.260319    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-r5wbk"]
Sep 11 14:16:02.264093 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:16:02.264058    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa554ea_ea88_4591_8954_eb1997352f84.slice/crio-ebdb81a62861f2f64dfc14947265868bbbb90d37dcb57bdc90f3143aedd6fa95 WatchSource:0}: Error finding container ebdb81a62861f2f64dfc14947265868bbbb90d37dcb57bdc90f3143aedd6fa95: Status 404 returned error can't find the container with id ebdb81a62861f2f64dfc14947265868bbbb90d37dcb57bdc90f3143aedd6fa95
Sep 11 14:16:02.265703 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.265682    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-wkp6k"]
Sep 11 14:16:02.268353 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:16:02.268335    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3068a765_444a_4f9c_9715_bec5001fd870.slice/crio-2cbd994bb78339e68bb0281cae35e7a8dece97c21da117c4a64567d8c81a9a5a WatchSource:0}: Error finding container 2cbd994bb78339e68bb0281cae35e7a8dece97c21da117c4a64567d8c81a9a5a: Status 404 returned error can't find the container with id 2cbd994bb78339e68bb0281cae35e7a8dece97c21da117c4a64567d8c81a9a5a
Sep 11 14:16:02.303457 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.303431    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-dh7sx"]
Sep 11 14:16:02.306552 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:16:02.306533    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29ec053_9e8e_439d_87f4_e40e1aa71b09.slice/crio-e1c6bba0d1a72f5cec183b3138ca2f77a2e138ac557dfc346d66bdd97fb6c5d8 WatchSource:0}: Error finding container e1c6bba0d1a72f5cec183b3138ca2f77a2e138ac557dfc346d66bdd97fb6c5d8: Status 404 returned error can't find the container with id e1c6bba0d1a72f5cec183b3138ca2f77a2e138ac557dfc346d66bdd97fb6c5d8
Sep 11 14:16:02.585741 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.585662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:02.585741 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:02.585736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xn7xm\" (UID: \"e3331a12-4c96-4c08-911e-28a97f06a61f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:02.585938 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:02.585807    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 14:16:02.585938 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:02.585826    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c68498b8c-l8mt8: secret "image-registry-tls" not found
Sep 11 14:16:02.585938 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:02.585851    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 14:16:02.585938 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:02.585879    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls podName:66b50aea-bda6-4474-bd43-ab1d10056bb6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:03.585864139 +0000 UTC m=+60.216615313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls") pod "image-registry-7c68498b8c-l8mt8" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6") : secret "image-registry-tls" not found
Sep 11 14:16:02.585938 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:02.585900    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls podName:e3331a12-4c96-4c08-911e-28a97f06a61f nodeName:}" failed. No retries permitted until 2026-09-11 14:16:03.585885719 +0000 UTC m=+60.216636913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xn7xm" (UID: "e3331a12-4c96-4c08-911e-28a97f06a61f") : secret "samples-operator-tls" not found
Sep 11 14:16:03.163416 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:03.163390    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxhlm"
Sep 11 14:16:03.229724 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:03.229691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-r5wbk" event={"ID":"faa554ea-ea88-4591-8954-eb1997352f84","Type":"ContainerStarted","Data":"ebdb81a62861f2f64dfc14947265868bbbb90d37dcb57bdc90f3143aedd6fa95"}
Sep 11 14:16:03.231589 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:03.231561    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-wkp6k" event={"ID":"3068a765-444a-4f9c-9715-bec5001fd870","Type":"ContainerStarted","Data":"2cbd994bb78339e68bb0281cae35e7a8dece97c21da117c4a64567d8c81a9a5a"}
Sep 11 14:16:03.234093 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:03.234066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" event={"ID":"b29ec053-9e8e-439d-87f4-e40e1aa71b09","Type":"ContainerStarted","Data":"e1c6bba0d1a72f5cec183b3138ca2f77a2e138ac557dfc346d66bdd97fb6c5d8"}
Sep 11 14:16:03.593864 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:03.593827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:03.594066 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:03.593923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xn7xm\" (UID: \"e3331a12-4c96-4c08-911e-28a97f06a61f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:03.594066 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:03.593999    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 14:16:03.594066 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:03.594023    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c68498b8c-l8mt8: secret "image-registry-tls" not found
Sep 11 14:16:03.594066 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:03.594047    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 14:16:03.594332 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:03.594097    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls podName:66b50aea-bda6-4474-bd43-ab1d10056bb6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:05.594079426 +0000 UTC m=+62.224830621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls") pod "image-registry-7c68498b8c-l8mt8" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6") : secret "image-registry-tls" not found
Sep 11 14:16:03.594332 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:03.594113    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls podName:e3331a12-4c96-4c08-911e-28a97f06a61f nodeName:}" failed. No retries permitted until 2026-09-11 14:16:05.594106817 +0000 UTC m=+62.224857990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xn7xm" (UID: "e3331a12-4c96-4c08-911e-28a97f06a61f") : secret "samples-operator-tls" not found
Sep 11 14:16:05.241481 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:05.241440    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-wkp6k" event={"ID":"3068a765-444a-4f9c-9715-bec5001fd870","Type":"ContainerStarted","Data":"becb3274f56ea4f18ce9c10033a8b63728e67f134f43557790e280a024c1efa5"}
Sep 11 14:16:05.242973 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:05.242952    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/0.log"
Sep 11 14:16:05.243064 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:05.242992    2581 generic.go:356] "Generic (PLEG): container finished" podID="b29ec053-9e8e-439d-87f4-e40e1aa71b09" containerID="cd15f6086983d53f03ed1a1930900bf767aa7a3e143e6afe33d7f2b143959067" exitCode=255
Sep 11 14:16:05.243112 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:05.243075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" event={"ID":"b29ec053-9e8e-439d-87f4-e40e1aa71b09","Type":"ContainerDied","Data":"cd15f6086983d53f03ed1a1930900bf767aa7a3e143e6afe33d7f2b143959067"}
Sep 11 14:16:05.243252 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:05.243237    2581 scope.go:117] "RemoveContainer" containerID="cd15f6086983d53f03ed1a1930900bf767aa7a3e143e6afe33d7f2b143959067"
Sep 11 14:16:05.244526 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:05.244506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-r5wbk" event={"ID":"faa554ea-ea88-4591-8954-eb1997352f84","Type":"ContainerStarted","Data":"901ad74a940c88cadb0e858210afc562ac766feaaf5640d1be2115d17de27837"}
Sep 11 14:16:05.262233 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:05.262189    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-wkp6k" podStartSLOduration=1.413233835 podStartE2EDuration="4.26217505s" totalImagesPullingTime="2.848941215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:05.260736405 +0000 UTC m=+61.891487600" watchObservedRunningTime="2026-09-11 14:16:05.26217505 +0000 UTC m=+61.892926273"
Sep 11 14:16:05.277087 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:05.276729    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-r5wbk" podStartSLOduration=1.433156492 podStartE2EDuration="4.276716461s" totalImagesPullingTime="2.843559969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:05.276715997 +0000 UTC m=+61.907467193" watchObservedRunningTime="2026-09-11 14:16:05.276716461 +0000 UTC m=+61.907467657"
Sep 11 14:16:05.613368 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:05.613284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:05.613368 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:05.613353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xn7xm\" (UID: \"e3331a12-4c96-4c08-911e-28a97f06a61f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:05.613551 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:05.613436    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 14:16:05.613551 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:05.613456    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c68498b8c-l8mt8: secret "image-registry-tls" not found
Sep 11 14:16:05.613551 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:05.613474    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 14:16:05.613551 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:05.613515    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls podName:66b50aea-bda6-4474-bd43-ab1d10056bb6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.613498591 +0000 UTC m=+66.244249781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls") pod "image-registry-7c68498b8c-l8mt8" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6") : secret "image-registry-tls" not found
Sep 11 14:16:05.613551 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:05.613529    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls podName:e3331a12-4c96-4c08-911e-28a97f06a61f nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.613523332 +0000 UTC m=+66.244274506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xn7xm" (UID: "e3331a12-4c96-4c08-911e-28a97f06a61f") : secret "samples-operator-tls" not found
Sep 11 14:16:06.248204 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.248177    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/1.log"
Sep 11 14:16:06.248746 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.248729    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/0.log"
Sep 11 14:16:06.248795 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.248765    2581 generic.go:356] "Generic (PLEG): container finished" podID="b29ec053-9e8e-439d-87f4-e40e1aa71b09" containerID="d0b1a7e1b392d95bbe4439d333f3b95f1a2fa6973b558a10b2572db5d58f1c1e" exitCode=255
Sep 11 14:16:06.248843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.248798    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" event={"ID":"b29ec053-9e8e-439d-87f4-e40e1aa71b09","Type":"ContainerDied","Data":"d0b1a7e1b392d95bbe4439d333f3b95f1a2fa6973b558a10b2572db5d58f1c1e"}
Sep 11 14:16:06.248883 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.248854    2581 scope.go:117] "RemoveContainer" containerID="cd15f6086983d53f03ed1a1930900bf767aa7a3e143e6afe33d7f2b143959067"
Sep 11 14:16:06.249084 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.249065    2581 scope.go:117] "RemoveContainer" containerID="d0b1a7e1b392d95bbe4439d333f3b95f1a2fa6973b558a10b2572db5d58f1c1e"
Sep 11 14:16:06.249287 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:06.249267    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-dh7sx_openshift-console-operator(b29ec053-9e8e-439d-87f4-e40e1aa71b09)\"" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" podUID="b29ec053-9e8e-439d-87f4-e40e1aa71b09"
Sep 11 14:16:06.553695 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.553622    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t8wff"]
Sep 11 14:16:06.556223 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.556207    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.560063 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.560041    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6n4gf\""
Sep 11 14:16:06.560207 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.560044    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 14:16:06.560383 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.560363    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 14:16:06.578300 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.578280    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t8wff"]
Sep 11 14:16:06.622640 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.622620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13d27bfe-8add-49c7-9e88-a7ed36a78c23-data-volume\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.622726 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.622660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.622726 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.622703    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgqd4\" (UniqueName: \"kubernetes.io/projected/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-api-access-pgqd4\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.622726 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.622719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.622841 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.622793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13d27bfe-8add-49c7-9e88-a7ed36a78c23-crio-socket\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.723414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.723390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.723498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.723442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgqd4\" (UniqueName: \"kubernetes.io/projected/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-api-access-pgqd4\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.723498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.723459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.723584 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:06.723505    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:06.723584 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:06.723532    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:06.723584 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:06.723563    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm podName:13d27bfe-8add-49c7-9e88-a7ed36a78c23 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.223545824 +0000 UTC m=+63.854296997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8wff" (UID: "13d27bfe-8add-49c7-9e88-a7ed36a78c23") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:06.723584 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:06.723577    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls podName:13d27bfe-8add-49c7-9e88-a7ed36a78c23 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.223570944 +0000 UTC m=+63.854322118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8wff" (UID: "13d27bfe-8add-49c7-9e88-a7ed36a78c23") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:06.723710 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.723591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13d27bfe-8add-49c7-9e88-a7ed36a78c23-crio-socket\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.723710 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.723655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13d27bfe-8add-49c7-9e88-a7ed36a78c23-data-volume\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.723771 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.723721    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13d27bfe-8add-49c7-9e88-a7ed36a78c23-crio-socket\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.723936 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.723922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13d27bfe-8add-49c7-9e88-a7ed36a78c23-data-volume\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:06.734602 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:06.734577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgqd4\" (UniqueName: \"kubernetes.io/projected/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-api-access-pgqd4\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:07.226784 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:07.226753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:07.227013 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:07.226812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:07.227013 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:07.226866    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:07.227013 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:07.226899    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:07.227013 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:07.226926    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm podName:13d27bfe-8add-49c7-9e88-a7ed36a78c23 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:08.226912341 +0000 UTC m=+64.857663515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8wff" (UID: "13d27bfe-8add-49c7-9e88-a7ed36a78c23") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:07.227013 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:07.226940    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls podName:13d27bfe-8add-49c7-9e88-a7ed36a78c23 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:08.226933715 +0000 UTC m=+64.857684888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8wff" (UID: "13d27bfe-8add-49c7-9e88-a7ed36a78c23") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:07.253171 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:07.253129    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/1.log"
Sep 11 14:16:07.253487 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:07.253438    2581 scope.go:117] "RemoveContainer" containerID="d0b1a7e1b392d95bbe4439d333f3b95f1a2fa6973b558a10b2572db5d58f1c1e"
Sep 11 14:16:07.253579 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:07.253562    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-dh7sx_openshift-console-operator(b29ec053-9e8e-439d-87f4-e40e1aa71b09)\"" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" podUID="b29ec053-9e8e-439d-87f4-e40e1aa71b09"
Sep 11 14:16:08.231473 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:08.231435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:08.231666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:08.231549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:08.231666 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:08.231572    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:08.231666 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:08.231632    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls podName:13d27bfe-8add-49c7-9e88-a7ed36a78c23 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:10.231617832 +0000 UTC m=+66.862369005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8wff" (UID: "13d27bfe-8add-49c7-9e88-a7ed36a78c23") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:08.231666 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:08.231657    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:08.231832 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:08.231706    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm podName:13d27bfe-8add-49c7-9e88-a7ed36a78c23 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:10.231693553 +0000 UTC m=+66.862444726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8wff" (UID: "13d27bfe-8add-49c7-9e88-a7ed36a78c23") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:08.657546 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:08.657473    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pc9xn_18888f5e-6492-4e3a-91f0-1df8358261ac/dns-node-resolver/0.log"
Sep 11 14:16:09.458300 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.458274    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jr657_f5a0754a-01e9-4d0e-8572-6bbd7143bc6b/node-ca/0.log"
Sep 11 14:16:09.541203 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.541173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:16:09.545618 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.545599    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 14:16:09.552171 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:09.552157    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 14:16:09.552253 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:09.552221    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs podName:6a3c4894-5f9b-4173-954e-e0b4d2eae548 nodeName:}" failed. No retries permitted until 2026-09-11 14:17:13.552198291 +0000 UTC m=+130.182949467 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs") pod "network-metrics-daemon-spn95" (UID: "6a3c4894-5f9b-4173-954e-e0b4d2eae548") : secret "metrics-daemon-secret" not found
Sep 11 14:16:09.642049 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.642023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xn7xm\" (UID: \"e3331a12-4c96-4c08-911e-28a97f06a61f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:09.642126 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.642081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:16:09.642126 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.642120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:09.642230 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:09.642169    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 14:16:09.642230 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:09.642223    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls podName:e3331a12-4c96-4c08-911e-28a97f06a61f nodeName:}" failed. No retries permitted until 2026-09-11 14:16:17.642205666 +0000 UTC m=+74.272956841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xn7xm" (UID: "e3331a12-4c96-4c08-911e-28a97f06a61f") : secret "samples-operator-tls" not found
Sep 11 14:16:09.642230 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:09.642227    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 14:16:09.642344 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:09.642238    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c68498b8c-l8mt8: secret "image-registry-tls" not found
Sep 11 14:16:09.642344 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:09.642275    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls podName:66b50aea-bda6-4474-bd43-ab1d10056bb6 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:17.642260889 +0000 UTC m=+74.273012072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls") pod "image-registry-7c68498b8c-l8mt8" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6") : secret "image-registry-tls" not found
Sep 11 14:16:09.645367 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.645351    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 14:16:09.654555 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.654534    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1066f894-f0db-4259-8508-dbd6d0bf8009-original-pull-secret\") pod \"global-pull-secret-syncer-lltwm\" (UID: \"1066f894-f0db-4259-8508-dbd6d0bf8009\") " pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:16:09.742828 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.742778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctxk\" (UniqueName: \"kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk\") pod \"network-check-target-k54nn\" (UID: \"9f331474-f7dc-42b4-b8c1-63e68e2ed181\") " pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:16:09.745748 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.745730    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 14:16:09.756128 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.756110    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 14:16:09.766592 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.766567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xctxk\" (UniqueName: \"kubernetes.io/projected/9f331474-f7dc-42b4-b8c1-63e68e2ed181-kube-api-access-xctxk\") pod \"network-check-target-k54nn\" (UID: \"9f331474-f7dc-42b4-b8c1-63e68e2ed181\") " pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:16:09.873653 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.873627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lltwm"
Sep 11 14:16:09.881370 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.881353    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lc92k\""
Sep 11 14:16:09.889579 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:09.889548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:16:10.145640 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:10.145568    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lltwm"]
Sep 11 14:16:10.148600 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:16:10.148568    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1066f894_f0db_4259_8508_dbd6d0bf8009.slice/crio-94dfb2dd616ea33d8d270628ec019712fb8b86748e5d18a0c0f05283acd07462 WatchSource:0}: Error finding container 94dfb2dd616ea33d8d270628ec019712fb8b86748e5d18a0c0f05283acd07462: Status 404 returned error can't find the container with id 94dfb2dd616ea33d8d270628ec019712fb8b86748e5d18a0c0f05283acd07462
Sep 11 14:16:10.187607 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:10.187581    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k54nn"]
Sep 11 14:16:10.190878 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:16:10.190858    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f331474_f7dc_42b4_b8c1_63e68e2ed181.slice/crio-a753d7efe149be8cd1a20dd1715e0635c36b9cb4770bed5060c6cc6f17ebd3dc WatchSource:0}: Error finding container a753d7efe149be8cd1a20dd1715e0635c36b9cb4770bed5060c6cc6f17ebd3dc: Status 404 returned error can't find the container with id a753d7efe149be8cd1a20dd1715e0635c36b9cb4770bed5060c6cc6f17ebd3dc
Sep 11 14:16:10.247300 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:10.247271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:10.247411 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:10.247393    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:10.247473 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:10.247430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:10.247473 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:10.247458    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm podName:13d27bfe-8add-49c7-9e88-a7ed36a78c23 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:14.24743438 +0000 UTC m=+70.878185572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8wff" (UID: "13d27bfe-8add-49c7-9e88-a7ed36a78c23") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:10.247595 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:10.247523    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:10.247595 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:10.247580    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls podName:13d27bfe-8add-49c7-9e88-a7ed36a78c23 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:14.247565024 +0000 UTC m=+70.878316202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8wff" (UID: "13d27bfe-8add-49c7-9e88-a7ed36a78c23") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:10.256646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:10.256621    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tx98m_92d16529-45cb-49bf-9dc9-fcb18447e4f1/serve-healthcheck-canary/0.log"
Sep 11 14:16:10.261587 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:10.261561    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lltwm" event={"ID":"1066f894-f0db-4259-8508-dbd6d0bf8009","Type":"ContainerStarted","Data":"94dfb2dd616ea33d8d270628ec019712fb8b86748e5d18a0c0f05283acd07462"}
Sep 11 14:16:10.262631 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:10.262613    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k54nn" event={"ID":"9f331474-f7dc-42b4-b8c1-63e68e2ed181","Type":"ContainerStarted","Data":"a753d7efe149be8cd1a20dd1715e0635c36b9cb4770bed5060c6cc6f17ebd3dc"}
Sep 11 14:16:10.651741 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:10.651708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:16:10.651915 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:10.651849    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:16:10.651993 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:10.651917    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls podName:142fce86-4363-43cb-bd13-1e08a51edd69 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:42.651898845 +0000 UTC m=+99.282650022 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls") pod "dns-default-z7zb8" (UID: "142fce86-4363-43cb-bd13-1e08a51edd69") : secret "dns-default-metrics-tls" not found
Sep 11 14:16:11.997519 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:11.997481    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:11.998004 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:11.997558    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:11.998004 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:11.997972    2581 scope.go:117] "RemoveContainer" containerID="d0b1a7e1b392d95bbe4439d333f3b95f1a2fa6973b558a10b2572db5d58f1c1e"
Sep 11 14:16:11.998187 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:11.998163    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-dh7sx_openshift-console-operator(b29ec053-9e8e-439d-87f4-e40e1aa71b09)\"" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" podUID="b29ec053-9e8e-439d-87f4-e40e1aa71b09"
Sep 11 14:16:14.285888 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:14.285852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:14.286386 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:14.285937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:14.286386 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:14.285972    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:14.286386 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:14.286066    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:14.286386 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:14.286099    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm podName:13d27bfe-8add-49c7-9e88-a7ed36a78c23 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:22.28607538 +0000 UTC m=+78.916826557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8wff" (UID: "13d27bfe-8add-49c7-9e88-a7ed36a78c23") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:14.286386 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:14.286134    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls podName:13d27bfe-8add-49c7-9e88-a7ed36a78c23 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:22.286115861 +0000 UTC m=+78.916867036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8wff" (UID: "13d27bfe-8add-49c7-9e88-a7ed36a78c23") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:15.279270 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:15.279235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lltwm" event={"ID":"1066f894-f0db-4259-8508-dbd6d0bf8009","Type":"ContainerStarted","Data":"b34b1230139896372015e39097bf355f4601064151786db045d160e05361ba1f"}
Sep 11 14:16:15.280706 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:15.280682    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k54nn" event={"ID":"9f331474-f7dc-42b4-b8c1-63e68e2ed181","Type":"ContainerStarted","Data":"9afe25c8836adf1de234457273584de29c3d6db4571bd5481fecc5f6bf79b6c8"}
Sep 11 14:16:15.280814 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:15.280751    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:16:15.297102 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:15.297059    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lltwm" podStartSLOduration=66.565324755 podStartE2EDuration="1m11.297045427s" totalImagesPullingTime="4.731720672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:15.295988065 +0000 UTC m=+71.926739273" watchObservedRunningTime="2026-09-11 14:16:15.297045427 +0000 UTC m=+71.927796622"
Sep 11 14:16:15.312984 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:15.312943    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k54nn" podStartSLOduration=66.623853893 podStartE2EDuration="1m11.312931571s" totalImagesPullingTime="4.689077678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:15.312755531 +0000 UTC m=+71.943506727" watchObservedRunningTime="2026-09-11 14:16:15.312931571 +0000 UTC m=+71.943682766"
Sep 11 14:16:17.715927 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:17.715892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:17.716326 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:17.715941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xn7xm\" (UID: \"e3331a12-4c96-4c08-911e-28a97f06a61f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:17.718244 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:17.718226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls\") pod \"image-registry-7c68498b8c-l8mt8\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") " pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:17.718345 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:17.718328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3331a12-4c96-4c08-911e-28a97f06a61f-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xn7xm\" (UID: \"e3331a12-4c96-4c08-911e-28a97f06a61f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:17.801062 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:17.801037    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jwfv2\""
Sep 11 14:16:17.809109 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:17.809091    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"
Sep 11 14:16:17.810382 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:17.810366    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jb4sz\""
Sep 11 14:16:17.818856 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:17.818838    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:18.082887 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:18.082822    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm"]
Sep 11 14:16:18.092154 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:18.092115    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c68498b8c-l8mt8"]
Sep 11 14:16:18.098090 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:16:18.098065    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b50aea_bda6_4474_bd43_ab1d10056bb6.slice/crio-1b31dd44f44395ccff51a5c3bdd8c83b866599ece576352a4d6d311da50ec9f1 WatchSource:0}: Error finding container 1b31dd44f44395ccff51a5c3bdd8c83b866599ece576352a4d6d311da50ec9f1: Status 404 returned error can't find the container with id 1b31dd44f44395ccff51a5c3bdd8c83b866599ece576352a4d6d311da50ec9f1
Sep 11 14:16:18.291785 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:18.291754    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm" event={"ID":"e3331a12-4c96-4c08-911e-28a97f06a61f","Type":"ContainerStarted","Data":"b6d1568d7074f985bb2783740e28c81c3d10e12165a5e115cb9bea58f3ec8741"}
Sep 11 14:16:18.293299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:18.293269    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8" event={"ID":"66b50aea-bda6-4474-bd43-ab1d10056bb6","Type":"ContainerStarted","Data":"c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080"}
Sep 11 14:16:18.293409 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:18.293311    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8" event={"ID":"66b50aea-bda6-4474-bd43-ab1d10056bb6","Type":"ContainerStarted","Data":"1b31dd44f44395ccff51a5c3bdd8c83b866599ece576352a4d6d311da50ec9f1"}
Sep 11 14:16:18.293409 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:18.293342    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:18.319364 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:18.319312    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8" podStartSLOduration=17.319293713 podStartE2EDuration="17.319293713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:18.318093962 +0000 UTC m=+74.948845170" watchObservedRunningTime="2026-09-11 14:16:18.319293713 +0000 UTC m=+74.950044960"
Sep 11 14:16:20.302525 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:20.302490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm" event={"ID":"e3331a12-4c96-4c08-911e-28a97f06a61f","Type":"ContainerStarted","Data":"3cd2631d4059636afd80f1f12cf1efe454546190e139bc8d781b11faf80b1350"}
Sep 11 14:16:20.302871 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:20.302543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm" event={"ID":"e3331a12-4c96-4c08-911e-28a97f06a61f","Type":"ContainerStarted","Data":"5c7d69fadae6febf6f0dfb44b3ee9c526679f06f146b5ea2d5ac96ce035530e3"}
Sep 11 14:16:22.348428 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:22.348391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:22.348791 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:22.348456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:22.348897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:22.348880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13d27bfe-8add-49c7-9e88-a7ed36a78c23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:22.350628 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:22.350596    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13d27bfe-8add-49c7-9e88-a7ed36a78c23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8wff\" (UID: \"13d27bfe-8add-49c7-9e88-a7ed36a78c23\") " pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:22.465997 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:22.465975    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t8wff"
Sep 11 14:16:22.734749 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:22.734607    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xn7xm" podStartSLOduration=20.31121537 podStartE2EDuration="21.734588733s" totalImagesPullingTime="1.423373363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:20.32874037 +0000 UTC m=+76.959491566" watchObservedRunningTime="2026-09-11 14:16:22.734588733 +0000 UTC m=+79.365339933"
Sep 11 14:16:22.735709 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:22.735686    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t8wff"]
Sep 11 14:16:22.738001 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:16:22.737977    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d27bfe_8add_49c7_9e88_a7ed36a78c23.slice/crio-9e01795a3181a7597a1ab0fae2b797e2a4ee11049d47149298d8ddf51ac5f93b WatchSource:0}: Error finding container 9e01795a3181a7597a1ab0fae2b797e2a4ee11049d47149298d8ddf51ac5f93b: Status 404 returned error can't find the container with id 9e01795a3181a7597a1ab0fae2b797e2a4ee11049d47149298d8ddf51ac5f93b
Sep 11 14:16:23.312567 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:23.312541    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8wff" event={"ID":"13d27bfe-8add-49c7-9e88-a7ed36a78c23","Type":"ContainerStarted","Data":"a0a0397b3844489ae47a530f848f045d30a68b1d087d5a389ee3e1979e380287"}
Sep 11 14:16:23.312713 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:23.312592    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8wff" event={"ID":"13d27bfe-8add-49c7-9e88-a7ed36a78c23","Type":"ContainerStarted","Data":"9e01795a3181a7597a1ab0fae2b797e2a4ee11049d47149298d8ddf51ac5f93b"}
Sep 11 14:16:24.318245 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:24.318209    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8wff" event={"ID":"13d27bfe-8add-49c7-9e88-a7ed36a78c23","Type":"ContainerStarted","Data":"f4fa445138a13e582136bf3dd55216c01beea24ef390391fb9494580a35fab44"}
Sep 11 14:16:24.853455 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:24.853424    2581 scope.go:117] "RemoveContainer" containerID="d0b1a7e1b392d95bbe4439d333f3b95f1a2fa6973b558a10b2572db5d58f1c1e"
Sep 11 14:16:25.322947 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:25.322925    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:16:25.323334 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:25.323319    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/1.log"
Sep 11 14:16:25.323377 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:25.323355    2581 generic.go:356] "Generic (PLEG): container finished" podID="b29ec053-9e8e-439d-87f4-e40e1aa71b09" containerID="240002c08cce16a85cd780b8bdd5e94d9db0e3e0970de39d32a5faad004e5a42" exitCode=255
Sep 11 14:16:25.323422 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:25.323403    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" event={"ID":"b29ec053-9e8e-439d-87f4-e40e1aa71b09","Type":"ContainerDied","Data":"240002c08cce16a85cd780b8bdd5e94d9db0e3e0970de39d32a5faad004e5a42"}
Sep 11 14:16:25.323500 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:25.323482    2581 scope.go:117] "RemoveContainer" containerID="d0b1a7e1b392d95bbe4439d333f3b95f1a2fa6973b558a10b2572db5d58f1c1e"
Sep 11 14:16:25.323797 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:25.323778    2581 scope.go:117] "RemoveContainer" containerID="240002c08cce16a85cd780b8bdd5e94d9db0e3e0970de39d32a5faad004e5a42"
Sep 11 14:16:25.323973 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:25.323952    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-dh7sx_openshift-console-operator(b29ec053-9e8e-439d-87f4-e40e1aa71b09)\"" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" podUID="b29ec053-9e8e-439d-87f4-e40e1aa71b09"
Sep 11 14:16:25.325605 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:25.325588    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8wff" event={"ID":"13d27bfe-8add-49c7-9e88-a7ed36a78c23","Type":"ContainerStarted","Data":"7cd68540b3f9b460d3609ee5a0665c9114e6c7af9eab38263e087fb63bdefa99"}
Sep 11 14:16:25.391897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:25.391857    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t8wff" podStartSLOduration=17.350633962 podStartE2EDuration="19.39184456s" totalImagesPullingTime="2.041210598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:16:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:25.389070482 +0000 UTC m=+82.019821678" watchObservedRunningTime="2026-09-11 14:16:25.39184456 +0000 UTC m=+82.022595756"
Sep 11 14:16:26.329704 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:26.329674    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:16:30.350611 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.350581    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"]
Sep 11 14:16:30.354662 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.354647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.365967 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.365946    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 14:16:30.366779 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.366764    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 14:16:30.366955 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.366943    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 14:16:30.368485 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.368469    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 14:16:30.368567 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.368552    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 14:16:30.377611 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.377591    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 14:16:30.377714 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.377642    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 14:16:30.378791 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.378776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"]
Sep 11 14:16:30.444703 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.444674    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c68498b8c-l8mt8"]
Sep 11 14:16:30.504216 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.504179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.504361 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.504237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.504361 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.504270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-ca\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.504361 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.504303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smpz6\" (UniqueName: \"kubernetes.io/projected/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-kube-api-access-smpz6\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.504513 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.504393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-hub\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.504513 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.504442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.605260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.605199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-hub\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.605260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.605234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.605260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.605255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.605492 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.605277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.605492 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.605296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-ca\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.605492 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.605332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smpz6\" (UniqueName: \"kubernetes.io/projected/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-kube-api-access-smpz6\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.606160 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.606115    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.607741 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.607721    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-ca\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.607839 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.607820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-hub\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.607878 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.607860    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.608053 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.608035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.666958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.666935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smpz6\" (UniqueName: \"kubernetes.io/projected/516f5540-fc9e-4d93-b8d3-e32beb16bc5a-kube-api-access-smpz6\") pod \"cluster-proxy-proxy-agent-8645c48758-5jrqj\" (UID: \"516f5540-fc9e-4d93-b8d3-e32beb16bc5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.680792 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.680774    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"
Sep 11 14:16:30.958279 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:30.958248    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj"]
Sep 11 14:16:30.961578 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:16:30.961547    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod516f5540_fc9e_4d93_b8d3_e32beb16bc5a.slice/crio-e6872d193b2440c2c3372d77608d32bb903b328d7bfb2eaf44c4d91c05947e11 WatchSource:0}: Error finding container e6872d193b2440c2c3372d77608d32bb903b328d7bfb2eaf44c4d91c05947e11: Status 404 returned error can't find the container with id e6872d193b2440c2c3372d77608d32bb903b328d7bfb2eaf44c4d91c05947e11
Sep 11 14:16:31.346091 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:31.346007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj" event={"ID":"516f5540-fc9e-4d93-b8d3-e32beb16bc5a","Type":"ContainerStarted","Data":"e6872d193b2440c2c3372d77608d32bb903b328d7bfb2eaf44c4d91c05947e11"}
Sep 11 14:16:31.997021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:31.996953    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:31.997021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:31.997022    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:31.997592 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:31.997442    2581 scope.go:117] "RemoveContainer" containerID="240002c08cce16a85cd780b8bdd5e94d9db0e3e0970de39d32a5faad004e5a42"
Sep 11 14:16:31.997655 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:31.997627    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-dh7sx_openshift-console-operator(b29ec053-9e8e-439d-87f4-e40e1aa71b09)\"" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" podUID="b29ec053-9e8e-439d-87f4-e40e1aa71b09"
Sep 11 14:16:35.362909 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:35.362870    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj" event={"ID":"516f5540-fc9e-4d93-b8d3-e32beb16bc5a","Type":"ContainerStarted","Data":"d60e39125c8693c86854a02041e9cd610530c01206847d8d6094f6b8569d2a2b"}
Sep 11 14:16:35.362909 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:35.362915    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj" event={"ID":"516f5540-fc9e-4d93-b8d3-e32beb16bc5a","Type":"ContainerStarted","Data":"093602eb919af267fa9377a0d8f54a1079e0e55291f3825329e6be8ba182d6f0"}
Sep 11 14:16:35.363375 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:35.362927    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj" event={"ID":"516f5540-fc9e-4d93-b8d3-e32beb16bc5a","Type":"ContainerStarted","Data":"fdf9419183cda3ca314e96dcd9c9b9139123b4e3088314f0d1419f16082097d4"}
Sep 11 14:16:40.218426 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.218359    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8645c48758-5jrqj" podStartSLOduration=6.644174955 podStartE2EDuration="10.218337751s" totalImagesPullingTime="3.574162796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:35.387467565 +0000 UTC m=+92.018218763" watchObservedRunningTime="2026-09-11 14:16:40.218337751 +0000 UTC m=+96.849089009"
Sep 11 14:16:40.218942 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.218921    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mplz7"]
Sep 11 14:16:40.221827 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.221806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.225051 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.225016    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 14:16:40.225179 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.225049    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9rrqh\""
Sep 11 14:16:40.225179 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.225076    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 14:16:40.225179 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.225076    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 14:16:40.225324 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.225203    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 14:16:40.226155 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.226124    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 14:16:40.226219 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.226171    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 14:16:40.370748 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.370725    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e402d86b-e14a-4efe-a405-b5e105e91f59-root\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.370873 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.370754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-textfile\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.370873 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.370778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6vbp\" (UniqueName: \"kubernetes.io/projected/e402d86b-e14a-4efe-a405-b5e105e91f59-kube-api-access-g6vbp\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.370873 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.370793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e402d86b-e14a-4efe-a405-b5e105e91f59-metrics-client-ca\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.370981 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.370877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.370981 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.370904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-tls\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.370981 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.370938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-accelerators-collector-config\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.370981 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.370972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-wtmp\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.371095 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.371009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e402d86b-e14a-4efe-a405-b5e105e91f59-sys\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.450943 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.450903    2581 patch_prober.go:28] interesting pod/image-registry-7c68498b8c-l8mt8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 14:16:40.451058 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.450967    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8" podUID="66b50aea-bda6-4474-bd43-ab1d10056bb6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 14:16:40.471737 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.471673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-tls\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.471737 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.471707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-accelerators-collector-config\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.471737 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.471736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-wtmp\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.471964 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.471852    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-wtmp\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.471964 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.471855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e402d86b-e14a-4efe-a405-b5e105e91f59-sys\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.471964 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.471909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e402d86b-e14a-4efe-a405-b5e105e91f59-root\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.471964 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.471939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e402d86b-e14a-4efe-a405-b5e105e91f59-sys\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.471964 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.471941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-textfile\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.472230 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.472001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6vbp\" (UniqueName: \"kubernetes.io/projected/e402d86b-e14a-4efe-a405-b5e105e91f59-kube-api-access-g6vbp\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.472230 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.472008    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e402d86b-e14a-4efe-a405-b5e105e91f59-root\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.472230 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.472031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e402d86b-e14a-4efe-a405-b5e105e91f59-metrics-client-ca\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.472230 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.472068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.472230 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.472211    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-textfile\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.472489 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.472428    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-accelerators-collector-config\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.472588 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.472567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e402d86b-e14a-4efe-a405-b5e105e91f59-metrics-client-ca\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.474043 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.474023    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-tls\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.474182 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.474092    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e402d86b-e14a-4efe-a405-b5e105e91f59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.483822 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.483803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6vbp\" (UniqueName: \"kubernetes.io/projected/e402d86b-e14a-4efe-a405-b5e105e91f59-kube-api-access-g6vbp\") pod \"node-exporter-mplz7\" (UID: \"e402d86b-e14a-4efe-a405-b5e105e91f59\") " pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.530920 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:40.530902    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mplz7"
Sep 11 14:16:40.540646 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:16:40.540627    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode402d86b_e14a_4efe_a405_b5e105e91f59.slice/crio-e3df464dfb3f44779dd478d213e43d4fcc43d2da56d4a595315cd1f0e81ee5af WatchSource:0}: Error finding container e3df464dfb3f44779dd478d213e43d4fcc43d2da56d4a595315cd1f0e81ee5af: Status 404 returned error can't find the container with id e3df464dfb3f44779dd478d213e43d4fcc43d2da56d4a595315cd1f0e81ee5af
Sep 11 14:16:41.382175 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:41.382133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mplz7" event={"ID":"e402d86b-e14a-4efe-a405-b5e105e91f59","Type":"ContainerStarted","Data":"e3df464dfb3f44779dd478d213e43d4fcc43d2da56d4a595315cd1f0e81ee5af"}
Sep 11 14:16:42.387291 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:42.387256    2581 generic.go:356] "Generic (PLEG): container finished" podID="e402d86b-e14a-4efe-a405-b5e105e91f59" containerID="86e69953098f32ffb12d8c8ad3daea476e94cfd2e027fa00a49c8e30ba65d078" exitCode=0
Sep 11 14:16:42.387663 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:42.387311    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mplz7" event={"ID":"e402d86b-e14a-4efe-a405-b5e105e91f59","Type":"ContainerDied","Data":"86e69953098f32ffb12d8c8ad3daea476e94cfd2e027fa00a49c8e30ba65d078"}
Sep 11 14:16:42.690062 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:42.690037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:16:42.692314 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:42.692285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/142fce86-4363-43cb-bd13-1e08a51edd69-metrics-tls\") pod \"dns-default-z7zb8\" (UID: \"142fce86-4363-43cb-bd13-1e08a51edd69\") " pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:16:42.970540 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:42.970465    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xblvp\""
Sep 11 14:16:42.978249 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:42.978228    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:16:43.270949 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:43.270866    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7zb8"]
Sep 11 14:16:43.276710 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:16:43.276684    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142fce86_4363_43cb_bd13_1e08a51edd69.slice/crio-2b1c213b9aa5d18a4a262ed98d3b88418a69bfd1375d5c9051880581902e2cb2 WatchSource:0}: Error finding container 2b1c213b9aa5d18a4a262ed98d3b88418a69bfd1375d5c9051880581902e2cb2: Status 404 returned error can't find the container with id 2b1c213b9aa5d18a4a262ed98d3b88418a69bfd1375d5c9051880581902e2cb2
Sep 11 14:16:43.392563 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:43.392532    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mplz7" event={"ID":"e402d86b-e14a-4efe-a405-b5e105e91f59","Type":"ContainerStarted","Data":"ba08005847240f36b62d554315390aa9571870e87182c9097e408263eb8feb37"}
Sep 11 14:16:43.392914 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:43.392583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mplz7" event={"ID":"e402d86b-e14a-4efe-a405-b5e105e91f59","Type":"ContainerStarted","Data":"d89ccde8c91ac4344da9ca78ffdf53a3d361a1f375c6a38109af5539abe87490"}
Sep 11 14:16:43.393674 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:43.393652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7zb8" event={"ID":"142fce86-4363-43cb-bd13-1e08a51edd69","Type":"ContainerStarted","Data":"2b1c213b9aa5d18a4a262ed98d3b88418a69bfd1375d5c9051880581902e2cb2"}
Sep 11 14:16:44.853959 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:44.853930    2581 scope.go:117] "RemoveContainer" containerID="240002c08cce16a85cd780b8bdd5e94d9db0e3e0970de39d32a5faad004e5a42"
Sep 11 14:16:44.854356 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:44.854134    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-dh7sx_openshift-console-operator(b29ec053-9e8e-439d-87f4-e40e1aa71b09)\"" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" podUID="b29ec053-9e8e-439d-87f4-e40e1aa71b09"
Sep 11 14:16:45.402466 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:45.402434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7zb8" event={"ID":"142fce86-4363-43cb-bd13-1e08a51edd69","Type":"ContainerStarted","Data":"389d21ab69c207b5cd9f01a8e9d1169879bd5a28a9c02bcee06eb6a1bcf07406"}
Sep 11 14:16:45.402644 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:45.402479    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7zb8" event={"ID":"142fce86-4363-43cb-bd13-1e08a51edd69","Type":"ContainerStarted","Data":"e80279c71bcb7389c6ec69b8d1dadee7fe4d4a68ca4656ad1a197a0ef855409c"}
Sep 11 14:16:45.402644 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:45.402583    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:16:45.676849 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:45.676774    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mplz7" podStartSLOduration=4.77924312 podStartE2EDuration="5.676759233s" totalImagesPullingTime="835.235216ms" totalInitContainerRuntime="62.280897ms" isStatefulPod=true podCreationTimestamp="2026-09-11 14:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:43.428008994 +0000 UTC m=+100.058760182" watchObservedRunningTime="2026-09-11 14:16:45.676759233 +0000 UTC m=+102.307510429"
Sep 11 14:16:45.676981 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:45.676878    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z7zb8" podStartSLOduration=66.228163556 podStartE2EDuration="1m7.676872278s" totalImagesPullingTime="1.448708722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:45.676528806 +0000 UTC m=+102.307280001" watchObservedRunningTime="2026-09-11 14:16:45.676872278 +0000 UTC m=+102.307623470"
Sep 11 14:16:46.288063 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:46.288031    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k54nn"
Sep 11 14:16:50.449248 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:50.449222    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:55.408508 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.408453    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z7zb8"
Sep 11 14:16:55.462743 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.462693    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8" podUID="66b50aea-bda6-4474-bd43-ab1d10056bb6" containerName="registry" containerID="cri-o://c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080" gracePeriod=30
Sep 11 14:16:55.698730 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.698707    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:55.882546 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.882519    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-bound-sa-token\") pod \"66b50aea-bda6-4474-bd43-ab1d10056bb6\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") "
Sep 11 14:16:55.882730 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.882559    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-image-registry-private-configuration\") pod \"66b50aea-bda6-4474-bd43-ab1d10056bb6\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") "
Sep 11 14:16:55.882730 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.882592    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-certificates\") pod \"66b50aea-bda6-4474-bd43-ab1d10056bb6\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") "
Sep 11 14:16:55.882730 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.882624    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s4b5\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-kube-api-access-4s4b5\") pod \"66b50aea-bda6-4474-bd43-ab1d10056bb6\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") "
Sep 11 14:16:55.882889 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.882873    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-trusted-ca\") pod \"66b50aea-bda6-4474-bd43-ab1d10056bb6\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") "
Sep 11 14:16:55.882962 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.882946    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-installation-pull-secrets\") pod \"66b50aea-bda6-4474-bd43-ab1d10056bb6\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") "
Sep 11 14:16:55.883024 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.883010    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls\") pod \"66b50aea-bda6-4474-bd43-ab1d10056bb6\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") "
Sep 11 14:16:55.883100 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.883050    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/66b50aea-bda6-4474-bd43-ab1d10056bb6-ca-trust-extracted\") pod \"66b50aea-bda6-4474-bd43-ab1d10056bb6\" (UID: \"66b50aea-bda6-4474-bd43-ab1d10056bb6\") "
Sep 11 14:16:55.883414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.883363    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "66b50aea-bda6-4474-bd43-ab1d10056bb6" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:16:55.883414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.883435    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "66b50aea-bda6-4474-bd43-ab1d10056bb6" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:16:55.885470 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.885430    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-kube-api-access-4s4b5" (OuterVolumeSpecName: "kube-api-access-4s4b5") pod "66b50aea-bda6-4474-bd43-ab1d10056bb6" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6"). InnerVolumeSpecName "kube-api-access-4s4b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:16:55.885677 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.885644    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "66b50aea-bda6-4474-bd43-ab1d10056bb6" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:16:55.885765 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.885713    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "66b50aea-bda6-4474-bd43-ab1d10056bb6" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:16:55.885841 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.885813    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "66b50aea-bda6-4474-bd43-ab1d10056bb6" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:16:55.885958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.885934    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "66b50aea-bda6-4474-bd43-ab1d10056bb6" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:16:55.891828 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.891798    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66b50aea-bda6-4474-bd43-ab1d10056bb6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "66b50aea-bda6-4474-bd43-ab1d10056bb6" (UID: "66b50aea-bda6-4474-bd43-ab1d10056bb6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:16:55.984343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.984312    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-bound-sa-token\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:16:55.984343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.984342    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-image-registry-private-configuration\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:16:55.984343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.984351    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-certificates\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:16:55.984517 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.984360    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s4b5\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-kube-api-access-4s4b5\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:16:55.984517 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.984369    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/66b50aea-bda6-4474-bd43-ab1d10056bb6-trusted-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:16:55.984517 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.984377    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/66b50aea-bda6-4474-bd43-ab1d10056bb6-installation-pull-secrets\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:16:55.984517 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.984384    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/66b50aea-bda6-4474-bd43-ab1d10056bb6-registry-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:16:55.984517 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:55.984394    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/66b50aea-bda6-4474-bd43-ab1d10056bb6-ca-trust-extracted\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:16:56.444028 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:56.443993    2581 generic.go:356] "Generic (PLEG): container finished" podID="66b50aea-bda6-4474-bd43-ab1d10056bb6" containerID="c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080" exitCode=0
Sep 11 14:16:56.444411 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:56.444051    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8"
Sep 11 14:16:56.444411 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:56.444072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8" event={"ID":"66b50aea-bda6-4474-bd43-ab1d10056bb6","Type":"ContainerDied","Data":"c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080"}
Sep 11 14:16:56.444411 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:56.444124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c68498b8c-l8mt8" event={"ID":"66b50aea-bda6-4474-bd43-ab1d10056bb6","Type":"ContainerDied","Data":"1b31dd44f44395ccff51a5c3bdd8c83b866599ece576352a4d6d311da50ec9f1"}
Sep 11 14:16:56.444411 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:56.444164    2581 scope.go:117] "RemoveContainer" containerID="c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080"
Sep 11 14:16:56.452016 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:56.452001    2581 scope.go:117] "RemoveContainer" containerID="c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080"
Sep 11 14:16:56.452306 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:16:56.452276    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080\": container with ID starting with c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080 not found: ID does not exist" containerID="c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080"
Sep 11 14:16:56.452412 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:56.452312    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080"} err="failed to get container status \"c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080\": rpc error: code = NotFound desc = could not find container \"c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080\": container with ID starting with c25f32e129508ca8dbd9bac3940b61538a6899e37f001b88b25843e166a5c080 not found: ID does not exist"
Sep 11 14:16:56.486725 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:56.486701    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c68498b8c-l8mt8"]
Sep 11 14:16:56.516491 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:56.516473    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c68498b8c-l8mt8"]
Sep 11 14:16:57.858521 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:57.858483    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66b50aea-bda6-4474-bd43-ab1d10056bb6" path="/var/lib/kubelet/pods/66b50aea-bda6-4474-bd43-ab1d10056bb6/volumes"
Sep 11 14:16:58.853776 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:58.853747    2581 scope.go:117] "RemoveContainer" containerID="240002c08cce16a85cd780b8bdd5e94d9db0e3e0970de39d32a5faad004e5a42"
Sep 11 14:16:59.457331 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:59.457302    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:16:59.457703 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:59.457391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" event={"ID":"b29ec053-9e8e-439d-87f4-e40e1aa71b09","Type":"ContainerStarted","Data":"7a5b56df83377c6d822c741785e02c44884a2c98086a32e91afb3bc4fb96ae25"}
Sep 11 14:16:59.457703 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:59.457656    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:59.694370 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:59.694344    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx"
Sep 11 14:16:59.761282 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:16:59.761196    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-dh7sx" podStartSLOduration=55.949904163 podStartE2EDuration="58.761174564s" totalImagesPullingTime="2.811270401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:59.516323349 +0000 UTC m=+116.147074547" watchObservedRunningTime="2026-09-11 14:16:59.761174564 +0000 UTC m=+116.391925763"
Sep 11 14:17:10.110211 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.110180    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54bd8b6877-7ptzd"]
Sep 11 14:17:10.110715 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.110515    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66b50aea-bda6-4474-bd43-ab1d10056bb6" containerName="registry"
Sep 11 14:17:10.110715 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.110532    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="66b50aea-bda6-4474-bd43-ab1d10056bb6" containerName="registry"
Sep 11 14:17:10.110715 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.110601    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="66b50aea-bda6-4474-bd43-ab1d10056bb6" containerName="registry"
Sep 11 14:17:10.114872 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.114854    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.119685 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.119662    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 14:17:10.119837 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.119819    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 14:17:10.119917 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.119739    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 14:17:10.119973 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.119723    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 14:17:10.131368 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.131351    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 14:17:10.131453 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.131433    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4nz8j\""
Sep 11 14:17:10.150628 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.150605    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 14:17:10.161048 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.161025    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54bd8b6877-7ptzd"]
Sep 11 14:17:10.168479 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.168459    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 14:17:10.184999 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.184975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-service-ca\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.185091 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.185003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-oauth-config\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.185091 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.185028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-serving-cert\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.185091 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.185072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-config\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.185234 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.185098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f95p\" (UniqueName: \"kubernetes.io/projected/d9e29d90-ac02-4a49-b281-aeb169b0450b-kube-api-access-4f95p\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.185234 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.185131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-oauth-serving-cert\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.285720 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.285693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-service-ca\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.285843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.285725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-oauth-config\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.285843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.285748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-serving-cert\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.285843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.285769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-config\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.285843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.285784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f95p\" (UniqueName: \"kubernetes.io/projected/d9e29d90-ac02-4a49-b281-aeb169b0450b-kube-api-access-4f95p\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.285843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.285817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-oauth-serving-cert\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.286536 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.286510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-service-ca\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.286628 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.286513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-oauth-serving-cert\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.286628 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.286510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-config\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.288201 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.288175    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-serving-cert\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.288201 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.288194    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-oauth-config\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.298240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.298212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f95p\" (UniqueName: \"kubernetes.io/projected/d9e29d90-ac02-4a49-b281-aeb169b0450b-kube-api-access-4f95p\") pod \"console-54bd8b6877-7ptzd\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") " pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.423382 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.423321    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:10.714879 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:10.714859    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54bd8b6877-7ptzd"]
Sep 11 14:17:10.716964 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:17:10.716937    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e29d90_ac02_4a49_b281_aeb169b0450b.slice/crio-d49bc9036b0715b0e80c859664520e808aacf6a4750dfd174ce1cba3837f63ef WatchSource:0}: Error finding container d49bc9036b0715b0e80c859664520e808aacf6a4750dfd174ce1cba3837f63ef: Status 404 returned error can't find the container with id d49bc9036b0715b0e80c859664520e808aacf6a4750dfd174ce1cba3837f63ef
Sep 11 14:17:11.499561 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:11.499525    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bd8b6877-7ptzd" event={"ID":"d9e29d90-ac02-4a49-b281-aeb169b0450b","Type":"ContainerStarted","Data":"d49bc9036b0715b0e80c859664520e808aacf6a4750dfd174ce1cba3837f63ef"}
Sep 11 14:17:13.509180 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:13.509083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bd8b6877-7ptzd" event={"ID":"d9e29d90-ac02-4a49-b281-aeb169b0450b","Type":"ContainerStarted","Data":"9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325"}
Sep 11 14:17:13.544731 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:13.544687    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54bd8b6877-7ptzd" podStartSLOduration=1.055752524 podStartE2EDuration="3.544671114s" totalImagesPullingTime="2.48891859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:13.543199214 +0000 UTC m=+130.173950410" watchObservedRunningTime="2026-09-11 14:17:13.544671114 +0000 UTC m=+130.175422312"
Sep 11 14:17:13.613010 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:13.612984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:17:13.615363 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:13.615338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a3c4894-5f9b-4173-954e-e0b4d2eae548-metrics-certs\") pod \"network-metrics-daemon-spn95\" (UID: \"6a3c4894-5f9b-4173-954e-e0b4d2eae548\") " pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:17:13.770211 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:13.770161    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vtjb2\""
Sep 11 14:17:13.776890 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:13.776877    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spn95"
Sep 11 14:17:14.111888 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:17:14.111861    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3c4894_5f9b_4173_954e_e0b4d2eae548.slice/crio-839ca1677723cb020371ee3fb6386c38768b27e11f22f91ee38c55df1346cb56 WatchSource:0}: Error finding container 839ca1677723cb020371ee3fb6386c38768b27e11f22f91ee38c55df1346cb56: Status 404 returned error can't find the container with id 839ca1677723cb020371ee3fb6386c38768b27e11f22f91ee38c55df1346cb56
Sep 11 14:17:14.116262 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:14.116242    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-spn95"]
Sep 11 14:17:14.513546 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:14.513513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spn95" event={"ID":"6a3c4894-5f9b-4173-954e-e0b4d2eae548","Type":"ContainerStarted","Data":"839ca1677723cb020371ee3fb6386c38768b27e11f22f91ee38c55df1346cb56"}
Sep 11 14:17:15.518906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:15.518874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spn95" event={"ID":"6a3c4894-5f9b-4173-954e-e0b4d2eae548","Type":"ContainerStarted","Data":"edd368732e2da7451b8e404f384a6b340e3e5090231ce03f1d11c66556807ffd"}
Sep 11 14:17:15.519274 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:15.518922    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spn95" event={"ID":"6a3c4894-5f9b-4173-954e-e0b4d2eae548","Type":"ContainerStarted","Data":"f45dea370e66d51161b80fe8d7bb171a4ecd41203c3eff840baa6564a1163330"}
Sep 11 14:17:15.543946 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:15.543904    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-spn95" podStartSLOduration=131.674998655 podStartE2EDuration="2m12.54388941s" totalImagesPullingTime="868.890755ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:15.542872561 +0000 UTC m=+132.173623757" watchObservedRunningTime="2026-09-11 14:17:15.54388941 +0000 UTC m=+132.174640605"
Sep 11 14:17:20.424242 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:20.424200    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:20.424673 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:20.424268    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:20.429080 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:20.429060    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:20.543446 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:20.543417    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:28.971619 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:28.971589    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54bd8b6877-7ptzd"]
Sep 11 14:17:36.600228 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:36.600191    2581 generic.go:356] "Generic (PLEG): container finished" podID="3068a765-444a-4f9c-9715-bec5001fd870" containerID="becb3274f56ea4f18ce9c10033a8b63728e67f134f43557790e280a024c1efa5" exitCode=0
Sep 11 14:17:36.600640 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:36.600246    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-wkp6k" event={"ID":"3068a765-444a-4f9c-9715-bec5001fd870","Type":"ContainerDied","Data":"becb3274f56ea4f18ce9c10033a8b63728e67f134f43557790e280a024c1efa5"}
Sep 11 14:17:36.600640 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:36.600587    2581 scope.go:117] "RemoveContainer" containerID="becb3274f56ea4f18ce9c10033a8b63728e67f134f43557790e280a024c1efa5"
Sep 11 14:17:37.605265 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:37.605235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-wkp6k" event={"ID":"3068a765-444a-4f9c-9715-bec5001fd870","Type":"ContainerStarted","Data":"e9bd6b3d0d8c6fe99a937f41f19685a3e5bd1a905f20e4983be7b01e7ca01827"}
Sep 11 14:17:53.990394 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:53.990359    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54bd8b6877-7ptzd" podUID="d9e29d90-ac02-4a49-b281-aeb169b0450b" containerName="console" containerID="cri-o://9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325" gracePeriod=15
Sep 11 14:17:54.233455 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.233432    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:54.293685 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.293631    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-oauth-serving-cert\") pod \"d9e29d90-ac02-4a49-b281-aeb169b0450b\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") "
Sep 11 14:17:54.293792 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.293700    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-oauth-config\") pod \"d9e29d90-ac02-4a49-b281-aeb169b0450b\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") "
Sep 11 14:17:54.293792 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.293730    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f95p\" (UniqueName: \"kubernetes.io/projected/d9e29d90-ac02-4a49-b281-aeb169b0450b-kube-api-access-4f95p\") pod \"d9e29d90-ac02-4a49-b281-aeb169b0450b\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") "
Sep 11 14:17:54.293792 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.293776    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-serving-cert\") pod \"d9e29d90-ac02-4a49-b281-aeb169b0450b\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") "
Sep 11 14:17:54.293947 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.293807    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-service-ca\") pod \"d9e29d90-ac02-4a49-b281-aeb169b0450b\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") "
Sep 11 14:17:54.293947 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.293834    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-config\") pod \"d9e29d90-ac02-4a49-b281-aeb169b0450b\" (UID: \"d9e29d90-ac02-4a49-b281-aeb169b0450b\") "
Sep 11 14:17:54.294043 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.294010    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d9e29d90-ac02-4a49-b281-aeb169b0450b" (UID: "d9e29d90-ac02-4a49-b281-aeb169b0450b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:17:54.294256 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.294231    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-service-ca" (OuterVolumeSpecName: "service-ca") pod "d9e29d90-ac02-4a49-b281-aeb169b0450b" (UID: "d9e29d90-ac02-4a49-b281-aeb169b0450b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:17:54.294342 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.294274    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-config" (OuterVolumeSpecName: "console-config") pod "d9e29d90-ac02-4a49-b281-aeb169b0450b" (UID: "d9e29d90-ac02-4a49-b281-aeb169b0450b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:17:54.295869 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.295844    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d9e29d90-ac02-4a49-b281-aeb169b0450b" (UID: "d9e29d90-ac02-4a49-b281-aeb169b0450b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:17:54.296251 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.296229    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d9e29d90-ac02-4a49-b281-aeb169b0450b" (UID: "d9e29d90-ac02-4a49-b281-aeb169b0450b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:17:54.296251 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.296239    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e29d90-ac02-4a49-b281-aeb169b0450b-kube-api-access-4f95p" (OuterVolumeSpecName: "kube-api-access-4f95p") pod "d9e29d90-ac02-4a49-b281-aeb169b0450b" (UID: "d9e29d90-ac02-4a49-b281-aeb169b0450b"). InnerVolumeSpecName "kube-api-access-4f95p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:17:54.394773 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.394747    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-serving-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:17:54.394773 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.394769    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:17:54.394773 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.394779    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-config\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:17:54.394946 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.394787    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9e29d90-ac02-4a49-b281-aeb169b0450b-oauth-serving-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:17:54.394946 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.394795    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9e29d90-ac02-4a49-b281-aeb169b0450b-console-oauth-config\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:17:54.394946 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.394803    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f95p\" (UniqueName: \"kubernetes.io/projected/d9e29d90-ac02-4a49-b281-aeb169b0450b-kube-api-access-4f95p\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:17:54.667616 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.667545    2581 generic.go:356] "Generic (PLEG): container finished" podID="d9e29d90-ac02-4a49-b281-aeb169b0450b" containerID="9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325" exitCode=0
Sep 11 14:17:54.667616 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.667588    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bd8b6877-7ptzd"
Sep 11 14:17:54.667761 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.667618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bd8b6877-7ptzd" event={"ID":"d9e29d90-ac02-4a49-b281-aeb169b0450b","Type":"ContainerDied","Data":"9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325"}
Sep 11 14:17:54.667761 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.667661    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bd8b6877-7ptzd" event={"ID":"d9e29d90-ac02-4a49-b281-aeb169b0450b","Type":"ContainerDied","Data":"d49bc9036b0715b0e80c859664520e808aacf6a4750dfd174ce1cba3837f63ef"}
Sep 11 14:17:54.667761 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.667683    2581 scope.go:117] "RemoveContainer" containerID="9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325"
Sep 11 14:17:54.677241 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.677224    2581 scope.go:117] "RemoveContainer" containerID="9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325"
Sep 11 14:17:54.677533 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:17:54.677508    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325\": container with ID starting with 9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325 not found: ID does not exist" containerID="9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325"
Sep 11 14:17:54.677632 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.677545    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325"} err="failed to get container status \"9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325\": rpc error: code = NotFound desc = could not find container \"9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325\": container with ID starting with 9514ce8711a7ee17f63b40aa6cf2c79aad8b19906a1e248e8d76e9ef192ab325 not found: ID does not exist"
Sep 11 14:17:54.704890 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.704864    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54bd8b6877-7ptzd"]
Sep 11 14:17:54.714930 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:54.714904    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54bd8b6877-7ptzd"]
Sep 11 14:17:55.857446 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:17:55.857418    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9e29d90-ac02-4a49-b281-aeb169b0450b" path="/var/lib/kubelet/pods/d9e29d90-ac02-4a49-b281-aeb169b0450b/volumes"
Sep 11 14:18:00.671085 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.671010    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bf44cd957-7znsg"]
Sep 11 14:18:00.671473 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.671272    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e29d90-ac02-4a49-b281-aeb169b0450b" containerName="console"
Sep 11 14:18:00.671473 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.671285    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e29d90-ac02-4a49-b281-aeb169b0450b" containerName="console"
Sep 11 14:18:00.671473 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.671332    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e29d90-ac02-4a49-b281-aeb169b0450b" containerName="console"
Sep 11 14:18:00.673489 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.673464    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.677731 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.677713    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 14:18:00.677731 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.677723    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 14:18:00.677911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.677769    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 14:18:00.677911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.677781    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 14:18:00.679330 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.679312    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 14:18:00.680412 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.680232    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 14:18:00.684083 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.684068    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 14:18:00.685295 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.685277    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4nz8j\""
Sep 11 14:18:00.692571 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.692550    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 14:18:00.718135 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.718112    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf44cd957-7znsg"]
Sep 11 14:18:00.736339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.736320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-oauth-config\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.736435 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.736350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-serving-cert\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.736435 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.736378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-trusted-ca-bundle\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.736435 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.736393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-console-config\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.736598 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.736476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-oauth-serving-cert\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.736598 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.736498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x2vj\" (UniqueName: \"kubernetes.io/projected/1a315e1b-350b-42df-b8f0-d05dca942456-kube-api-access-7x2vj\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.736598 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.736528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-service-ca\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.837060 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.837032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-service-ca\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.837227 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.837072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-oauth-config\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.837227 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.837101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-serving-cert\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.837227 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.837127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-trusted-ca-bundle\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.837227 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.837158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-console-config\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.837227 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.837199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-oauth-serving-cert\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.837227 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.837213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x2vj\" (UniqueName: \"kubernetes.io/projected/1a315e1b-350b-42df-b8f0-d05dca942456-kube-api-access-7x2vj\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.838309 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.838282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-oauth-serving-cert\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.838478 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.838386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-service-ca\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.838600 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.838577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-trusted-ca-bundle\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.838671 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.838458    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-console-config\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.843469 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.843447    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-oauth-config\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.844367 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.844349    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-serving-cert\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.847330 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.847312    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x2vj\" (UniqueName: \"kubernetes.io/projected/1a315e1b-350b-42df-b8f0-d05dca942456-kube-api-access-7x2vj\") pod \"console-bf44cd957-7znsg\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") " pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:00.983260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:00.983239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:01.259424 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:01.259340    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf44cd957-7znsg"]
Sep 11 14:18:01.263385 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:18:01.263350    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a315e1b_350b_42df_b8f0_d05dca942456.slice/crio-898c2bf0e1786f0ce247c1b7e2d63ff56db856e0f826c0770ec64a58cc8b660c WatchSource:0}: Error finding container 898c2bf0e1786f0ce247c1b7e2d63ff56db856e0f826c0770ec64a58cc8b660c: Status 404 returned error can't find the container with id 898c2bf0e1786f0ce247c1b7e2d63ff56db856e0f826c0770ec64a58cc8b660c
Sep 11 14:18:01.691519 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:01.691479    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf44cd957-7znsg" event={"ID":"1a315e1b-350b-42df-b8f0-d05dca942456","Type":"ContainerStarted","Data":"62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f"}
Sep 11 14:18:01.691873 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:01.691533    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf44cd957-7znsg" event={"ID":"1a315e1b-350b-42df-b8f0-d05dca942456","Type":"ContainerStarted","Data":"898c2bf0e1786f0ce247c1b7e2d63ff56db856e0f826c0770ec64a58cc8b660c"}
Sep 11 14:18:01.720254 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:01.720207    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bf44cd957-7znsg" podStartSLOduration=1.7201936629999999 podStartE2EDuration="1.720193663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:18:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:18:01.720090932 +0000 UTC m=+178.350842127" watchObservedRunningTime="2026-09-11 14:18:01.720193663 +0000 UTC m=+178.350944859"
Sep 11 14:18:10.983575 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:10.983531    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:10.983575 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:10.983590    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:10.988486 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:10.988464    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:18:11.734627 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:18:11.734599    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:19:27.694831 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.694752    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zz92g"]
Sep 11 14:19:27.698368 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.698353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zz92g"
Sep 11 14:19:27.702674 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.702655    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6br54\""
Sep 11 14:19:27.703299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.703282    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 14:19:27.703677 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.703650    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 14:19:27.711005 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.710987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d9629a9-83b1-4d64-9307-0505c529cd5c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zz92g\" (UID: \"4d9629a9-83b1-4d64-9307-0505c529cd5c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zz92g"
Sep 11 14:19:27.711082 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.711026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb44l\" (UniqueName: \"kubernetes.io/projected/4d9629a9-83b1-4d64-9307-0505c529cd5c-kube-api-access-sb44l\") pod \"cert-manager-cainjector-559cdd8c87-zz92g\" (UID: \"4d9629a9-83b1-4d64-9307-0505c529cd5c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zz92g"
Sep 11 14:19:27.778372 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.778351    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zz92g"]
Sep 11 14:19:27.811736 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.811711    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d9629a9-83b1-4d64-9307-0505c529cd5c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zz92g\" (UID: \"4d9629a9-83b1-4d64-9307-0505c529cd5c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zz92g"
Sep 11 14:19:27.811819 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.811751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb44l\" (UniqueName: \"kubernetes.io/projected/4d9629a9-83b1-4d64-9307-0505c529cd5c-kube-api-access-sb44l\") pod \"cert-manager-cainjector-559cdd8c87-zz92g\" (UID: \"4d9629a9-83b1-4d64-9307-0505c529cd5c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zz92g"
Sep 11 14:19:27.838080 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.838060    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb44l\" (UniqueName: \"kubernetes.io/projected/4d9629a9-83b1-4d64-9307-0505c529cd5c-kube-api-access-sb44l\") pod \"cert-manager-cainjector-559cdd8c87-zz92g\" (UID: \"4d9629a9-83b1-4d64-9307-0505c529cd5c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zz92g"
Sep 11 14:19:27.840887 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:27.840869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d9629a9-83b1-4d64-9307-0505c529cd5c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zz92g\" (UID: \"4d9629a9-83b1-4d64-9307-0505c529cd5c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zz92g"
Sep 11 14:19:28.007069 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:28.007018    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zz92g"
Sep 11 14:19:28.303973 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:28.303914    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zz92g"]
Sep 11 14:19:28.306233 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:19:28.306206    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d9629a9_83b1_4d64_9307_0505c529cd5c.slice/crio-c410dabc0247f94a234fa754cb1b7622aeb19bc2c8db0c97ee6f5003935884ab WatchSource:0}: Error finding container c410dabc0247f94a234fa754cb1b7622aeb19bc2c8db0c97ee6f5003935884ab: Status 404 returned error can't find the container with id c410dabc0247f94a234fa754cb1b7622aeb19bc2c8db0c97ee6f5003935884ab
Sep 11 14:19:28.981003 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:28.980967    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zz92g" event={"ID":"4d9629a9-83b1-4d64-9307-0505c529cd5c","Type":"ContainerStarted","Data":"c410dabc0247f94a234fa754cb1b7622aeb19bc2c8db0c97ee6f5003935884ab"}
Sep 11 14:19:40.095045 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.095013    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl"]
Sep 11 14:19:40.099217 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.099202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl"
Sep 11 14:19:40.101993 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.101970    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wwd5d\""
Sep 11 14:19:40.102104 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.102006    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:19:40.102956 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.102938    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 14:19:40.121374 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.121348    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl"]
Sep 11 14:19:40.195313 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.195285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fgp4\" (UniqueName: \"kubernetes.io/projected/3ce4e1bf-a58e-4687-8337-3a4635027536-kube-api-access-6fgp4\") pod \"openshift-lws-operator-fd8ccff4c-4z9zl\" (UID: \"3ce4e1bf-a58e-4687-8337-3a4635027536\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl"
Sep 11 14:19:40.195452 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.195334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ce4e1bf-a58e-4687-8337-3a4635027536-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4z9zl\" (UID: \"3ce4e1bf-a58e-4687-8337-3a4635027536\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl"
Sep 11 14:19:40.295940 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.295917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgp4\" (UniqueName: \"kubernetes.io/projected/3ce4e1bf-a58e-4687-8337-3a4635027536-kube-api-access-6fgp4\") pod \"openshift-lws-operator-fd8ccff4c-4z9zl\" (UID: \"3ce4e1bf-a58e-4687-8337-3a4635027536\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl"
Sep 11 14:19:40.296031 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.295958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ce4e1bf-a58e-4687-8337-3a4635027536-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4z9zl\" (UID: \"3ce4e1bf-a58e-4687-8337-3a4635027536\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl"
Sep 11 14:19:40.296305 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.296286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ce4e1bf-a58e-4687-8337-3a4635027536-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4z9zl\" (UID: \"3ce4e1bf-a58e-4687-8337-3a4635027536\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl"
Sep 11 14:19:40.320086 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.320063    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fgp4\" (UniqueName: \"kubernetes.io/projected/3ce4e1bf-a58e-4687-8337-3a4635027536-kube-api-access-6fgp4\") pod \"openshift-lws-operator-fd8ccff4c-4z9zl\" (UID: \"3ce4e1bf-a58e-4687-8337-3a4635027536\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl"
Sep 11 14:19:40.407977 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.407915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl"
Sep 11 14:19:40.697947 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:40.697910    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl"]
Sep 11 14:19:40.701225 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:19:40.701195    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ce4e1bf_a58e_4687_8337_3a4635027536.slice/crio-128f95bac29f61b0eb39988558cdb6991dc904fa021374f98762e7642e04fb8d WatchSource:0}: Error finding container 128f95bac29f61b0eb39988558cdb6991dc904fa021374f98762e7642e04fb8d: Status 404 returned error can't find the container with id 128f95bac29f61b0eb39988558cdb6991dc904fa021374f98762e7642e04fb8d
Sep 11 14:19:41.021610 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:41.021537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl" event={"ID":"3ce4e1bf-a58e-4687-8337-3a4635027536","Type":"ContainerStarted","Data":"128f95bac29f61b0eb39988558cdb6991dc904fa021374f98762e7642e04fb8d"}
Sep 11 14:19:44.034132 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:44.034098    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl" event={"ID":"3ce4e1bf-a58e-4687-8337-3a4635027536","Type":"ContainerStarted","Data":"59089ad2878e1c2f48d985fb196b2283fc403b32e512c7dbf4565b621a4172fb"}
Sep 11 14:19:47.047870 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:47.047829    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zz92g" event={"ID":"4d9629a9-83b1-4d64-9307-0505c529cd5c","Type":"ContainerStarted","Data":"9bec0e0c02ad31d37a56ee84cbfd51b3b9108d6965c6cfed3f3955c87fe48f1a"}
Sep 11 14:19:47.094155 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:47.094085    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4z9zl" podStartSLOduration=4.5683141670000005 podStartE2EDuration="7.094071343s" totalImagesPullingTime="2.525757176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:19:44.060900621 +0000 UTC m=+280.691651817" watchObservedRunningTime="2026-09-11 14:19:47.094071343 +0000 UTC m=+283.724822539"
Sep 11 14:19:47.094686 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:19:47.094662    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zz92g" podStartSLOduration=1.84771338 podStartE2EDuration="20.094652525s" totalImagesPullingTime="18.246939145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:19:47.094014526 +0000 UTC m=+283.724765722" watchObservedRunningTime="2026-09-11 14:19:47.094652525 +0000 UTC m=+283.725403720"
Sep 11 14:20:01.866225 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.866196    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"]
Sep 11 14:20:01.872595 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.872572    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:01.878015 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.877987    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 14:20:01.878134 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.878044    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 14:20:01.878412 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.878396    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 14:20:01.879404 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.879382    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 14:20:01.879659 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.879643    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rpcgr\""
Sep 11 14:20:01.954551 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.954527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnjtk\" (UniqueName: \"kubernetes.io/projected/ca7b7a78-2564-48fd-b149-15d5de96de14-kube-api-access-bnjtk\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:01.954665 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.954555    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca7b7a78-2564-48fd-b149-15d5de96de14-tmp\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:01.954665 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.954588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca7b7a78-2564-48fd-b149-15d5de96de14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:01.954665 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.954604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca7b7a78-2564-48fd-b149-15d5de96de14-webhook-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:01.954665 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.954657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca7b7a78-2564-48fd-b149-15d5de96de14-manifests\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:01.965347 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:01.965325    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"]
Sep 11 14:20:02.055183 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.055159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnjtk\" (UniqueName: \"kubernetes.io/projected/ca7b7a78-2564-48fd-b149-15d5de96de14-kube-api-access-bnjtk\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:02.055301 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.055190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca7b7a78-2564-48fd-b149-15d5de96de14-tmp\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:02.055301 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.055224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca7b7a78-2564-48fd-b149-15d5de96de14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:02.055301 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.055242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca7b7a78-2564-48fd-b149-15d5de96de14-webhook-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:02.055301 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.055265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca7b7a78-2564-48fd-b149-15d5de96de14-manifests\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:02.055631 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.055610    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca7b7a78-2564-48fd-b149-15d5de96de14-manifests\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:02.057425 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.057405    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca7b7a78-2564-48fd-b149-15d5de96de14-tmp\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:02.057721 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.057703    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca7b7a78-2564-48fd-b149-15d5de96de14-webhook-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:02.057721 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.057713    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca7b7a78-2564-48fd-b149-15d5de96de14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:02.073006 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.072984    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnjtk\" (UniqueName: \"kubernetes.io/projected/ca7b7a78-2564-48fd-b149-15d5de96de14-kube-api-access-bnjtk\") pod \"opendatahub-operator-controller-manager-74798b5f56-6ljh5\" (UID: \"ca7b7a78-2564-48fd-b149-15d5de96de14\") " pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:02.183032 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.182972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:02.492612 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:02.492579    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"]
Sep 11 14:20:02.497548 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:20:02.497525    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7b7a78_2564_48fd_b149_15d5de96de14.slice/crio-249c1612bcf4dd66dbb31638fbae0e5dbe70a3afd9891a4a8b329928646575fe WatchSource:0}: Error finding container 249c1612bcf4dd66dbb31638fbae0e5dbe70a3afd9891a4a8b329928646575fe: Status 404 returned error can't find the container with id 249c1612bcf4dd66dbb31638fbae0e5dbe70a3afd9891a4a8b329928646575fe
Sep 11 14:20:03.103353 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:03.103312    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5" event={"ID":"ca7b7a78-2564-48fd-b149-15d5de96de14","Type":"ContainerStarted","Data":"249c1612bcf4dd66dbb31638fbae0e5dbe70a3afd9891a4a8b329928646575fe"}
Sep 11 14:20:03.768661 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:03.768631    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:20:03.772001 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:03.771981    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:20:03.792106 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:03.792088    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 14:20:06.117716 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:06.117680    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5" event={"ID":"ca7b7a78-2564-48fd-b149-15d5de96de14","Type":"ContainerStarted","Data":"8ec8ef182d53eea2b72a8ae4b3e7618a6b758414b19d80e5df39f5d84e0cf700"}
Sep 11 14:20:07.123747 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:07.123711    2581 generic.go:356] "Generic (PLEG): container finished" podID="ca7b7a78-2564-48fd-b149-15d5de96de14" containerID="8ec8ef182d53eea2b72a8ae4b3e7618a6b758414b19d80e5df39f5d84e0cf700" exitCode=0
Sep 11 14:20:07.124209 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:07.123793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5" event={"ID":"ca7b7a78-2564-48fd-b149-15d5de96de14","Type":"ContainerDied","Data":"8ec8ef182d53eea2b72a8ae4b3e7618a6b758414b19d80e5df39f5d84e0cf700"}
Sep 11 14:20:07.124274 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:07.124257    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:20:08.129860 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:08.129819    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5" event={"ID":"ca7b7a78-2564-48fd-b149-15d5de96de14","Type":"ContainerStarted","Data":"43bd381f5fdb57991cf15f2dfbf6df40b2564685118c3a74ca2cb8d0e30affa3"}
Sep 11 14:20:08.130316 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:08.129921    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:08.223289 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:08.223243    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5" podStartSLOduration=2.628863988 podStartE2EDuration="7.223226016s" totalImagesPullingTime="3.538652606s" totalInitContainerRuntime="1.055709422s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:20:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:20:08.209803754 +0000 UTC m=+304.840554950" watchObservedRunningTime="2026-09-11 14:20:08.223226016 +0000 UTC m=+304.853977211"
Sep 11 14:20:19.136356 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:19.136325    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74798b5f56-6ljh5"
Sep 11 14:20:28.226766 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.226730    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"]
Sep 11 14:20:28.229869 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.229852    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"
Sep 11 14:20:28.234081 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.234062    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 14:20:28.234405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.234389    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 14:20:28.234405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.234400    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 14:20:28.235220 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.235203    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 14:20:28.248418 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.248398    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"]
Sep 11 14:20:28.353158 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.353112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8xj2\" (UniqueName: \"kubernetes.io/projected/0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0-kube-api-access-x8xj2\") pod \"kube-auth-proxy-f974d944c-9ljbn\" (UID: \"0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0\") " pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"
Sep 11 14:20:28.353316 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.353198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0-tmp\") pod \"kube-auth-proxy-f974d944c-9ljbn\" (UID: \"0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0\") " pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"
Sep 11 14:20:28.353316 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.353235    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0-tls-certs\") pod \"kube-auth-proxy-f974d944c-9ljbn\" (UID: \"0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0\") " pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"
Sep 11 14:20:28.453785 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.453754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8xj2\" (UniqueName: \"kubernetes.io/projected/0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0-kube-api-access-x8xj2\") pod \"kube-auth-proxy-f974d944c-9ljbn\" (UID: \"0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0\") " pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"
Sep 11 14:20:28.453907 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.453800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0-tmp\") pod \"kube-auth-proxy-f974d944c-9ljbn\" (UID: \"0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0\") " pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"
Sep 11 14:20:28.453907 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.453831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0-tls-certs\") pod \"kube-auth-proxy-f974d944c-9ljbn\" (UID: \"0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0\") " pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"
Sep 11 14:20:28.456023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.456003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0-tmp\") pod \"kube-auth-proxy-f974d944c-9ljbn\" (UID: \"0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0\") " pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"
Sep 11 14:20:28.456176 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.456134    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0-tls-certs\") pod \"kube-auth-proxy-f974d944c-9ljbn\" (UID: \"0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0\") " pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"
Sep 11 14:20:28.473212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.473186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8xj2\" (UniqueName: \"kubernetes.io/projected/0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0-kube-api-access-x8xj2\") pod \"kube-auth-proxy-f974d944c-9ljbn\" (UID: \"0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0\") " pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"
Sep 11 14:20:28.538643 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.538595    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"
Sep 11 14:20:28.829302 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:28.829219    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f974d944c-9ljbn"]
Sep 11 14:20:28.832115 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:20:28.832085    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ddfce7d_f1ee_4b74_9cee_2ebc5f729cd0.slice/crio-4b457ffbcb6c57751f64e79c5fe179a8bfd315af248ae6b2ed5dbe9bf2927c90 WatchSource:0}: Error finding container 4b457ffbcb6c57751f64e79c5fe179a8bfd315af248ae6b2ed5dbe9bf2927c90: Status 404 returned error can't find the container with id 4b457ffbcb6c57751f64e79c5fe179a8bfd315af248ae6b2ed5dbe9bf2927c90
Sep 11 14:20:29.208024 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:29.207987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn" event={"ID":"0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0","Type":"ContainerStarted","Data":"4b457ffbcb6c57751f64e79c5fe179a8bfd315af248ae6b2ed5dbe9bf2927c90"}
Sep 11 14:20:30.083705 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.081677    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"]
Sep 11 14:20:30.086037 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.086010    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.090025 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.090003    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b244d\""
Sep 11 14:20:30.090812 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.090798    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 14:20:30.091041 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.091022    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 14:20:30.091361 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.091347    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 14:20:30.091415 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.091381    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 14:20:30.143512 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.143452    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"]
Sep 11 14:20:30.270571 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.270494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.270571 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.270552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.270814 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.270616    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.270814 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.270641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.270814 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.270726    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.270814 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.270793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89rps\" (UniqueName: \"kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-kube-api-access-89rps\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.270991 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.270858    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.371506 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.371425    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.371506 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.371471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.371506 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.371504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.371766 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.371547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89rps\" (UniqueName: \"kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-kube-api-access-89rps\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.371766 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.371601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.371766 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.371636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.371766 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.371668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.372662 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.372634    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.374566 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.374540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.375317 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.375290    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.376046 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.375897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.376262 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.376232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.390285 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.390240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.395961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.395934    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89rps\" (UniqueName: \"kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-kube-api-access-89rps\") pod \"istiod-openshift-gateway-7b7995d5cd-swbz7\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:30.695054 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:30.695019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:32.020300 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:32.020278    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"]
Sep 11 14:20:32.022116 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:20:32.022087    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71b1c3b_c6e6_45a9_878c_ed20c9b3b638.slice/crio-9d9fd28e131daa050c6e56f60f61327d8e31a8266cb9afff3ee588a0a563aa31 WatchSource:0}: Error finding container 9d9fd28e131daa050c6e56f60f61327d8e31a8266cb9afff3ee588a0a563aa31: Status 404 returned error can't find the container with id 9d9fd28e131daa050c6e56f60f61327d8e31a8266cb9afff3ee588a0a563aa31
Sep 11 14:20:32.223149 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:32.223110    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7" event={"ID":"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638","Type":"ContainerStarted","Data":"9d9fd28e131daa050c6e56f60f61327d8e31a8266cb9afff3ee588a0a563aa31"}
Sep 11 14:20:32.224631 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:32.224597    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn" event={"ID":"0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0","Type":"ContainerStarted","Data":"b13d2c8e2c320b7c95a8920137b0e3497e78c65d6ad4cc67a5c53276f1607930"}
Sep 11 14:20:32.245370 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:32.245320    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f974d944c-9ljbn" podStartSLOduration=1.2861682220000001 podStartE2EDuration="4.24529906s" totalImagesPullingTime="2.959130838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:20:32.244289312 +0000 UTC m=+328.875040507" watchObservedRunningTime="2026-09-11 14:20:32.24529906 +0000 UTC m=+328.876050255"
Sep 11 14:20:34.531219 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:34.531180    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 14:20:34.531604 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:34.531258    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 14:20:35.240118 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:35.240077    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7" event={"ID":"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638","Type":"ContainerStarted","Data":"2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f"}
Sep 11 14:20:35.240319 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:35.240190    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:35.241968 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:35.241943    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-swbz7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 14:20:35.242082 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:35.241989    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7" podUID="f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 14:20:35.274822 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:35.274774    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7" podStartSLOduration=2.767923091 podStartE2EDuration="5.274759803s" totalImagesPullingTime="2.506836712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:20:35.273317234 +0000 UTC m=+331.904068431" watchObservedRunningTime="2026-09-11 14:20:35.274759803 +0000 UTC m=+331.905511000"
Sep 11 14:20:36.244593 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:36.244568    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:41.496105 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.496069    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"]
Sep 11 14:20:41.503077 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.503054    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.532651 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.532621    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"]
Sep 11 14:20:41.563361 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.563335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5d1381d-2842-485b-a936-d68e570da133-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.563490 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.563375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5d1381d-2842-485b-a936-d68e570da133-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.563490 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.563431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd224\" (UniqueName: \"kubernetes.io/projected/b5d1381d-2842-485b-a936-d68e570da133-kube-api-access-sd224\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.563490 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.563475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5d1381d-2842-485b-a936-d68e570da133-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.563646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.563504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5d1381d-2842-485b-a936-d68e570da133-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.563646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.563538    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5d1381d-2842-485b-a936-d68e570da133-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.563646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.563568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5d1381d-2842-485b-a936-d68e570da133-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.664776 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.664738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5d1381d-2842-485b-a936-d68e570da133-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.664894 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.664787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5d1381d-2842-485b-a936-d68e570da133-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.664894 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.664815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd224\" (UniqueName: \"kubernetes.io/projected/b5d1381d-2842-485b-a936-d68e570da133-kube-api-access-sd224\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.664894 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.664848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5d1381d-2842-485b-a936-d68e570da133-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.664894 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.664863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5d1381d-2842-485b-a936-d68e570da133-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.664894 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.664887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5d1381d-2842-485b-a936-d68e570da133-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.665135 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.664906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5d1381d-2842-485b-a936-d68e570da133-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.665686 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.665663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5d1381d-2842-485b-a936-d68e570da133-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.667195 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.667175    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5d1381d-2842-485b-a936-d68e570da133-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.667381 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.667358    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5d1381d-2842-485b-a936-d68e570da133-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.667525 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.667506    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5d1381d-2842-485b-a936-d68e570da133-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.667608 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.667588    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5d1381d-2842-485b-a936-d68e570da133-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.699785 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.699758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd224\" (UniqueName: \"kubernetes.io/projected/b5d1381d-2842-485b-a936-d68e570da133-kube-api-access-sd224\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.702203 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.702177    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5d1381d-2842-485b-a936-d68e570da133-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4fj2p\" (UID: \"b5d1381d-2842-485b-a936-d68e570da133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:41.811606 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:41.811556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:42.121836 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:42.121759    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"]
Sep 11 14:20:42.126815 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:20:42.126783    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d1381d_2842_485b_a936_d68e570da133.slice/crio-a4455a869fd501c505c8ef5b3c3877a1c150d67edc4a42d5852f014946c8a43d WatchSource:0}: Error finding container a4455a869fd501c505c8ef5b3c3877a1c150d67edc4a42d5852f014946c8a43d: Status 404 returned error can't find the container with id a4455a869fd501c505c8ef5b3c3877a1c150d67edc4a42d5852f014946c8a43d
Sep 11 14:20:42.128812 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:42.128783    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 14:20:42.128871 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:42.128844    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 14:20:42.271742 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:42.271697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p" event={"ID":"b5d1381d-2842-485b-a936-d68e570da133","Type":"ContainerStarted","Data":"c16e3063b794718e52163342d7af95b4b2db7a2e1d404d0d593c5c918c06716a"}
Sep 11 14:20:42.271904 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:42.271750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p" event={"ID":"b5d1381d-2842-485b-a936-d68e570da133","Type":"ContainerStarted","Data":"a4455a869fd501c505c8ef5b3c3877a1c150d67edc4a42d5852f014946c8a43d"}
Sep 11 14:20:42.271904 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:42.271773    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:42.315240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:42.315190    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p" podStartSLOduration=1.315174931 podStartE2EDuration="1.315174931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:20:42.312978004 +0000 UTC m=+338.943729201" watchObservedRunningTime="2026-09-11 14:20:42.315174931 +0000 UTC m=+338.945926127"
Sep 11 14:20:43.277577 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:43.277546    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-4fj2p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 14:20:43.278037 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:43.277600    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p" podUID="b5d1381d-2842-485b-a936-d68e570da133" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 14:20:46.276889 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.276860    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4fj2p"
Sep 11 14:20:46.401131 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.401097    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"]
Sep 11 14:20:46.401355 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.401330    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7" podUID="f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" containerName="discovery" containerID="cri-o://2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f" gracePeriod=30
Sep 11 14:20:46.637310 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.637286    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:46.704388 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.704367    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-ca-configmap\") pod \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") "
Sep 11 14:20:46.704502 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.704393    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-cacerts\") pod \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") "
Sep 11 14:20:46.704502 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.704437    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89rps\" (UniqueName: \"kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-kube-api-access-89rps\") pod \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") "
Sep 11 14:20:46.704502 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.704467    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-token\") pod \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") "
Sep 11 14:20:46.704502 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.704482    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-local-certs\") pod \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") "
Sep 11 14:20:46.704694 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.704516    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-dns-cert\") pod \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") "
Sep 11 14:20:46.704694 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.704589    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-kubeconfig\") pod \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\" (UID: \"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638\") "
Sep 11 14:20:46.704798 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.704775    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" (UID: "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:20:46.706794 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.706756    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-cacerts" (OuterVolumeSpecName: "cacerts") pod "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" (UID: "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:20:46.706909 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.706799    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-kube-api-access-89rps" (OuterVolumeSpecName: "kube-api-access-89rps") pod "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" (UID: "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638"). InnerVolumeSpecName "kube-api-access-89rps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:20:46.707023 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.706991    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" (UID: "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:20:46.707124 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.707044    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" (UID: "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:20:46.707124 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.707032    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-local-certs" (OuterVolumeSpecName: "local-certs") pod "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" (UID: "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:20:46.707124 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.707112    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-token" (OuterVolumeSpecName: "istio-token") pod "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" (UID: "f71b1c3b-c6e6-45a9-878c-ed20c9b3b638"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:20:46.805021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.804999    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-dns-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:20:46.805021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.805021    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-kubeconfig\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:20:46.805021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.805030    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-csr-ca-configmap\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:20:46.805229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.805039    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-cacerts\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:20:46.805229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.805048    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89rps\" (UniqueName: \"kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-kube-api-access-89rps\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:20:46.805229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.805056    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-istio-token\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:20:46.805229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:46.805064    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638-local-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:20:47.293659 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:47.293624    2581 generic.go:356] "Generic (PLEG): container finished" podID="f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" containerID="2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f" exitCode=0
Sep 11 14:20:47.294123 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:47.293667    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7" event={"ID":"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638","Type":"ContainerDied","Data":"2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f"}
Sep 11 14:20:47.294123 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:47.293677    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"
Sep 11 14:20:47.294123 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:47.293706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7" event={"ID":"f71b1c3b-c6e6-45a9-878c-ed20c9b3b638","Type":"ContainerDied","Data":"9d9fd28e131daa050c6e56f60f61327d8e31a8266cb9afff3ee588a0a563aa31"}
Sep 11 14:20:47.294123 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:47.293724    2581 scope.go:117] "RemoveContainer" containerID="2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f"
Sep 11 14:20:47.301946 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:47.301930    2581 scope.go:117] "RemoveContainer" containerID="2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f"
Sep 11 14:20:47.302221 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:20:47.302203    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f\": container with ID starting with 2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f not found: ID does not exist" containerID="2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f"
Sep 11 14:20:47.302275 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:47.302232    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f"} err="failed to get container status \"2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f\": rpc error: code = NotFound desc = could not find container \"2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f\": container with ID starting with 2f860ecbb975a405168ceeecc7953da4fbb4094470876d4b4a9780a394e0664f not found: ID does not exist"
Sep 11 14:20:47.384085 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:47.384058    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"]
Sep 11 14:20:47.399011 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:47.398988    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swbz7"]
Sep 11 14:20:47.858098 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:20:47.858067    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" path="/var/lib/kubelet/pods/f71b1c3b-c6e6-45a9-878c-ed20c9b3b638/volumes"
Sep 11 14:21:56.684963 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.684930    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"]
Sep 11 14:21:56.685403 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.685201    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" containerName="discovery"
Sep 11 14:21:56.685403 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.685213    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" containerName="discovery"
Sep 11 14:21:56.685403 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.685278    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f71b1c3b-c6e6-45a9-878c-ed20c9b3b638" containerName="discovery"
Sep 11 14:21:56.688128 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.688112    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:21:56.694706 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.694691    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 14:21:56.695631 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.695616    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 14:21:56.695700 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.695641    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jg7fw\""
Sep 11 14:21:56.714736 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.714711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pnq6\" (UniqueName: \"kubernetes.io/projected/169028f7-45f7-4b0d-acb8-7973e71bec98-kube-api-access-5pnq6\") pod \"limitador-operator-controller-manager-74495c69f8-bmzmx\" (UID: \"169028f7-45f7-4b0d-acb8-7973e71bec98\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:21:56.716694 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.716672    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"]
Sep 11 14:21:56.815479 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.815453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pnq6\" (UniqueName: \"kubernetes.io/projected/169028f7-45f7-4b0d-acb8-7973e71bec98-kube-api-access-5pnq6\") pod \"limitador-operator-controller-manager-74495c69f8-bmzmx\" (UID: \"169028f7-45f7-4b0d-acb8-7973e71bec98\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:21:56.824765 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.824744    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pnq6\" (UniqueName: \"kubernetes.io/projected/169028f7-45f7-4b0d-acb8-7973e71bec98-kube-api-access-5pnq6\") pod \"limitador-operator-controller-manager-74495c69f8-bmzmx\" (UID: \"169028f7-45f7-4b0d-acb8-7973e71bec98\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:21:56.997417 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:56.997387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:21:57.286113 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:57.286089    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"]
Sep 11 14:21:57.288778 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:21:57.288752    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169028f7_45f7_4b0d_acb8_7973e71bec98.slice/crio-bce13b95f8dd69b2d5450efd9cc9c8337dd616f09572866429e98e88ea2a5545 WatchSource:0}: Error finding container bce13b95f8dd69b2d5450efd9cc9c8337dd616f09572866429e98e88ea2a5545: Status 404 returned error can't find the container with id bce13b95f8dd69b2d5450efd9cc9c8337dd616f09572866429e98e88ea2a5545
Sep 11 14:21:57.571213 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:21:57.571118    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx" event={"ID":"169028f7-45f7-4b0d-acb8-7973e71bec98","Type":"ContainerStarted","Data":"bce13b95f8dd69b2d5450efd9cc9c8337dd616f09572866429e98e88ea2a5545"}
Sep 11 14:22:00.586996 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:00.586963    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx" event={"ID":"169028f7-45f7-4b0d-acb8-7973e71bec98","Type":"ContainerStarted","Data":"6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd"}
Sep 11 14:22:00.587387 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:00.587083    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:22:00.612030 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:00.611981    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx" podStartSLOduration=2.271382694 podStartE2EDuration="4.611965588s" totalImagesPullingTime="2.340582894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:22:00.611810806 +0000 UTC m=+417.242562003" watchObservedRunningTime="2026-09-11 14:22:00.611965588 +0000 UTC m=+417.242716788"
Sep 11 14:22:01.690757 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:01.690725    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rf66q"]
Sep 11 14:22:01.693408 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:01.693391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rf66q"
Sep 11 14:22:01.697699 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:01.697680    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dtjq6\""
Sep 11 14:22:01.715096 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:01.711296    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rf66q"]
Sep 11 14:22:01.753842 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:01.753815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkrcd\" (UniqueName: \"kubernetes.io/projected/b723064c-66f4-48a7-aafb-41256d2d598f-kube-api-access-nkrcd\") pod \"authorino-operator-76b478bd78-rf66q\" (UID: \"b723064c-66f4-48a7-aafb-41256d2d598f\") " pod="kuadrant-system/authorino-operator-76b478bd78-rf66q"
Sep 11 14:22:01.854706 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:01.854674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkrcd\" (UniqueName: \"kubernetes.io/projected/b723064c-66f4-48a7-aafb-41256d2d598f-kube-api-access-nkrcd\") pod \"authorino-operator-76b478bd78-rf66q\" (UID: \"b723064c-66f4-48a7-aafb-41256d2d598f\") " pod="kuadrant-system/authorino-operator-76b478bd78-rf66q"
Sep 11 14:22:01.868680 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:01.868654    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkrcd\" (UniqueName: \"kubernetes.io/projected/b723064c-66f4-48a7-aafb-41256d2d598f-kube-api-access-nkrcd\") pod \"authorino-operator-76b478bd78-rf66q\" (UID: \"b723064c-66f4-48a7-aafb-41256d2d598f\") " pod="kuadrant-system/authorino-operator-76b478bd78-rf66q"
Sep 11 14:22:02.002959 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:02.002903    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rf66q"
Sep 11 14:22:02.279945 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:02.279785    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rf66q"]
Sep 11 14:22:02.282760 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:22:02.282733    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb723064c_66f4_48a7_aafb_41256d2d598f.slice/crio-5a12a19ab260426294f64130602b5863e1fec3fcdfc2364d364d5f1da83cb3c3 WatchSource:0}: Error finding container 5a12a19ab260426294f64130602b5863e1fec3fcdfc2364d364d5f1da83cb3c3: Status 404 returned error can't find the container with id 5a12a19ab260426294f64130602b5863e1fec3fcdfc2364d364d5f1da83cb3c3
Sep 11 14:22:02.596966 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:02.596881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rf66q" event={"ID":"b723064c-66f4-48a7-aafb-41256d2d598f","Type":"ContainerStarted","Data":"5a12a19ab260426294f64130602b5863e1fec3fcdfc2364d364d5f1da83cb3c3"}
Sep 11 14:22:04.607199 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:04.607162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rf66q" event={"ID":"b723064c-66f4-48a7-aafb-41256d2d598f","Type":"ContainerStarted","Data":"a9884e5dbff13e6cd5dcf9e9aff18c323f4e3927975412d89102ec3278089c29"}
Sep 11 14:22:04.607586 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:04.607277    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-rf66q"
Sep 11 14:22:04.648352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:04.648308    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-rf66q" podStartSLOduration=2.19483239 podStartE2EDuration="3.648292982s" totalImagesPullingTime="1.453460592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:22:04.6480017 +0000 UTC m=+421.278752896" watchObservedRunningTime="2026-09-11 14:22:04.648292982 +0000 UTC m=+421.279044177"
Sep 11 14:22:11.593457 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:11.593421    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:22:11.862660 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:11.862588    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5565fcd579-66bxx"]
Sep 11 14:22:11.865748 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:11.865728    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:11.870027 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:22:11.869999    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"console-5565fcd579-66bxx\" is forbidden: User \"system:node:ip-10-0-134-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-134-221.ec2.internal' and this object" podUID="66f82e05-62e1-43f6-819a-cbf15fa30613" pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:11.901629 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:11.901608    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5565fcd579-66bxx"]
Sep 11 14:22:11.927508 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:11.927487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66f82e05-62e1-43f6-819a-cbf15fa30613-console-oauth-config\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:11.927607 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:11.927516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-console-config\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:11.927607 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:11.927535    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsncx\" (UniqueName: \"kubernetes.io/projected/66f82e05-62e1-43f6-819a-cbf15fa30613-kube-api-access-nsncx\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:11.927607 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:11.927553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-service-ca\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:11.927732 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:11.927708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-trusted-ca-bundle\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:11.927767 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:11.927754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66f82e05-62e1-43f6-819a-cbf15fa30613-console-serving-cert\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:11.927799 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:11.927782    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-oauth-serving-cert\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.029154 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.029113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-trusted-ca-bundle\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.029352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.029176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66f82e05-62e1-43f6-819a-cbf15fa30613-console-serving-cert\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.029352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.029194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-oauth-serving-cert\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.029352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.029221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66f82e05-62e1-43f6-819a-cbf15fa30613-console-oauth-config\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.029352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.029241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-console-config\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.029352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.029258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsncx\" (UniqueName: \"kubernetes.io/projected/66f82e05-62e1-43f6-819a-cbf15fa30613-kube-api-access-nsncx\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.029352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.029285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-service-ca\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.030047 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.030017    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-oauth-serving-cert\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.030173 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.030033    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-service-ca\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.030231 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.030064    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-console-config\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.030231 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.030080    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f82e05-62e1-43f6-819a-cbf15fa30613-trusted-ca-bundle\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.031873 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.031854    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66f82e05-62e1-43f6-819a-cbf15fa30613-console-oauth-config\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.032018 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.032001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66f82e05-62e1-43f6-819a-cbf15fa30613-console-serving-cert\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.043689 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.043671    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsncx\" (UniqueName: \"kubernetes.io/projected/66f82e05-62e1-43f6-819a-cbf15fa30613-kube-api-access-nsncx\") pod \"console-5565fcd579-66bxx\" (UID: \"66f82e05-62e1-43f6-819a-cbf15fa30613\") " pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.174703 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.174610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:12.473905 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.473875    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5565fcd579-66bxx"]
Sep 11 14:22:12.476990 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:22:12.476964    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f82e05_62e1_43f6_819a_cbf15fa30613.slice/crio-717e31a15d709094a13946cb90b6603f98875176ea68527165a89f8ae5e7fb5a WatchSource:0}: Error finding container 717e31a15d709094a13946cb90b6603f98875176ea68527165a89f8ae5e7fb5a: Status 404 returned error can't find the container with id 717e31a15d709094a13946cb90b6603f98875176ea68527165a89f8ae5e7fb5a
Sep 11 14:22:12.644815 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.644781    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5565fcd579-66bxx" event={"ID":"66f82e05-62e1-43f6-819a-cbf15fa30613","Type":"ContainerStarted","Data":"6557ea96f78d25d672518a1b0ef1067c6fbef5257dfce2b2b394484fed5c369f"}
Sep 11 14:22:12.645180 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.644831    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5565fcd579-66bxx" event={"ID":"66f82e05-62e1-43f6-819a-cbf15fa30613","Type":"ContainerStarted","Data":"717e31a15d709094a13946cb90b6603f98875176ea68527165a89f8ae5e7fb5a"}
Sep 11 14:22:12.683120 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:12.683074    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5565fcd579-66bxx" podStartSLOduration=1.683059351 podStartE2EDuration="1.683059351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:22:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:22:12.681688372 +0000 UTC m=+429.312439578" watchObservedRunningTime="2026-09-11 14:22:12.683059351 +0000 UTC m=+429.313810546"
Sep 11 14:22:15.613639 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:15.613612    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-rf66q"
Sep 11 14:22:22.174779 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:22.174743    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:22.175271 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:22.174811    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:22.179644 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:22.179622    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:22.692095 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:22.692064    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5565fcd579-66bxx"
Sep 11 14:22:22.846597 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:22.846567    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf44cd957-7znsg"]
Sep 11 14:22:23.995891 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:23.995859    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"]
Sep 11 14:22:23.996382 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:23.996032    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx" podUID="169028f7-45f7-4b0d-acb8-7973e71bec98" containerName="manager" containerID="cri-o://6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd" gracePeriod=2
Sep 11 14:22:24.009219 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.009192    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"]
Sep 11 14:22:24.014921 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:22:24.014802    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"169028f7-45f7-4b0d-acb8-7973e71bec98\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-bmzmx\": pods \"limitador-operator-controller-manager-74495c69f8-bmzmx\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:22:24.027233 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.027211    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"]
Sep 11 14:22:24.027498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.027487    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="169028f7-45f7-4b0d-acb8-7973e71bec98" containerName="manager"
Sep 11 14:22:24.027543 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.027499    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="169028f7-45f7-4b0d-acb8-7973e71bec98" containerName="manager"
Sep 11 14:22:24.027577 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.027546    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="169028f7-45f7-4b0d-acb8-7973e71bec98" containerName="manager"
Sep 11 14:22:24.030188 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.030169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"
Sep 11 14:22:24.040783 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.040758    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"]
Sep 11 14:22:24.058444 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:22:24.058410    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bmzmx\" is forbidden: User \"system:node:ip-10-0-134-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-221.ec2.internal' and this object" podUID="169028f7-45f7-4b0d-acb8-7973e71bec98" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:22:24.119989 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.119966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztwmj\" (UniqueName: \"kubernetes.io/projected/aaa069e6-e382-4cbe-a17e-4b41b2a748cb-kube-api-access-ztwmj\") pod \"limitador-operator-controller-manager-74495c69f8-r65pq\" (UID: \"aaa069e6-e382-4cbe-a17e-4b41b2a748cb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"
Sep 11 14:22:24.220797 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.220774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztwmj\" (UniqueName: \"kubernetes.io/projected/aaa069e6-e382-4cbe-a17e-4b41b2a748cb-kube-api-access-ztwmj\") pod \"limitador-operator-controller-manager-74495c69f8-r65pq\" (UID: \"aaa069e6-e382-4cbe-a17e-4b41b2a748cb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"
Sep 11 14:22:24.233667 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.233645    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:22:24.235953 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:22:24.235923    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bmzmx\" is forbidden: User \"system:node:ip-10-0-134-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-221.ec2.internal' and this object" podUID="169028f7-45f7-4b0d-acb8-7973e71bec98" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:22:24.237026 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.237003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztwmj\" (UniqueName: \"kubernetes.io/projected/aaa069e6-e382-4cbe-a17e-4b41b2a748cb-kube-api-access-ztwmj\") pod \"limitador-operator-controller-manager-74495c69f8-r65pq\" (UID: \"aaa069e6-e382-4cbe-a17e-4b41b2a748cb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"
Sep 11 14:22:24.321662 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.321601    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pnq6\" (UniqueName: \"kubernetes.io/projected/169028f7-45f7-4b0d-acb8-7973e71bec98-kube-api-access-5pnq6\") pod \"169028f7-45f7-4b0d-acb8-7973e71bec98\" (UID: \"169028f7-45f7-4b0d-acb8-7973e71bec98\") "
Sep 11 14:22:24.323639 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.323608    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/169028f7-45f7-4b0d-acb8-7973e71bec98-kube-api-access-5pnq6" (OuterVolumeSpecName: "kube-api-access-5pnq6") pod "169028f7-45f7-4b0d-acb8-7973e71bec98" (UID: "169028f7-45f7-4b0d-acb8-7973e71bec98"). InnerVolumeSpecName "kube-api-access-5pnq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:22:24.384763 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.384744    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"
Sep 11 14:22:24.422993 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.422967    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pnq6\" (UniqueName: \"kubernetes.io/projected/169028f7-45f7-4b0d-acb8-7973e71bec98-kube-api-access-5pnq6\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:22:24.672689 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.672609    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"]
Sep 11 14:22:24.676865 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:22:24.676833    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa069e6_e382_4cbe_a17e_4b41b2a748cb.slice/crio-071ed8fcd73a90f5416e1b6140cf6aec4bf7e283004c840a200e1ac19b56da98 WatchSource:0}: Error finding container 071ed8fcd73a90f5416e1b6140cf6aec4bf7e283004c840a200e1ac19b56da98: Status 404 returned error can't find the container with id 071ed8fcd73a90f5416e1b6140cf6aec4bf7e283004c840a200e1ac19b56da98
Sep 11 14:22:24.698734 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.698711    2581 generic.go:356] "Generic (PLEG): container finished" podID="169028f7-45f7-4b0d-acb8-7973e71bec98" containerID="6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd" exitCode=0
Sep 11 14:22:24.698846 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.698751    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:22:24.698846 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.698788    2581 scope.go:117] "RemoveContainer" containerID="6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd"
Sep 11 14:22:24.700188 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.700158    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq" event={"ID":"aaa069e6-e382-4cbe-a17e-4b41b2a748cb","Type":"ContainerStarted","Data":"071ed8fcd73a90f5416e1b6140cf6aec4bf7e283004c840a200e1ac19b56da98"}
Sep 11 14:22:24.701128 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:22:24.701102    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bmzmx\" is forbidden: User \"system:node:ip-10-0-134-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-221.ec2.internal' and this object" podUID="169028f7-45f7-4b0d-acb8-7973e71bec98" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:22:24.712230 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:22:24.712211    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bmzmx\" is forbidden: User \"system:node:ip-10-0-134-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-221.ec2.internal' and this object" podUID="169028f7-45f7-4b0d-acb8-7973e71bec98" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:22:24.712302 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.712265    2581 scope.go:117] "RemoveContainer" containerID="6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd"
Sep 11 14:22:24.712548 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:22:24.712531    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd\": container with ID starting with 6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd not found: ID does not exist" containerID="6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd"
Sep 11 14:22:24.712596 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:24.712557    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd"} err="failed to get container status \"6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd\": rpc error: code = NotFound desc = could not find container \"6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd\": container with ID starting with 6e6ca4620f1def362cab20988d35f5f6753a8712d8684e86cba4031bfca063cd not found: ID does not exist"
Sep 11 14:22:25.641351 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.641321    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"]
Sep 11 14:22:25.644383 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.644357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:22:25.658970 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:22:25.658945    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bmzmx\" is forbidden: User \"system:node:ip-10-0-134-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-221.ec2.internal' and this object" podUID="169028f7-45f7-4b0d-acb8-7973e71bec98" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:22:25.661181 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.661164    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-btkwl\""
Sep 11 14:22:25.684021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.683999    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"]
Sep 11 14:22:25.707283 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.707262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq" event={"ID":"aaa069e6-e382-4cbe-a17e-4b41b2a748cb","Type":"ContainerStarted","Data":"56302a061522e275265ad3004b6a73afd78a4cb45adf0feb3e6af54a5b8d4b96"}
Sep 11 14:22:25.707453 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.707376    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"
Sep 11 14:22:25.732929 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.732907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b42be2e-0b59-43a7-987b-852ec4791c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-c8g6r\" (UID: \"3b42be2e-0b59-43a7-987b-852ec4791c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:22:25.733001 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.732935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq8ww\" (UniqueName: \"kubernetes.io/projected/3b42be2e-0b59-43a7-987b-852ec4791c87-kube-api-access-kq8ww\") pod \"kuadrant-operator-controller-manager-5769f99d9f-c8g6r\" (UID: \"3b42be2e-0b59-43a7-987b-852ec4791c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:22:25.833502 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.833478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b42be2e-0b59-43a7-987b-852ec4791c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-c8g6r\" (UID: \"3b42be2e-0b59-43a7-987b-852ec4791c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:22:25.833589 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.833507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq8ww\" (UniqueName: \"kubernetes.io/projected/3b42be2e-0b59-43a7-987b-852ec4791c87-kube-api-access-kq8ww\") pod \"kuadrant-operator-controller-manager-5769f99d9f-c8g6r\" (UID: \"3b42be2e-0b59-43a7-987b-852ec4791c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:22:25.833912 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.833890    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b42be2e-0b59-43a7-987b-852ec4791c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-c8g6r\" (UID: \"3b42be2e-0b59-43a7-987b-852ec4791c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:22:25.856856 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.856837    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq8ww\" (UniqueName: \"kubernetes.io/projected/3b42be2e-0b59-43a7-987b-852ec4791c87-kube-api-access-kq8ww\") pod \"kuadrant-operator-controller-manager-5769f99d9f-c8g6r\" (UID: \"3b42be2e-0b59-43a7-987b-852ec4791c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:22:25.858787 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.858766    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="169028f7-45f7-4b0d-acb8-7973e71bec98" path="/var/lib/kubelet/pods/169028f7-45f7-4b0d-acb8-7973e71bec98/volumes"
Sep 11 14:22:25.868443 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:22:25.868419    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bmzmx\" is forbidden: User \"system:node:ip-10-0-134-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-221.ec2.internal' and this object" podUID="169028f7-45f7-4b0d-acb8-7973e71bec98" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bmzmx"
Sep 11 14:22:25.871004 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.870967    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq" podStartSLOduration=2.8709540110000002 podStartE2EDuration="2.870954011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:22:25.865025687 +0000 UTC m=+442.495776882" watchObservedRunningTime="2026-09-11 14:22:25.870954011 +0000 UTC m=+442.501705207"
Sep 11 14:22:25.954575 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:25.954556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:22:26.250705 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:26.250614    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"]
Sep 11 14:22:26.253572 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:22:26.253543    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b42be2e_0b59_43a7_987b_852ec4791c87.slice/crio-a0dac37d0c6d3286e1194859e6b96a7492038543028a022dd1b7838b014f4027 WatchSource:0}: Error finding container a0dac37d0c6d3286e1194859e6b96a7492038543028a022dd1b7838b014f4027: Status 404 returned error can't find the container with id a0dac37d0c6d3286e1194859e6b96a7492038543028a022dd1b7838b014f4027
Sep 11 14:22:26.713295 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:26.713257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r" event={"ID":"3b42be2e-0b59-43a7-987b-852ec4791c87","Type":"ContainerStarted","Data":"a0dac37d0c6d3286e1194859e6b96a7492038543028a022dd1b7838b014f4027"}
Sep 11 14:22:32.744818 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:32.744782    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r" event={"ID":"3b42be2e-0b59-43a7-987b-852ec4791c87","Type":"ContainerStarted","Data":"6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2"}
Sep 11 14:22:32.745206 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:32.744921    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:22:32.775628 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:32.775582    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r" podStartSLOduration=1.840404436 podStartE2EDuration="7.775567445s" totalImagesPullingTime="5.935163009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:22:32.773263517 +0000 UTC m=+449.404014712" watchObservedRunningTime="2026-09-11 14:22:32.775567445 +0000 UTC m=+449.406318640"
Sep 11 14:22:36.715658 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:36.715627    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"
Sep 11 14:22:43.752056 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:43.752020    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:22:47.865536 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:47.865483    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bf44cd957-7znsg" podUID="1a315e1b-350b-42df-b8f0-d05dca942456" containerName="console" containerID="cri-o://62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f" gracePeriod=15
Sep 11 14:22:48.109375 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.109347    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:22:48.210057 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.210035    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-service-ca\") pod \"1a315e1b-350b-42df-b8f0-d05dca942456\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") "
Sep 11 14:22:48.210222 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.210070    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-console-config\") pod \"1a315e1b-350b-42df-b8f0-d05dca942456\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") "
Sep 11 14:22:48.210222 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.210092    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-oauth-serving-cert\") pod \"1a315e1b-350b-42df-b8f0-d05dca942456\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") "
Sep 11 14:22:48.210222 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.210122    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-serving-cert\") pod \"1a315e1b-350b-42df-b8f0-d05dca942456\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") "
Sep 11 14:22:48.210222 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.210176    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-oauth-config\") pod \"1a315e1b-350b-42df-b8f0-d05dca942456\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") "
Sep 11 14:22:48.210222 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.210198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-trusted-ca-bundle\") pod \"1a315e1b-350b-42df-b8f0-d05dca942456\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") "
Sep 11 14:22:48.210550 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.210239    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x2vj\" (UniqueName: \"kubernetes.io/projected/1a315e1b-350b-42df-b8f0-d05dca942456-kube-api-access-7x2vj\") pod \"1a315e1b-350b-42df-b8f0-d05dca942456\" (UID: \"1a315e1b-350b-42df-b8f0-d05dca942456\") "
Sep 11 14:22:48.210550 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.210453    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-service-ca" (OuterVolumeSpecName: "service-ca") pod "1a315e1b-350b-42df-b8f0-d05dca942456" (UID: "1a315e1b-350b-42df-b8f0-d05dca942456"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:22:48.210646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.210609    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-console-config" (OuterVolumeSpecName: "console-config") pod "1a315e1b-350b-42df-b8f0-d05dca942456" (UID: "1a315e1b-350b-42df-b8f0-d05dca942456"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:22:48.210646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.210627    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1a315e1b-350b-42df-b8f0-d05dca942456" (UID: "1a315e1b-350b-42df-b8f0-d05dca942456"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:22:48.210791 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.210766    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1a315e1b-350b-42df-b8f0-d05dca942456" (UID: "1a315e1b-350b-42df-b8f0-d05dca942456"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:22:48.212477 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.212453    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1a315e1b-350b-42df-b8f0-d05dca942456" (UID: "1a315e1b-350b-42df-b8f0-d05dca942456"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:22:48.212599 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.212473    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1a315e1b-350b-42df-b8f0-d05dca942456" (UID: "1a315e1b-350b-42df-b8f0-d05dca942456"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:22:48.212657 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.212607    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a315e1b-350b-42df-b8f0-d05dca942456-kube-api-access-7x2vj" (OuterVolumeSpecName: "kube-api-access-7x2vj") pod "1a315e1b-350b-42df-b8f0-d05dca942456" (UID: "1a315e1b-350b-42df-b8f0-d05dca942456"). InnerVolumeSpecName "kube-api-access-7x2vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:22:48.311001 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.310972    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-trusted-ca-bundle\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:22:48.311001 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.310998    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x2vj\" (UniqueName: \"kubernetes.io/projected/1a315e1b-350b-42df-b8f0-d05dca942456-kube-api-access-7x2vj\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:22:48.311176 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.311011    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:22:48.311176 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.311024    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-console-config\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:22:48.311176 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.311035    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a315e1b-350b-42df-b8f0-d05dca942456-oauth-serving-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:22:48.311176 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.311047    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-serving-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:22:48.311176 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.311060    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a315e1b-350b-42df-b8f0-d05dca942456-console-oauth-config\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:22:48.815783 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.815748    2581 generic.go:356] "Generic (PLEG): container finished" podID="1a315e1b-350b-42df-b8f0-d05dca942456" containerID="62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f" exitCode=0
Sep 11 14:22:48.815979 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.815801    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf44cd957-7znsg"
Sep 11 14:22:48.815979 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.815830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf44cd957-7znsg" event={"ID":"1a315e1b-350b-42df-b8f0-d05dca942456","Type":"ContainerDied","Data":"62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f"}
Sep 11 14:22:48.815979 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.815905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf44cd957-7znsg" event={"ID":"1a315e1b-350b-42df-b8f0-d05dca942456","Type":"ContainerDied","Data":"898c2bf0e1786f0ce247c1b7e2d63ff56db856e0f826c0770ec64a58cc8b660c"}
Sep 11 14:22:48.815979 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.815927    2581 scope.go:117] "RemoveContainer" containerID="62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f"
Sep 11 14:22:48.824573 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.824557    2581 scope.go:117] "RemoveContainer" containerID="62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f"
Sep 11 14:22:48.824839 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:22:48.824823    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f\": container with ID starting with 62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f not found: ID does not exist" containerID="62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f"
Sep 11 14:22:48.824893 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.824845    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f"} err="failed to get container status \"62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f\": rpc error: code = NotFound desc = could not find container \"62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f\": container with ID starting with 62b5ada6d6191bb66726e7e4ebe18008acd06ec1b5a62be4c29c0e24d850d18f not found: ID does not exist"
Sep 11 14:22:48.847128 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.847105    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf44cd957-7znsg"]
Sep 11 14:22:48.851289 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:48.851267    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bf44cd957-7znsg"]
Sep 11 14:22:49.857929 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:22:49.857899    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a315e1b-350b-42df-b8f0-d05dca942456" path="/var/lib/kubelet/pods/1a315e1b-350b-42df-b8f0-d05dca942456/volumes"
Sep 11 14:23:39.566788 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.566753    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58767bdf65-vx59t"]
Sep 11 14:23:39.567299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.567118    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a315e1b-350b-42df-b8f0-d05dca942456" containerName="console"
Sep 11 14:23:39.567299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.567133    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a315e1b-350b-42df-b8f0-d05dca942456" containerName="console"
Sep 11 14:23:39.567299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.567210    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a315e1b-350b-42df-b8f0-d05dca942456" containerName="console"
Sep 11 14:23:39.568924 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.568908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:39.574972 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.574946    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 14:23:39.575114 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.575056    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 14:23:39.578011 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.577987    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pgmvd\""
Sep 11 14:23:39.578104 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.578086    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 14:23:39.597061 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.597037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58767bdf65-vx59t"]
Sep 11 14:23:39.698509 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.698484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-webhook-cert\") pod \"maas-controller-58767bdf65-vx59t\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") " pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:39.698651 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.698515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76xzp\" (UniqueName: \"kubernetes.io/projected/6dea580b-34ee-409b-9825-f913cf29193e-kube-api-access-76xzp\") pod \"maas-controller-58767bdf65-vx59t\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") " pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:39.698651 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.698537    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-metrics-certs\") pod \"maas-controller-58767bdf65-vx59t\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") " pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:39.799063 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.799030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-webhook-cert\") pod \"maas-controller-58767bdf65-vx59t\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") " pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:39.799212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.799066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76xzp\" (UniqueName: \"kubernetes.io/projected/6dea580b-34ee-409b-9825-f913cf29193e-kube-api-access-76xzp\") pod \"maas-controller-58767bdf65-vx59t\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") " pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:39.799212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.799086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-metrics-certs\") pod \"maas-controller-58767bdf65-vx59t\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") " pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:39.801774 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.801748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-webhook-cert\") pod \"maas-controller-58767bdf65-vx59t\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") " pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:39.801880 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.801776    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-metrics-certs\") pod \"maas-controller-58767bdf65-vx59t\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") " pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:39.826620 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.826564    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76xzp\" (UniqueName: \"kubernetes.io/projected/6dea580b-34ee-409b-9825-f913cf29193e-kube-api-access-76xzp\") pod \"maas-controller-58767bdf65-vx59t\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") " pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:39.879186 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:39.879156    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:40.165402 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:40.165378    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58767bdf65-vx59t"]
Sep 11 14:23:40.167780 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:23:40.167754    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dea580b_34ee_409b_9825_f913cf29193e.slice/crio-3d836e9cce8dc844013ded5eb7037ec346406859105991c5e39c54f3b5f41964 WatchSource:0}: Error finding container 3d836e9cce8dc844013ded5eb7037ec346406859105991c5e39c54f3b5f41964: Status 404 returned error can't find the container with id 3d836e9cce8dc844013ded5eb7037ec346406859105991c5e39c54f3b5f41964
Sep 11 14:23:41.037735 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:41.037677    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58767bdf65-vx59t" event={"ID":"6dea580b-34ee-409b-9825-f913cf29193e","Type":"ContainerStarted","Data":"3d836e9cce8dc844013ded5eb7037ec346406859105991c5e39c54f3b5f41964"}
Sep 11 14:23:43.047619 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:43.047586    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58767bdf65-vx59t" event={"ID":"6dea580b-34ee-409b-9825-f913cf29193e","Type":"ContainerStarted","Data":"4afa6542c882b798ae04a5709fa89cf700867c352defa2b133d07c1c443e34c5"}
Sep 11 14:23:43.047979 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:43.047710    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:43.071789 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:43.071742    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58767bdf65-vx59t" podStartSLOduration=1.7649271149999999 podStartE2EDuration="4.071726825s" totalImagesPullingTime="2.30679971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:23:43.070173115 +0000 UTC m=+519.700924312" watchObservedRunningTime="2026-09-11 14:23:43.071726825 +0000 UTC m=+519.702478021"
Sep 11 14:23:53.966094 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:53.966064    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58767bdf65-vx59t"]
Sep 11 14:23:53.966636 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:53.966299    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58767bdf65-vx59t" podUID="6dea580b-34ee-409b-9825-f913cf29193e" containerName="manager" containerID="cri-o://4afa6542c882b798ae04a5709fa89cf700867c352defa2b133d07c1c443e34c5" gracePeriod=30
Sep 11 14:23:53.968015 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:53.967988    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:54.095212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.095184    2581 generic.go:356] "Generic (PLEG): container finished" podID="6dea580b-34ee-409b-9825-f913cf29193e" containerID="4afa6542c882b798ae04a5709fa89cf700867c352defa2b133d07c1c443e34c5" exitCode=0
Sep 11 14:23:54.095319 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.095229    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58767bdf65-vx59t" event={"ID":"6dea580b-34ee-409b-9825-f913cf29193e","Type":"ContainerDied","Data":"4afa6542c882b798ae04a5709fa89cf700867c352defa2b133d07c1c443e34c5"}
Sep 11 14:23:54.212762 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.212735    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:54.308857 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.308798    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76xzp\" (UniqueName: \"kubernetes.io/projected/6dea580b-34ee-409b-9825-f913cf29193e-kube-api-access-76xzp\") pod \"6dea580b-34ee-409b-9825-f913cf29193e\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") "
Sep 11 14:23:54.308857 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.308848    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-webhook-cert\") pod \"6dea580b-34ee-409b-9825-f913cf29193e\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") "
Sep 11 14:23:54.309011 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.308868    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-metrics-certs\") pod \"6dea580b-34ee-409b-9825-f913cf29193e\" (UID: \"6dea580b-34ee-409b-9825-f913cf29193e\") "
Sep 11 14:23:54.311014 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.310983    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6dea580b-34ee-409b-9825-f913cf29193e" (UID: "6dea580b-34ee-409b-9825-f913cf29193e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:23:54.311014 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.311005    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6dea580b-34ee-409b-9825-f913cf29193e" (UID: "6dea580b-34ee-409b-9825-f913cf29193e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:23:54.311257 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.310994    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dea580b-34ee-409b-9825-f913cf29193e-kube-api-access-76xzp" (OuterVolumeSpecName: "kube-api-access-76xzp") pod "6dea580b-34ee-409b-9825-f913cf29193e" (UID: "6dea580b-34ee-409b-9825-f913cf29193e"). InnerVolumeSpecName "kube-api-access-76xzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:23:54.410020 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.410000    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-webhook-cert\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:23:54.410020 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.410019    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dea580b-34ee-409b-9825-f913cf29193e-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:23:54.410171 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:54.410028    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76xzp\" (UniqueName: \"kubernetes.io/projected/6dea580b-34ee-409b-9825-f913cf29193e-kube-api-access-76xzp\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:23:55.100436 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:55.100399    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58767bdf65-vx59t" event={"ID":"6dea580b-34ee-409b-9825-f913cf29193e","Type":"ContainerDied","Data":"3d836e9cce8dc844013ded5eb7037ec346406859105991c5e39c54f3b5f41964"}
Sep 11 14:23:55.100436 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:55.100423    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58767bdf65-vx59t"
Sep 11 14:23:55.100953 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:55.100465    2581 scope.go:117] "RemoveContainer" containerID="4afa6542c882b798ae04a5709fa89cf700867c352defa2b133d07c1c443e34c5"
Sep 11 14:23:55.125438 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:55.125407    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58767bdf65-vx59t"]
Sep 11 14:23:55.127968 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:55.127947    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58767bdf65-vx59t"]
Sep 11 14:23:55.858805 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:23:55.858776    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dea580b-34ee-409b-9825-f913cf29193e" path="/var/lib/kubelet/pods/6dea580b-34ee-409b-9825-f913cf29193e/volumes"
Sep 11 14:24:18.061723 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.061688    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"]
Sep 11 14:24:18.062116 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.061976    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dea580b-34ee-409b-9825-f913cf29193e" containerName="manager"
Sep 11 14:24:18.062116 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.061987    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dea580b-34ee-409b-9825-f913cf29193e" containerName="manager"
Sep 11 14:24:18.062116 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.062036    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dea580b-34ee-409b-9825-f913cf29193e" containerName="manager"
Sep 11 14:24:18.067943 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.067925    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.072300 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.072279    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:24:18.072618 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.072601    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 14:24:18.074563 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.074543    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 14:24:18.075386 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.075371    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 14:24:18.086773 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.086754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"]
Sep 11 14:24:18.092539 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.092522    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-maas-api-tls\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.092643 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.092546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-metrics-certs\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.092643 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.092573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c6b4ae2-2f09-459b-93c1-724196b1604c-openshift-service-ca\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.092643 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.092593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5kp5\" (UniqueName: \"kubernetes.io/projected/0c6b4ae2-2f09-459b-93c1-724196b1604c-kube-api-access-m5kp5\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.194052 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.194028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-metrics-certs\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.194212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.194077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c6b4ae2-2f09-459b-93c1-724196b1604c-openshift-service-ca\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.194212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.194105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5kp5\" (UniqueName: \"kubernetes.io/projected/0c6b4ae2-2f09-459b-93c1-724196b1604c-kube-api-access-m5kp5\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.194212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.194202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-maas-api-tls\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.194824 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.194798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c6b4ae2-2f09-459b-93c1-724196b1604c-openshift-service-ca\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.196501 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.196478    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-maas-api-tls\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.196693 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.196675    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-metrics-certs\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.204750 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.204731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5kp5\" (UniqueName: \"kubernetes.io/projected/0c6b4ae2-2f09-459b-93c1-724196b1604c-kube-api-access-m5kp5\") pod \"maas-api-6c98db545c-7zl8f\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") " pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.377333 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.377270    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:18.670586 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:18.670517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"]
Sep 11 14:24:18.686443 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:24:18.686406    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6b4ae2_2f09_459b_93c1_724196b1604c.slice/crio-c2ed6b88d2bf89c855d4e211ba19dc06b9be028432a844a787d087457bcf5ce4 WatchSource:0}: Error finding container c2ed6b88d2bf89c855d4e211ba19dc06b9be028432a844a787d087457bcf5ce4: Status 404 returned error can't find the container with id c2ed6b88d2bf89c855d4e211ba19dc06b9be028432a844a787d087457bcf5ce4
Sep 11 14:24:19.202293 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:19.202254    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f" event={"ID":"0c6b4ae2-2f09-459b-93c1-724196b1604c","Type":"ContainerStarted","Data":"c2ed6b88d2bf89c855d4e211ba19dc06b9be028432a844a787d087457bcf5ce4"}
Sep 11 14:24:21.213497 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:21.213465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f" event={"ID":"0c6b4ae2-2f09-459b-93c1-724196b1604c","Type":"ContainerStarted","Data":"9061daaab4f14a92f3a3b1e2822935469bf3ec8e7ac9e754b4d3e8b458949020"}
Sep 11 14:24:21.213857 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:21.213603    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:21.237260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:21.237211    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f" podStartSLOduration=1.616536374 podStartE2EDuration="3.237196906s" totalImagesPullingTime="1.620660532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:24:21.234991124 +0000 UTC m=+557.865742321" watchObservedRunningTime="2026-09-11 14:24:21.237196906 +0000 UTC m=+557.867948103"
Sep 11 14:24:27.223695 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:27.223663    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:24:57.115127 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.115091    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"]
Sep 11 14:24:57.119394 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.119377    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.135096 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.135076    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 14:24:57.135956 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.135938    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jg47g\""
Sep 11 14:24:57.136053 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.135957    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 14:24:57.136111 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.136090    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 14:24:57.189040 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.189013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"]
Sep 11 14:24:57.194925 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.194890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.194994 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.194950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.195050 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.195032    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flcxc\" (UniqueName: \"kubernetes.io/projected/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-kube-api-access-flcxc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.195086 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.195073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.195119 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.195105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.195185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.195168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.295902 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.295870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.296042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.295909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flcxc\" (UniqueName: \"kubernetes.io/projected/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-kube-api-access-flcxc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.296042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.295938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.296042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.295969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.296042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.295992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.296042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.296039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.296415 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.296396    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.296515 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.296498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.296576 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.296540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.298356 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.298339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.298615 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.298598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.331853 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.331828    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flcxc\" (UniqueName: \"kubernetes.io/projected/8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7-kube-api-access-flcxc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wcd7c\" (UID: \"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.429411 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.429332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:24:57.705268 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:57.705234    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"]
Sep 11 14:24:57.707124 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:24:57.707099    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9a02cf_11d4_41b8_81a8_2aeeb7ec5ac7.slice/crio-ff24e8322795ba31176ad4f7b39205a12787fcfbfff1016a77bbc19a828c5f28 WatchSource:0}: Error finding container ff24e8322795ba31176ad4f7b39205a12787fcfbfff1016a77bbc19a828c5f28: Status 404 returned error can't find the container with id ff24e8322795ba31176ad4f7b39205a12787fcfbfff1016a77bbc19a828c5f28
Sep 11 14:24:58.379107 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:58.379068    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c" event={"ID":"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7","Type":"ContainerStarted","Data":"ff24e8322795ba31176ad4f7b39205a12787fcfbfff1016a77bbc19a828c5f28"}
Sep 11 14:24:59.385647 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:59.385610    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c" event={"ID":"8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7","Type":"ContainerStarted","Data":"be59aeb9a90451b75f1709970f27d4e60fe552ff1c737908274e9eedeaeebb59"}
Sep 11 14:24:59.412441 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:24:59.412397    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c" podStartSLOduration=1.4220064909999999 podStartE2EDuration="2.412380377s" totalImagesPullingTime="990.373886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:24:59.409808912 +0000 UTC m=+596.040560107" watchObservedRunningTime="2026-09-11 14:24:59.412380377 +0000 UTC m=+596.043131572"
Sep 11 14:25:03.808268 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:03.808234    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:25:03.808659 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:03.808517    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:25:07.429866 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:07.429835    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:25:07.432286 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:07.429917    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:25:07.442185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:07.442161    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:25:08.437179 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:08.437125    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wcd7c"
Sep 11 14:25:11.884801 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:11.884771    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"]
Sep 11 14:25:11.889674 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:11.889646    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:11.894022 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:11.893985    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 11 14:25:11.902561 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:11.902539    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"]
Sep 11 14:25:12.014957 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.014924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/708bd1b0-161d-4fca-868e-859f5f296850-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.015135 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.014980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.015135 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.015015    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5md7j\" (UniqueName: \"kubernetes.io/projected/708bd1b0-161d-4fca-868e-859f5f296850-kube-api-access-5md7j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.015135 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.015084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.015135 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.015117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.015364 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.015211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.115779 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.115746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/708bd1b0-161d-4fca-868e-859f5f296850-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.115951 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.115789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.115951 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.115813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5md7j\" (UniqueName: \"kubernetes.io/projected/708bd1b0-161d-4fca-868e-859f5f296850-kube-api-access-5md7j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.115951 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.115933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.116114 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.115978    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.116114 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.116037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.116309 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.116285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.116362 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.116313    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.116362 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.116326    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.118180 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.118156    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/708bd1b0-161d-4fca-868e-859f5f296850-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.118374 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.118355    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/708bd1b0-161d-4fca-868e-859f5f296850-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.129244 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.129213    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5md7j\" (UniqueName: \"kubernetes.io/projected/708bd1b0-161d-4fca-868e-859f5f296850-kube-api-access-5md7j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z955t\" (UID: \"708bd1b0-161d-4fca-868e-859f5f296850\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.200534 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.200503    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:12.490456 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.490432    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"]
Sep 11 14:25:12.492845 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:25:12.492816    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708bd1b0_161d_4fca_868e_859f5f296850.slice/crio-f69ca72a3beafac3186a0e87cc61af3016dc128f8a2b72dd9b718d9c93f66368 WatchSource:0}: Error finding container f69ca72a3beafac3186a0e87cc61af3016dc128f8a2b72dd9b718d9c93f66368: Status 404 returned error can't find the container with id f69ca72a3beafac3186a0e87cc61af3016dc128f8a2b72dd9b718d9c93f66368
Sep 11 14:25:12.494206 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:12.494188    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:25:13.450411 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:13.450372    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t" event={"ID":"708bd1b0-161d-4fca-868e-859f5f296850","Type":"ContainerStarted","Data":"beb18e1af11fc5c082acf2b5c76a7f42a07bc8f2d39b78b73101357523e3d162"}
Sep 11 14:25:13.450807 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:13.450449    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t" event={"ID":"708bd1b0-161d-4fca-868e-859f5f296850","Type":"ContainerStarted","Data":"f69ca72a3beafac3186a0e87cc61af3016dc128f8a2b72dd9b718d9c93f66368"}
Sep 11 14:25:13.484829 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:13.484781    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t" podStartSLOduration=2.237760148 podStartE2EDuration="2.484765808s" totalImagesPullingTime="247.00566ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:25:13.484415886 +0000 UTC m=+610.115167084" watchObservedRunningTime="2026-09-11 14:25:13.484765808 +0000 UTC m=+610.115517003"
Sep 11 14:25:22.200724 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:22.200687    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:22.201115 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:22.200756    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:22.215773 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:22.215745    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:25:22.502603 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:25:22.502532    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z955t"
Sep 11 14:26:52.895997 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:52.895961    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7785-49f226"]
Sep 11 14:26:52.899065 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:52.899046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-49f226"
Sep 11 14:26:52.902065 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:52.902046    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-998c2\""
Sep 11 14:26:52.905480 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:52.905438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7785-49f226"]
Sep 11 14:26:53.015377 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:53.015343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdvbc\" (UniqueName: \"kubernetes.io/projected/c2ed74cc-ad04-4491-9121-52ed1eb6753a-kube-api-access-bdvbc\") pod \"test-curl-7785-49f226\" (UID: \"c2ed74cc-ad04-4491-9121-52ed1eb6753a\") " pod="opendatahub/test-curl-7785-49f226"
Sep 11 14:26:53.116704 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:53.116663    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvbc\" (UniqueName: \"kubernetes.io/projected/c2ed74cc-ad04-4491-9121-52ed1eb6753a-kube-api-access-bdvbc\") pod \"test-curl-7785-49f226\" (UID: \"c2ed74cc-ad04-4491-9121-52ed1eb6753a\") " pod="opendatahub/test-curl-7785-49f226"
Sep 11 14:26:53.129543 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:53.129502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdvbc\" (UniqueName: \"kubernetes.io/projected/c2ed74cc-ad04-4491-9121-52ed1eb6753a-kube-api-access-bdvbc\") pod \"test-curl-7785-49f226\" (UID: \"c2ed74cc-ad04-4491-9121-52ed1eb6753a\") " pod="opendatahub/test-curl-7785-49f226"
Sep 11 14:26:53.209404 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:53.209379    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-49f226"
Sep 11 14:26:53.485540 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:53.485518    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7785-49f226"]
Sep 11 14:26:53.488087 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:26:53.488055    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2ed74cc_ad04_4491_9121_52ed1eb6753a.slice/crio-a206445b6a9a85916eed9d6c0cc91d50a4def5e89c2e597f6e588ad9f4cbd4cc WatchSource:0}: Error finding container a206445b6a9a85916eed9d6c0cc91d50a4def5e89c2e597f6e588ad9f4cbd4cc: Status 404 returned error can't find the container with id a206445b6a9a85916eed9d6c0cc91d50a4def5e89c2e597f6e588ad9f4cbd4cc
Sep 11 14:26:53.888073 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:53.887994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7785-49f226" event={"ID":"c2ed74cc-ad04-4491-9121-52ed1eb6753a","Type":"ContainerStarted","Data":"a206445b6a9a85916eed9d6c0cc91d50a4def5e89c2e597f6e588ad9f4cbd4cc"}
Sep 11 14:26:55.072970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.072935    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"]
Sep 11 14:26:55.087520 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.087491    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.090249 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.090222    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a39864-serving-cert\""
Sep 11 14:26:55.090511 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.090491    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tvhzt\""
Sep 11 14:26:55.090789 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.090771    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"]
Sep 11 14:26:55.136163 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.136104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-maas-api-tls\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.136349 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.136193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5298e935-0b0e-4678-ac18-47e5d7c38376-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.136349 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.136224    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq9nc\" (UniqueName: \"kubernetes.io/projected/5298e935-0b0e-4678-ac18-47e5d7c38376-kube-api-access-cq9nc\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.136349 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.136276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-metrics-certs\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.237114 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.237076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-maas-api-tls\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.237311 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.237134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5298e935-0b0e-4678-ac18-47e5d7c38376-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.237311 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:26:55.237284    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-serving-cert: secret "maas-api-e2e-inf-a-a39864-serving-cert" not found
Sep 11 14:26:55.237444 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.237304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq9nc\" (UniqueName: \"kubernetes.io/projected/5298e935-0b0e-4678-ac18-47e5d7c38376-kube-api-access-cq9nc\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.237444 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:26:55.237374    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-maas-api-tls podName:5298e935-0b0e-4678-ac18-47e5d7c38376 nodeName:}" failed. No retries permitted until 2026-09-11 14:26:55.737349604 +0000 UTC m=+712.368100793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-maas-api-tls") pod "maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2" (UID: "5298e935-0b0e-4678-ac18-47e5d7c38376") : secret "maas-api-e2e-inf-a-a39864-serving-cert" not found
Sep 11 14:26:55.237444 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.237396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-metrics-certs\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.238080 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.238053    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5298e935-0b0e-4678-ac18-47e5d7c38376-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.240404 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.240382    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-metrics-certs\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.248669 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.248644    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq9nc\" (UniqueName: \"kubernetes.io/projected/5298e935-0b0e-4678-ac18-47e5d7c38376-kube-api-access-cq9nc\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.742900 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.742869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-maas-api-tls\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.745328 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.745297    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-maas-api-tls\") pod \"maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:55.899336 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.899265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7785-49f226" event={"ID":"c2ed74cc-ad04-4491-9121-52ed1eb6753a","Type":"ContainerStarted","Data":"1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13"}
Sep 11 14:26:55.920202 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:55.920134    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7785-49f226" podStartSLOduration=1.8866009 podStartE2EDuration="3.920119709s" totalImagesPullingTime="2.033518809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:55.919964558 +0000 UTC m=+712.550715755" watchObservedRunningTime="2026-09-11 14:26:55.920119709 +0000 UTC m=+712.550870904"
Sep 11 14:26:56.001112 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:56.001081    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:56.273238 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:56.273208    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"]
Sep 11 14:26:56.275093 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:26:56.275058    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5298e935_0b0e_4678_ac18_47e5d7c38376.slice/crio-facfd4f2a37e49c1b93c43db2a40ae82d07803576b09ee99ed3d7ae5c1238a95 WatchSource:0}: Error finding container facfd4f2a37e49c1b93c43db2a40ae82d07803576b09ee99ed3d7ae5c1238a95: Status 404 returned error can't find the container with id facfd4f2a37e49c1b93c43db2a40ae82d07803576b09ee99ed3d7ae5c1238a95
Sep 11 14:26:56.559158 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:56.559063    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7785-49f226"]
Sep 11 14:26:56.563703 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:56.563607    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7785-49f226"]
Sep 11 14:26:56.906455 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:56.906427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2" event={"ID":"5298e935-0b0e-4678-ac18-47e5d7c38376","Type":"ContainerStarted","Data":"f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8"}
Sep 11 14:26:56.906574 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:56.906512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2" event={"ID":"5298e935-0b0e-4678-ac18-47e5d7c38376","Type":"ContainerStarted","Data":"facfd4f2a37e49c1b93c43db2a40ae82d07803576b09ee99ed3d7ae5c1238a95"}
Sep 11 14:26:56.906702 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:26:56.906674    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7785-49f226" container="test-curl-7785-49f226"
Sep 11 14:26:56.906795 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:56.906757    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:26:56.932426 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:56.932381    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2" podStartSLOduration=1.384583742 podStartE2EDuration="1.932367735s" totalImagesPullingTime="547.783993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:56.929980633 +0000 UTC m=+713.560731828" watchObservedRunningTime="2026-09-11 14:26:56.932367735 +0000 UTC m=+713.563118931"
Sep 11 14:26:57.912119 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:26:57.912083    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7785-49f226" podUID="c2ed74cc-ad04-4491-9121-52ed1eb6753a" containerName="test-curl-7785-49f226" containerID="cri-o://1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13" gracePeriod=2
Sep 11 14:27:00.072747 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:00.072719    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-49f226"
Sep 11 14:27:00.183190 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:00.183105    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdvbc\" (UniqueName: \"kubernetes.io/projected/c2ed74cc-ad04-4491-9121-52ed1eb6753a-kube-api-access-bdvbc\") pod \"c2ed74cc-ad04-4491-9121-52ed1eb6753a\" (UID: \"c2ed74cc-ad04-4491-9121-52ed1eb6753a\") "
Sep 11 14:27:00.185505 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:00.185474    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2ed74cc-ad04-4491-9121-52ed1eb6753a-kube-api-access-bdvbc" (OuterVolumeSpecName: "kube-api-access-bdvbc") pod "c2ed74cc-ad04-4491-9121-52ed1eb6753a" (UID: "c2ed74cc-ad04-4491-9121-52ed1eb6753a"). InnerVolumeSpecName "kube-api-access-bdvbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:27:00.283806 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:00.283776    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdvbc\" (UniqueName: \"kubernetes.io/projected/c2ed74cc-ad04-4491-9121-52ed1eb6753a-kube-api-access-bdvbc\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:27:00.927231 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:00.927196    2581 generic.go:356] "Generic (PLEG): container finished" podID="c2ed74cc-ad04-4491-9121-52ed1eb6753a" containerID="1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13" exitCode=137
Sep 11 14:27:00.927381 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:00.927237    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-49f226"
Sep 11 14:27:00.927381 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:00.927255    2581 scope.go:117] "RemoveContainer" containerID="1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13"
Sep 11 14:27:00.936549 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:00.936530    2581 scope.go:117] "RemoveContainer" containerID="1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13"
Sep 11 14:27:00.936828 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:27:00.936810    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13\": container with ID starting with 1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13 not found: ID does not exist" containerID="1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13"
Sep 11 14:27:00.936892 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:00.936837    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13"} err="failed to get container status \"1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13\": rpc error: code = NotFound desc = could not find container \"1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13\": container with ID starting with 1b2a2b052d7534187fbc20191ae74f129e4227393d5fbb48271b3d0c6edd1b13 not found: ID does not exist"
Sep 11 14:27:00.937738 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:27:00.937715    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-49f226\" is forbidden: User \"system:node:ip-10-0-134-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-221.ec2.internal' and this object" podUID="c2ed74cc-ad04-4491-9121-52ed1eb6753a" pod="opendatahub/test-curl-7785-49f226"
Sep 11 14:27:01.858822 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:01.858790    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2ed74cc-ad04-4491-9121-52ed1eb6753a" path="/var/lib/kubelet/pods/c2ed74cc-ad04-4491-9121-52ed1eb6753a/volumes"
Sep 11 14:27:02.918187 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:02.918159    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:27:04.401284 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.401251    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"]
Sep 11 14:27:04.401641 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.401557    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2ed74cc-ad04-4491-9121-52ed1eb6753a" containerName="test-curl-7785-49f226"
Sep 11 14:27:04.401641 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.401568    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2ed74cc-ad04-4491-9121-52ed1eb6753a" containerName="test-curl-7785-49f226"
Sep 11 14:27:04.401641 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.401629    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2ed74cc-ad04-4491-9121-52ed1eb6753a" containerName="test-curl-7785-49f226"
Sep 11 14:27:04.406072 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.406051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:04.408793 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.408770    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-b4a233-serving-cert\""
Sep 11 14:27:04.423478 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.423455    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"]
Sep 11 14:27:04.519919 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.519885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-metrics-certs\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:04.519919 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.519923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-maas-api-tls\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:04.520112 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.519975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68pxp\" (UniqueName: \"kubernetes.io/projected/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-kube-api-access-68pxp\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:04.520112 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.520027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-openshift-service-ca\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:04.621305 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.621273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-metrics-certs\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:04.621305 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.621316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-maas-api-tls\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:04.621527 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.621356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68pxp\" (UniqueName: \"kubernetes.io/projected/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-kube-api-access-68pxp\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:04.621527 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.621375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-openshift-service-ca\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:04.621527 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:27:04.621475    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-serving-cert: secret "maas-api-e2e-autores-b4a233-serving-cert" not found
Sep 11 14:27:04.621673 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:27:04.621562    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-maas-api-tls podName:9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af nodeName:}" failed. No retries permitted until 2026-09-11 14:27:05.121539273 +0000 UTC m=+721.752290464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-maas-api-tls") pod "maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44" (UID: "9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af") : secret "maas-api-e2e-autores-b4a233-serving-cert" not found
Sep 11 14:27:04.622084 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.622066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-openshift-service-ca\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:04.623833 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.623806    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-metrics-certs\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:04.633152 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:04.633111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68pxp\" (UniqueName: \"kubernetes.io/projected/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-kube-api-access-68pxp\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:05.124862 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.124828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-maas-api-tls\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:05.127159 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.127104    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-maas-api-tls\") pod \"maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:05.318197 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.318157    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:05.628056 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.628028    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"]
Sep 11 14:27:05.630206 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:27:05.630179    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb4ae4a_c9c2_4ed9_8fe0_9e1ffec661af.slice/crio-38029721d062fbf349072dc87743a39542202b5d39516a30517eb384cd4371a8 WatchSource:0}: Error finding container 38029721d062fbf349072dc87743a39542202b5d39516a30517eb384cd4371a8: Status 404 returned error can't find the container with id 38029721d062fbf349072dc87743a39542202b5d39516a30517eb384cd4371a8
Sep 11 14:27:05.677445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.677420    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"]
Sep 11 14:27:05.681603 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.681588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.685407 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.685388    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-43ca2273-serving-cert\""
Sep 11 14:27:05.711297 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.711274    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"]
Sep 11 14:27:05.831153 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.831117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5dadae0-d9db-458a-87d5-35ef6f4d1796-openshift-service-ca\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.831307 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.831181    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tktj\" (UniqueName: \"kubernetes.io/projected/a5dadae0-d9db-458a-87d5-35ef6f4d1796-kube-api-access-5tktj\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.831307 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.831222    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-maas-api-tls\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.831307 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.831245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-metrics-certs\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.932357 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.932272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-maas-api-tls\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.932357 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.932314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-metrics-certs\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.932584 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.932412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5dadae0-d9db-458a-87d5-35ef6f4d1796-openshift-service-ca\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.932584 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.932458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tktj\" (UniqueName: \"kubernetes.io/projected/a5dadae0-d9db-458a-87d5-35ef6f4d1796-kube-api-access-5tktj\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.933104 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.933078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5dadae0-d9db-458a-87d5-35ef6f4d1796-openshift-service-ca\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.934827 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.934807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-metrics-certs\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.934976 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.934953    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-maas-api-tls\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.945153 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.945119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tktj\" (UniqueName: \"kubernetes.io/projected/a5dadae0-d9db-458a-87d5-35ef6f4d1796-kube-api-access-5tktj\") pod \"maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:05.954713 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.954687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44" event={"ID":"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af","Type":"ContainerStarted","Data":"38029721d062fbf349072dc87743a39542202b5d39516a30517eb384cd4371a8"}
Sep 11 14:27:05.991536 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:05.991517    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:06.293928 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:27:06.293899    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5dadae0_d9db_458a_87d5_35ef6f4d1796.slice/crio-9daf754c472ffaf666b012cf6346c01431ca6f0c2dc8f4447356ab86616f0cb9 WatchSource:0}: Error finding container 9daf754c472ffaf666b012cf6346c01431ca6f0c2dc8f4447356ab86616f0cb9: Status 404 returned error can't find the container with id 9daf754c472ffaf666b012cf6346c01431ca6f0c2dc8f4447356ab86616f0cb9
Sep 11 14:27:06.303463 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:06.303438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"]
Sep 11 14:27:06.961189 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:06.961134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv" event={"ID":"a5dadae0-d9db-458a-87d5-35ef6f4d1796","Type":"ContainerStarted","Data":"937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc"}
Sep 11 14:27:06.961623 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:06.961219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv" event={"ID":"a5dadae0-d9db-458a-87d5-35ef6f4d1796","Type":"ContainerStarted","Data":"9daf754c472ffaf666b012cf6346c01431ca6f0c2dc8f4447356ab86616f0cb9"}
Sep 11 14:27:06.961623 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:06.961258    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:06.962686 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:06.962662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44" event={"ID":"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af","Type":"ContainerStarted","Data":"4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e"}
Sep 11 14:27:06.962796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:06.962784    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:06.997542 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:06.997501    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv" podStartSLOduration=1.5320324360000002 podStartE2EDuration="1.997483267s" totalImagesPullingTime="465.450831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:06.99685244 +0000 UTC m=+723.627603638" watchObservedRunningTime="2026-09-11 14:27:06.997483267 +0000 UTC m=+723.628234464"
Sep 11 14:27:07.025565 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:07.025482    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44" podStartSLOduration=2.624245327 podStartE2EDuration="3.025466672s" totalImagesPullingTime="401.221345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:07.022799375 +0000 UTC m=+723.653550638" watchObservedRunningTime="2026-09-11 14:27:07.025466672 +0000 UTC m=+723.656217868"
Sep 11 14:27:12.972489 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:12.972461    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:27:12.973296 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:12.972903    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:17.020092 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.020064    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"]
Sep 11 14:27:17.025708 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.025688    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.030431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.030407    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-b6b864-serving-cert\""
Sep 11 14:27:17.036842 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.036820    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-metrics-certs\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.036985 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.036854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-maas-api-tls\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.036985 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.036890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66a2e2f8-f7e2-4642-ba13-c273501345e5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.037095 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.036994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hws9g\" (UniqueName: \"kubernetes.io/projected/66a2e2f8-f7e2-4642-ba13-c273501345e5-kube-api-access-hws9g\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.137710 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.137684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hws9g\" (UniqueName: \"kubernetes.io/projected/66a2e2f8-f7e2-4642-ba13-c273501345e5-kube-api-access-hws9g\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.137985 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.137725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-metrics-certs\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.137985 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.137788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-maas-api-tls\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.137985 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.137835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66a2e2f8-f7e2-4642-ba13-c273501345e5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.137985 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:27:17.137940    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-serving-cert: secret "maas-api-e2e-inf-b-b6b864-serving-cert" not found
Sep 11 14:27:17.138246 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:27:17.138032    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-maas-api-tls podName:66a2e2f8-f7e2-4642-ba13-c273501345e5 nodeName:}" failed. No retries permitted until 2026-09-11 14:27:17.638014885 +0000 UTC m=+734.268766076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-maas-api-tls") pod "maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5" (UID: "66a2e2f8-f7e2-4642-ba13-c273501345e5") : secret "maas-api-e2e-inf-b-b6b864-serving-cert" not found
Sep 11 14:27:17.138587 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.138565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66a2e2f8-f7e2-4642-ba13-c273501345e5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.140241 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.140219    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-metrics-certs\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.156831 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.156798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hws9g\" (UniqueName: \"kubernetes.io/projected/66a2e2f8-f7e2-4642-ba13-c273501345e5-kube-api-access-hws9g\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.162613 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.162584    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"]
Sep 11 14:27:17.642421 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.642376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-maas-api-tls\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.644830 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.644805    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-maas-api-tls\") pod \"maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:17.936306 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:17.936225    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:18.064498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.064463    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"]
Sep 11 14:27:18.069366 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.069349    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:27:18.071966 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.071942    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-b6b864-dockercfg-vrchg\""
Sep 11 14:27:18.072126 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.072109    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-b6b864\""
Sep 11 14:27:18.078565 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.078542    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"]
Sep 11 14:27:18.148479 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.148436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq9lr\" (UniqueName: \"kubernetes.io/projected/a806cb50-27d9-4917-a7ed-f100a73d42f7-kube-api-access-zq9lr\") pod \"payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc\" (UID: \"a806cb50-27d9-4917-a7ed-f100a73d42f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:27:18.148479 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.148486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a806cb50-27d9-4917-a7ed-f100a73d42f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc\" (UID: \"a806cb50-27d9-4917-a7ed-f100a73d42f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:27:18.230533 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.230510    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"]
Sep 11 14:27:18.233362 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:27:18.233324    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a2e2f8_f7e2_4642_ba13_c273501345e5.slice/crio-9fd9c95c16d995f65d87559f57d6c974217ff36d76785e253a01eff0766ddea8 WatchSource:0}: Error finding container 9fd9c95c16d995f65d87559f57d6c974217ff36d76785e253a01eff0766ddea8: Status 404 returned error can't find the container with id 9fd9c95c16d995f65d87559f57d6c974217ff36d76785e253a01eff0766ddea8
Sep 11 14:27:18.248941 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.248912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq9lr\" (UniqueName: \"kubernetes.io/projected/a806cb50-27d9-4917-a7ed-f100a73d42f7-kube-api-access-zq9lr\") pod \"payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc\" (UID: \"a806cb50-27d9-4917-a7ed-f100a73d42f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:27:18.249042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.248952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a806cb50-27d9-4917-a7ed-f100a73d42f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc\" (UID: \"a806cb50-27d9-4917-a7ed-f100a73d42f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:27:18.249663 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.249641    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a806cb50-27d9-4917-a7ed-f100a73d42f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc\" (UID: \"a806cb50-27d9-4917-a7ed-f100a73d42f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:27:18.259434 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.259404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq9lr\" (UniqueName: \"kubernetes.io/projected/a806cb50-27d9-4917-a7ed-f100a73d42f7-kube-api-access-zq9lr\") pod \"payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc\" (UID: \"a806cb50-27d9-4917-a7ed-f100a73d42f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:27:18.380277 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.380243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:27:18.669765 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:18.669737    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"]
Sep 11 14:27:18.673233 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:27:18.673208    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda806cb50_27d9_4917_a7ed_f100a73d42f7.slice/crio-0eeb1490ffcd793594cf733e226fbf469835857b51166f517dd0e57b0909fbd8 WatchSource:0}: Error finding container 0eeb1490ffcd793594cf733e226fbf469835857b51166f517dd0e57b0909fbd8: Status 404 returned error can't find the container with id 0eeb1490ffcd793594cf733e226fbf469835857b51166f517dd0e57b0909fbd8
Sep 11 14:27:19.016870 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:19.016837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc" event={"ID":"a806cb50-27d9-4917-a7ed-f100a73d42f7","Type":"ContainerStarted","Data":"0eeb1490ffcd793594cf733e226fbf469835857b51166f517dd0e57b0909fbd8"}
Sep 11 14:27:19.018367 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:19.018340    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5" event={"ID":"66a2e2f8-f7e2-4642-ba13-c273501345e5","Type":"ContainerStarted","Data":"4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d"}
Sep 11 14:27:19.018476 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:19.018383    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5" event={"ID":"66a2e2f8-f7e2-4642-ba13-c273501345e5","Type":"ContainerStarted","Data":"9fd9c95c16d995f65d87559f57d6c974217ff36d76785e253a01eff0766ddea8"}
Sep 11 14:27:19.018476 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:19.018425    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:19.073654 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:19.073606    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5" podStartSLOduration=2.6545379909999998 podStartE2EDuration="3.073588508s" totalImagesPullingTime="419.050517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:19.072096691 +0000 UTC m=+735.702847888" watchObservedRunningTime="2026-09-11 14:27:19.073588508 +0000 UTC m=+735.704339704"
Sep 11 14:27:21.030346 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.030313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc" event={"ID":"a806cb50-27d9-4917-a7ed-f100a73d42f7","Type":"ContainerStarted","Data":"89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576"}
Sep 11 14:27:21.030810 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.030404    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:27:21.185407 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.185352    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc" podStartSLOduration=1.449637335 podStartE2EDuration="3.185328051s" totalImagesPullingTime="1.735690716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:21.06519702 +0000 UTC m=+737.695948215" watchObservedRunningTime="2026-09-11 14:27:21.185328051 +0000 UTC m=+737.816079248"
Sep 11 14:27:21.186780 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.186760    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"]
Sep 11 14:27:21.190168 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.190150    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.193666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.193645    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-422801d9-kserve-self-signed-certs\""
Sep 11 14:27:21.206834 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.206811    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"]
Sep 11 14:27:21.273858 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.273828    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-home\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.274010 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.273869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4rvq\" (UniqueName: \"kubernetes.io/projected/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-kube-api-access-v4rvq\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.274010 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.273903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-dshm\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.274010 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.273983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-model-cache\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.274119 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.274051    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tmp-dir\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.274119 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.274092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tls-certs\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.374951 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.374877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4rvq\" (UniqueName: \"kubernetes.io/projected/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-kube-api-access-v4rvq\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.374951 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.374915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-dshm\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.374951 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.374943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-model-cache\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.375229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.374976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tmp-dir\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.375229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.375009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tls-certs\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.375229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.375077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-home\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.375424 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.375398    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-model-cache\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.375626 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.375472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tmp-dir\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.375714 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.375687    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-home\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.377372 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.377350    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-dshm\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.377867 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.377847    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tls-certs\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.383492 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.383472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4rvq\" (UniqueName: \"kubernetes.io/projected/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-kube-api-access-v4rvq\") pod \"e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") " pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.498787 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.498753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:21.779897 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:21.779873    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"]
Sep 11 14:27:21.781544 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:27:21.781518    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7caae82_dcbc_408c_8822_08b8f9fe0fa0.slice/crio-f7a604b1b9a2f50aedaf871ea215189a8d25da6daf85c8ad0baecb452d8b185b WatchSource:0}: Error finding container f7a604b1b9a2f50aedaf871ea215189a8d25da6daf85c8ad0baecb452d8b185b: Status 404 returned error can't find the container with id f7a604b1b9a2f50aedaf871ea215189a8d25da6daf85c8ad0baecb452d8b185b
Sep 11 14:27:22.037550 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:22.037459    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88" event={"ID":"d7caae82-dcbc-408c-8822-08b8f9fe0fa0","Type":"ContainerStarted","Data":"c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a"}
Sep 11 14:27:22.037550 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:22.037509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88" event={"ID":"d7caae82-dcbc-408c-8822-08b8f9fe0fa0","Type":"ContainerStarted","Data":"f7a604b1b9a2f50aedaf871ea215189a8d25da6daf85c8ad0baecb452d8b185b"}
Sep 11 14:27:22.061054 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:22.061011    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88" podStartSLOduration=1.06099544 podStartE2EDuration="1.06099544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:22.059234853 +0000 UTC m=+738.689986060" watchObservedRunningTime="2026-09-11 14:27:22.06099544 +0000 UTC m=+738.691746636"
Sep 11 14:27:25.029260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:25.029221    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:27:28.147027 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.146994    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"]
Sep 11 14:27:28.147551 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.147226    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv" podUID="a5dadae0-d9db-458a-87d5-35ef6f4d1796" containerName="maas-api" containerID="cri-o://937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc" gracePeriod=30
Sep 11 14:27:28.396766 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.396743    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:28.438615 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.438584    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tktj\" (UniqueName: \"kubernetes.io/projected/a5dadae0-d9db-458a-87d5-35ef6f4d1796-kube-api-access-5tktj\") pod \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") "
Sep 11 14:27:28.438772 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.438631    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5dadae0-d9db-458a-87d5-35ef6f4d1796-openshift-service-ca\") pod \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") "
Sep 11 14:27:28.438772 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.438703    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-metrics-certs\") pod \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") "
Sep 11 14:27:28.438772 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.438750    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-maas-api-tls\") pod \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\" (UID: \"a5dadae0-d9db-458a-87d5-35ef6f4d1796\") "
Sep 11 14:27:28.439064 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.439034    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5dadae0-d9db-458a-87d5-35ef6f4d1796-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5dadae0-d9db-458a-87d5-35ef6f4d1796" (UID: "a5dadae0-d9db-458a-87d5-35ef6f4d1796"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:27:28.441302 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.441273    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a5dadae0-d9db-458a-87d5-35ef6f4d1796" (UID: "a5dadae0-d9db-458a-87d5-35ef6f4d1796"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:27:28.441454 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.441429    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5dadae0-d9db-458a-87d5-35ef6f4d1796" (UID: "a5dadae0-d9db-458a-87d5-35ef6f4d1796"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:27:28.441498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.441438    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5dadae0-d9db-458a-87d5-35ef6f4d1796-kube-api-access-5tktj" (OuterVolumeSpecName: "kube-api-access-5tktj") pod "a5dadae0-d9db-458a-87d5-35ef6f4d1796" (UID: "a5dadae0-d9db-458a-87d5-35ef6f4d1796"). InnerVolumeSpecName "kube-api-access-5tktj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:27:28.539422 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.539389    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:27:28.539422 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.539414    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5dadae0-d9db-458a-87d5-35ef6f4d1796-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:27:28.539422 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.539423    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tktj\" (UniqueName: \"kubernetes.io/projected/a5dadae0-d9db-458a-87d5-35ef6f4d1796-kube-api-access-5tktj\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:27:28.539593 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:28.539432    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5dadae0-d9db-458a-87d5-35ef6f4d1796-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:27:29.071751 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:29.071717    2581 generic.go:356] "Generic (PLEG): container finished" podID="a5dadae0-d9db-458a-87d5-35ef6f4d1796" containerID="937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc" exitCode=0
Sep 11 14:27:29.071918 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:29.071765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv" event={"ID":"a5dadae0-d9db-458a-87d5-35ef6f4d1796","Type":"ContainerDied","Data":"937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc"}
Sep 11 14:27:29.071918 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:29.071773    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"
Sep 11 14:27:29.071918 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:29.071807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv" event={"ID":"a5dadae0-d9db-458a-87d5-35ef6f4d1796","Type":"ContainerDied","Data":"9daf754c472ffaf666b012cf6346c01431ca6f0c2dc8f4447356ab86616f0cb9"}
Sep 11 14:27:29.071918 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:29.071828    2581 scope.go:117] "RemoveContainer" containerID="937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc"
Sep 11 14:27:29.085891 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:29.085872    2581 scope.go:117] "RemoveContainer" containerID="937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc"
Sep 11 14:27:29.086262 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:27:29.086241    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc\": container with ID starting with 937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc not found: ID does not exist" containerID="937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc"
Sep 11 14:27:29.086327 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:29.086271    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc"} err="failed to get container status \"937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc\": rpc error: code = NotFound desc = could not find container \"937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc\": container with ID starting with 937994941fecd279d02392cfd94bc5e6ab7e4c5c11a89419c9b761c556ea35bc not found: ID does not exist"
Sep 11 14:27:29.113439 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:29.113404    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"]
Sep 11 14:27:29.118129 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:29.118105    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-43ca2273-548d69c7d5-sx4tv"]
Sep 11 14:27:29.858597 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:29.858569    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5dadae0-d9db-458a-87d5-35ef6f4d1796" path="/var/lib/kubelet/pods/a5dadae0-d9db-458a-87d5-35ef6f4d1796/volumes"
Sep 11 14:27:31.499751 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:31.499713    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:31.500129 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:31.499863    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:31.511920 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:31.511901    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:32.039319 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:32.039287    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:27:32.098721 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:32.098693    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:27:33.217109 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.217082    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"]
Sep 11 14:27:33.217497 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.217448    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5dadae0-d9db-458a-87d5-35ef6f4d1796" containerName="maas-api"
Sep 11 14:27:33.217497 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.217463    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5dadae0-d9db-458a-87d5-35ef6f4d1796" containerName="maas-api"
Sep 11 14:27:33.217565 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.217524    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5dadae0-d9db-458a-87d5-35ef6f4d1796" containerName="maas-api"
Sep 11 14:27:33.220597 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.220578    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.223934 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.223915    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-2db3d4c3-serving-cert\""
Sep 11 14:27:33.244428 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.244405    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"]
Sep 11 14:27:33.281686 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.281643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-maas-api-tls\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.281823 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.281704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4crw9\" (UniqueName: \"kubernetes.io/projected/71f4ed61-9880-4e3d-912b-a4016da45b33-kube-api-access-4crw9\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.281823 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.281741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f4ed61-9880-4e3d-912b-a4016da45b33-openshift-service-ca\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.281823 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.281765    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-metrics-certs\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.382787 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.382760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f4ed61-9880-4e3d-912b-a4016da45b33-openshift-service-ca\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.382787 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.382793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-metrics-certs\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.383012 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.382874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-maas-api-tls\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.383012 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.382909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4crw9\" (UniqueName: \"kubernetes.io/projected/71f4ed61-9880-4e3d-912b-a4016da45b33-kube-api-access-4crw9\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.383551 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.383531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f4ed61-9880-4e3d-912b-a4016da45b33-openshift-service-ca\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.385518 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.385499    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-metrics-certs\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.385645 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.385623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-maas-api-tls\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.396593 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.396493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4crw9\" (UniqueName: \"kubernetes.io/projected/71f4ed61-9880-4e3d-912b-a4016da45b33-kube-api-access-4crw9\") pod \"maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.530911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.530831    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:33.808985 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:33.808961    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"]
Sep 11 14:27:33.810954 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:27:33.810928    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f4ed61_9880_4e3d_912b_a4016da45b33.slice/crio-3cb971f30b35029e4d7aa9cc39fd01f014d1f7b95f7153daa4e890905bf2549d WatchSource:0}: Error finding container 3cb971f30b35029e4d7aa9cc39fd01f014d1f7b95f7153daa4e890905bf2549d: Status 404 returned error can't find the container with id 3cb971f30b35029e4d7aa9cc39fd01f014d1f7b95f7153daa4e890905bf2549d
Sep 11 14:27:34.099155 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:34.099059    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7" event={"ID":"71f4ed61-9880-4e3d-912b-a4016da45b33","Type":"ContainerStarted","Data":"3cb971f30b35029e4d7aa9cc39fd01f014d1f7b95f7153daa4e890905bf2549d"}
Sep 11 14:27:35.104735 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:35.104697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7" event={"ID":"71f4ed61-9880-4e3d-912b-a4016da45b33","Type":"ContainerStarted","Data":"f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b"}
Sep 11 14:27:35.105130 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:35.104826    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:27:35.125317 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:35.125268    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7" podStartSLOduration=1.7523161379999999 podStartE2EDuration="2.125250541s" totalImagesPullingTime="372.934403ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:35.12344166 +0000 UTC m=+751.754192852" watchObservedRunningTime="2026-09-11 14:27:35.125250541 +0000 UTC m=+751.756001736"
Sep 11 14:27:41.114619 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:27:41.114589    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:28:04.614713 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:04.614678    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"]
Sep 11 14:28:04.615193 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:04.614895    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7" podUID="71f4ed61-9880-4e3d-912b-a4016da45b33" containerName="maas-api" containerID="cri-o://f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b" gracePeriod=30
Sep 11 14:28:04.868903 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:04.868849    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:28:04.962592 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:04.962566    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f4ed61-9880-4e3d-912b-a4016da45b33-openshift-service-ca\") pod \"71f4ed61-9880-4e3d-912b-a4016da45b33\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") "
Sep 11 14:28:04.962736 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:04.962608    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4crw9\" (UniqueName: \"kubernetes.io/projected/71f4ed61-9880-4e3d-912b-a4016da45b33-kube-api-access-4crw9\") pod \"71f4ed61-9880-4e3d-912b-a4016da45b33\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") "
Sep 11 14:28:04.962736 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:04.962643    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-maas-api-tls\") pod \"71f4ed61-9880-4e3d-912b-a4016da45b33\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") "
Sep 11 14:28:04.962736 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:04.962665    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-metrics-certs\") pod \"71f4ed61-9880-4e3d-912b-a4016da45b33\" (UID: \"71f4ed61-9880-4e3d-912b-a4016da45b33\") "
Sep 11 14:28:04.962950 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:04.962925    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71f4ed61-9880-4e3d-912b-a4016da45b33-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "71f4ed61-9880-4e3d-912b-a4016da45b33" (UID: "71f4ed61-9880-4e3d-912b-a4016da45b33"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:28:04.964755 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:04.964728    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71f4ed61-9880-4e3d-912b-a4016da45b33-kube-api-access-4crw9" (OuterVolumeSpecName: "kube-api-access-4crw9") pod "71f4ed61-9880-4e3d-912b-a4016da45b33" (UID: "71f4ed61-9880-4e3d-912b-a4016da45b33"). InnerVolumeSpecName "kube-api-access-4crw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:28:04.964886 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:04.964831    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "71f4ed61-9880-4e3d-912b-a4016da45b33" (UID: "71f4ed61-9880-4e3d-912b-a4016da45b33"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:28:04.964886 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:04.964857    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "71f4ed61-9880-4e3d-912b-a4016da45b33" (UID: "71f4ed61-9880-4e3d-912b-a4016da45b33"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:28:05.063905 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.063874    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f4ed61-9880-4e3d-912b-a4016da45b33-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:28:05.063905 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.063899    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4crw9\" (UniqueName: \"kubernetes.io/projected/71f4ed61-9880-4e3d-912b-a4016da45b33-kube-api-access-4crw9\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:28:05.063905 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.063909    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:28:05.064113 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.063918    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71f4ed61-9880-4e3d-912b-a4016da45b33-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:28:05.248764 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.248731    2581 generic.go:356] "Generic (PLEG): container finished" podID="71f4ed61-9880-4e3d-912b-a4016da45b33" containerID="f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b" exitCode=0
Sep 11 14:28:05.248908 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.248767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7" event={"ID":"71f4ed61-9880-4e3d-912b-a4016da45b33","Type":"ContainerDied","Data":"f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b"}
Sep 11 14:28:05.248908 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.248780    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"
Sep 11 14:28:05.248908 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.248821    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7" event={"ID":"71f4ed61-9880-4e3d-912b-a4016da45b33","Type":"ContainerDied","Data":"3cb971f30b35029e4d7aa9cc39fd01f014d1f7b95f7153daa4e890905bf2549d"}
Sep 11 14:28:05.248908 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.248844    2581 scope.go:117] "RemoveContainer" containerID="f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b"
Sep 11 14:28:05.258987 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.258862    2581 scope.go:117] "RemoveContainer" containerID="f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b"
Sep 11 14:28:05.259216 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:28:05.259189    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b\": container with ID starting with f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b not found: ID does not exist" containerID="f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b"
Sep 11 14:28:05.259320 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.259225    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b"} err="failed to get container status \"f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b\": rpc error: code = NotFound desc = could not find container \"f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b\": container with ID starting with f5b021a6329944478f9fb880e5b28fced276bdc94ca362760ef39639d87ff66b not found: ID does not exist"
Sep 11 14:28:05.274494 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.274468    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"]
Sep 11 14:28:05.279792 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.279772    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2db3d4c3-7896d6674d-nsmj7"]
Sep 11 14:28:05.859217 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:05.859187    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71f4ed61-9880-4e3d-912b-a4016da45b33" path="/var/lib/kubelet/pods/71f4ed61-9880-4e3d-912b-a4016da45b33/volumes"
Sep 11 14:28:11.677355 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.677320    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"]
Sep 11 14:28:11.677711 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.677674    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f4ed61-9880-4e3d-912b-a4016da45b33" containerName="maas-api"
Sep 11 14:28:11.677711 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.677685    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f4ed61-9880-4e3d-912b-a4016da45b33" containerName="maas-api"
Sep 11 14:28:11.677781 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.677740    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71f4ed61-9880-4e3d-912b-a4016da45b33" containerName="maas-api"
Sep 11 14:28:11.682045 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.682016    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.684406 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.684389    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f44a68eb-serving-cert\""
Sep 11 14:28:11.692828 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.692807    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"]
Sep 11 14:28:11.718875 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.718851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-openshift-service-ca\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.718978 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.718879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9cdx\" (UniqueName: \"kubernetes.io/projected/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-kube-api-access-c9cdx\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.718978 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.718910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-maas-api-tls\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.719059 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.719024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-metrics-certs\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.820388 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.820358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-maas-api-tls\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.820549 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.820427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-metrics-certs\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.820549 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.820504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-openshift-service-ca\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.820549 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.820531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9cdx\" (UniqueName: \"kubernetes.io/projected/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-kube-api-access-c9cdx\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.821124 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.821102    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-openshift-service-ca\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.822780 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.822757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-maas-api-tls\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.822899 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.822798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-metrics-certs\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.829313 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.829293    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9cdx\" (UniqueName: \"kubernetes.io/projected/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-kube-api-access-c9cdx\") pod \"maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:11.992967 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:11.992938    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:12.269732 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:12.269708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"]
Sep 11 14:28:12.271857 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:28:12.271821    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69cb5f53_e95f_4250_a8ed_c4df5b2cf02c.slice/crio-e1b51f7414fa43dabe5161cd426515ce55a20d9ca452a7b7ba34908852454311 WatchSource:0}: Error finding container e1b51f7414fa43dabe5161cd426515ce55a20d9ca452a7b7ba34908852454311: Status 404 returned error can't find the container with id e1b51f7414fa43dabe5161cd426515ce55a20d9ca452a7b7ba34908852454311
Sep 11 14:28:12.285299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:12.285273    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72" event={"ID":"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c","Type":"ContainerStarted","Data":"e1b51f7414fa43dabe5161cd426515ce55a20d9ca452a7b7ba34908852454311"}
Sep 11 14:28:13.291195 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:13.291157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72" event={"ID":"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c","Type":"ContainerStarted","Data":"85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83"}
Sep 11 14:28:13.291646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:13.291254    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:13.314907 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:13.314866    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72" podStartSLOduration=1.8906169259999999 podStartE2EDuration="2.314852446s" totalImagesPullingTime="424.23552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:28:13.313006392 +0000 UTC m=+789.943757588" watchObservedRunningTime="2026-09-11 14:28:13.314852446 +0000 UTC m=+789.945603641"
Sep 11 14:28:19.300929 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:19.300898    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:28:48.840825 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:48.840790    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"]
Sep 11 14:28:48.844972 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:48.844949    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:48.849059 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:48.849032    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-422801d9-kserve-self-signed-certs\""
Sep 11 14:28:48.933491 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:48.933464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d50a4b62-3851-41f9-8480-757842c394d0-tls-certs\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:48.933611 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:48.933499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-model-cache\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:48.933611 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:48.933527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-dshm\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:48.933611 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:48.933582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5mpc\" (UniqueName: \"kubernetes.io/projected/d50a4b62-3851-41f9-8480-757842c394d0-kube-api-access-v5mpc\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:48.933727 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:48.933616    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-home\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:48.933727 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:48.933635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-tmp-dir\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:48.941927 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:48.941901    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"]
Sep 11 14:28:49.034944 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.034914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d50a4b62-3851-41f9-8480-757842c394d0-tls-certs\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.035101 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.034950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-model-cache\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.035101 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.034978    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-dshm\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.035101 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.035032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mpc\" (UniqueName: \"kubernetes.io/projected/d50a4b62-3851-41f9-8480-757842c394d0-kube-api-access-v5mpc\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.035101 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.035076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-home\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.035367 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.035103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-tmp-dir\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.035470 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.035440    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-model-cache\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.035524 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.035488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-home\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.035705 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.035681    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-tmp-dir\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.037488 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.037465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-dshm\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.037732 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.037715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d50a4b62-3851-41f9-8480-757842c394d0-tls-certs\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.056258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.056229    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5mpc\" (UniqueName: \"kubernetes.io/projected/d50a4b62-3851-41f9-8480-757842c394d0-kube-api-access-v5mpc\") pod \"e2e-conflict-b-422801d9-kserve-5644cd644c-stghh\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") " pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.155692 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.155606    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:49.439380 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.439356    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"]
Sep 11 14:28:49.442220 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:28:49.442195    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd50a4b62_3851_41f9_8480_757842c394d0.slice/crio-d17124c3dac3c9b7413402353a124684992e6c0a1b9e09dee29a0f1426d30247 WatchSource:0}: Error finding container d17124c3dac3c9b7413402353a124684992e6c0a1b9e09dee29a0f1426d30247: Status 404 returned error can't find the container with id d17124c3dac3c9b7413402353a124684992e6c0a1b9e09dee29a0f1426d30247
Sep 11 14:28:49.458171 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:49.458124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh" event={"ID":"d50a4b62-3851-41f9-8480-757842c394d0","Type":"ContainerStarted","Data":"d17124c3dac3c9b7413402353a124684992e6c0a1b9e09dee29a0f1426d30247"}
Sep 11 14:28:50.467280 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:50.467238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh" event={"ID":"d50a4b62-3851-41f9-8480-757842c394d0","Type":"ContainerStarted","Data":"bcf89e624aba813ce2806b3a0d9e6710a7724e90a6b9812187768a84c6044e71"}
Sep 11 14:28:50.491322 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:50.491275    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh" podStartSLOduration=9.491258944 podStartE2EDuration="9.491258944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:28:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:28:50.488797201 +0000 UTC m=+827.119548413" watchObservedRunningTime="2026-09-11 14:28:50.491258944 +0000 UTC m=+827.122010140"
Sep 11 14:28:59.156718 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:59.156679    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:59.156718 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:59.156725    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:59.169460 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:59.169437    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:59.519043 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:59.519022    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:28:59.752607 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:59.752573    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"]
Sep 11 14:28:59.752833 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:59.752808    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44" podUID="9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af" containerName="maas-api" containerID="cri-o://4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e" gracePeriod=30
Sep 11 14:28:59.996297 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:28:59.996274    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:29:00.030108 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.030081    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-openshift-service-ca\") pod \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") "
Sep 11 14:29:00.030266 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.030169    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-maas-api-tls\") pod \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") "
Sep 11 14:29:00.030266 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.030195    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68pxp\" (UniqueName: \"kubernetes.io/projected/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-kube-api-access-68pxp\") pod \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") "
Sep 11 14:29:00.030266 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.030265    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-metrics-certs\") pod \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\" (UID: \"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af\") "
Sep 11 14:29:00.030487 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.030460    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af" (UID: "9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:29:00.030561 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.030539    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:00.032405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.032372    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-kube-api-access-68pxp" (OuterVolumeSpecName: "kube-api-access-68pxp") pod "9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af" (UID: "9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af"). InnerVolumeSpecName "kube-api-access-68pxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:00.032405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.032394    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af" (UID: "9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:29:00.032680 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.032644    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af" (UID: "9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:29:00.131823 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.131708    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:00.131823 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.131741    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:00.131823 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.131755    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68pxp\" (UniqueName: \"kubernetes.io/projected/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af-kube-api-access-68pxp\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:00.513919 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.513881    2581 generic.go:356] "Generic (PLEG): container finished" podID="9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af" containerID="4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e" exitCode=0
Sep 11 14:29:00.513919 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.513924    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"
Sep 11 14:29:00.514431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.513968    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44" event={"ID":"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af","Type":"ContainerDied","Data":"4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e"}
Sep 11 14:29:00.514431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.514018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44" event={"ID":"9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af","Type":"ContainerDied","Data":"38029721d062fbf349072dc87743a39542202b5d39516a30517eb384cd4371a8"}
Sep 11 14:29:00.514431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.514039    2581 scope.go:117] "RemoveContainer" containerID="4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e"
Sep 11 14:29:00.522898 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.522879    2581 scope.go:117] "RemoveContainer" containerID="4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e"
Sep 11 14:29:00.523161 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:29:00.523122    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e\": container with ID starting with 4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e not found: ID does not exist" containerID="4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e"
Sep 11 14:29:00.523242 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.523165    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e"} err="failed to get container status \"4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e\": rpc error: code = NotFound desc = could not find container \"4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e\": container with ID starting with 4512ea777b70013aed3a45db32322a7bea60ea520955955bd70715ec0f14f27e not found: ID does not exist"
Sep 11 14:29:00.539504 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.539476    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"]
Sep 11 14:29:00.545210 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:00.545187    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b4a233-c5dcdf64d-rbw44"]
Sep 11 14:29:01.859181 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:01.859124    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af" path="/var/lib/kubelet/pods/9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af/volumes"
Sep 11 14:29:05.893730 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:05.893697    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"]
Sep 11 14:29:05.894212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:05.893905    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72" podUID="69cb5f53-e95f-4250-a8ed-c4df5b2cf02c" containerName="maas-api" containerID="cri-o://85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83" gracePeriod=30
Sep 11 14:29:06.136077 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.136054    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:29:06.187877 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.187858    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-openshift-service-ca\") pod \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") "
Sep 11 14:29:06.188026 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.187893    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-maas-api-tls\") pod \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") "
Sep 11 14:29:06.188026 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.187920    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9cdx\" (UniqueName: \"kubernetes.io/projected/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-kube-api-access-c9cdx\") pod \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") "
Sep 11 14:29:06.188169 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.188116    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-metrics-certs\") pod \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\" (UID: \"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c\") "
Sep 11 14:29:06.188326 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.188302    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "69cb5f53-e95f-4250-a8ed-c4df5b2cf02c" (UID: "69cb5f53-e95f-4250-a8ed-c4df5b2cf02c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:29:06.188480 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.188462    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:06.190030 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.190008    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-kube-api-access-c9cdx" (OuterVolumeSpecName: "kube-api-access-c9cdx") pod "69cb5f53-e95f-4250-a8ed-c4df5b2cf02c" (UID: "69cb5f53-e95f-4250-a8ed-c4df5b2cf02c"). InnerVolumeSpecName "kube-api-access-c9cdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:06.190116 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.190038    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "69cb5f53-e95f-4250-a8ed-c4df5b2cf02c" (UID: "69cb5f53-e95f-4250-a8ed-c4df5b2cf02c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:29:06.190263 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.190122    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "69cb5f53-e95f-4250-a8ed-c4df5b2cf02c" (UID: "69cb5f53-e95f-4250-a8ed-c4df5b2cf02c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:29:06.289874 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.289839    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:06.289874 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.289874    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:06.290118 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.289888    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9cdx\" (UniqueName: \"kubernetes.io/projected/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c-kube-api-access-c9cdx\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:06.545582 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.545491    2581 generic.go:356] "Generic (PLEG): container finished" podID="69cb5f53-e95f-4250-a8ed-c4df5b2cf02c" containerID="85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83" exitCode=0
Sep 11 14:29:06.545582 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.545534    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"
Sep 11 14:29:06.545783 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.545578    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72" event={"ID":"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c","Type":"ContainerDied","Data":"85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83"}
Sep 11 14:29:06.545783 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.545626    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72" event={"ID":"69cb5f53-e95f-4250-a8ed-c4df5b2cf02c","Type":"ContainerDied","Data":"e1b51f7414fa43dabe5161cd426515ce55a20d9ca452a7b7ba34908852454311"}
Sep 11 14:29:06.545783 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.545648    2581 scope.go:117] "RemoveContainer" containerID="85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83"
Sep 11 14:29:06.554680 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.554665    2581 scope.go:117] "RemoveContainer" containerID="85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83"
Sep 11 14:29:06.554919 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:29:06.554903    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83\": container with ID starting with 85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83 not found: ID does not exist" containerID="85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83"
Sep 11 14:29:06.554961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.554928    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83"} err="failed to get container status \"85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83\": rpc error: code = NotFound desc = could not find container \"85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83\": container with ID starting with 85336d518c0f87dceefc81e1c22cf7a0e6552b59a97dbc38c265ad7a3f901a83 not found: ID does not exist"
Sep 11 14:29:06.579849 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.579829    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"]
Sep 11 14:29:06.593042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:06.593021    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f44a68eb-84d46fbfdd-qkm72"]
Sep 11 14:29:07.376071 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:07.376018    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"]
Sep 11 14:29:07.859078 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:07.859046    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69cb5f53-e95f-4250-a8ed-c4df5b2cf02c" path="/var/lib/kubelet/pods/69cb5f53-e95f-4250-a8ed-c4df5b2cf02c/volumes"
Sep 11 14:29:14.029258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.029227    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"]
Sep 11 14:29:14.029752 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.029731    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af" containerName="maas-api"
Sep 11 14:29:14.029826 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.029757    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af" containerName="maas-api"
Sep 11 14:29:14.029826 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.029769    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69cb5f53-e95f-4250-a8ed-c4df5b2cf02c" containerName="maas-api"
Sep 11 14:29:14.029826 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.029777    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69cb5f53-e95f-4250-a8ed-c4df5b2cf02c" containerName="maas-api"
Sep 11 14:29:14.029967 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.029869    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eb4ae4a-c9c2-4ed9-8fe0-9e1ffec661af" containerName="maas-api"
Sep 11 14:29:14.029967 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.029885    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="69cb5f53-e95f-4250-a8ed-c4df5b2cf02c" containerName="maas-api"
Sep 11 14:29:14.034077 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.034056    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.040226 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.040199    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b0010444-serving-cert\""
Sep 11 14:29:14.049872 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.049846    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"]
Sep 11 14:29:14.158424 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.158389    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-metrics-certs\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.158615 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.158449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqfdv\" (UniqueName: \"kubernetes.io/projected/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-kube-api-access-bqfdv\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.158615 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.158546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-openshift-service-ca\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.158714 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.158643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-maas-api-tls\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.259345 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.259305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqfdv\" (UniqueName: \"kubernetes.io/projected/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-kube-api-access-bqfdv\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.259554 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.259361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-openshift-service-ca\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.259554 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.259444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-maas-api-tls\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.259554 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.259497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-metrics-certs\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.260033 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.260007    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-openshift-service-ca\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.261872 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.261849    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-metrics-certs\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.261963 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.261895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-maas-api-tls\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.275048 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.275018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqfdv\" (UniqueName: \"kubernetes.io/projected/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-kube-api-access-bqfdv\") pod \"maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.344557 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.344487    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:14.624999 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:14.624977    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"]
Sep 11 14:29:14.627123 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:29:14.627095    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode816528e_b8f5_4f7d_8e7d_d5e3c9d43ef8.slice/crio-ddfa4cb6b511fd01d4c05ec4b3d9a430f8c845eff8808442a8d6bf3d6ea1bc28 WatchSource:0}: Error finding container ddfa4cb6b511fd01d4c05ec4b3d9a430f8c845eff8808442a8d6bf3d6ea1bc28: Status 404 returned error can't find the container with id ddfa4cb6b511fd01d4c05ec4b3d9a430f8c845eff8808442a8d6bf3d6ea1bc28
Sep 11 14:29:15.596257 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:15.596218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk" event={"ID":"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8","Type":"ContainerStarted","Data":"0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0"}
Sep 11 14:29:15.596641 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:15.596276    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk" event={"ID":"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8","Type":"ContainerStarted","Data":"ddfa4cb6b511fd01d4c05ec4b3d9a430f8c845eff8808442a8d6bf3d6ea1bc28"}
Sep 11 14:29:15.596641 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:15.596313    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:15.617908 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:15.617866    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk" podStartSLOduration=1.159406226 podStartE2EDuration="1.617852749s" totalImagesPullingTime="458.446523ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:15.616918383 +0000 UTC m=+852.247669578" watchObservedRunningTime="2026-09-11 14:29:15.617852749 +0000 UTC m=+852.248603945"
Sep 11 14:29:21.606940 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:21.606910    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:22.397916 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.397855    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh" podUID="d50a4b62-3851-41f9-8480-757842c394d0" containerName="main" containerID="cri-o://bcf89e624aba813ce2806b3a0d9e6710a7724e90a6b9812187768a84c6044e71" gracePeriod=45
Sep 11 14:29:22.635831 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.635802    2581 generic.go:356] "Generic (PLEG): container finished" podID="d50a4b62-3851-41f9-8480-757842c394d0" containerID="bcf89e624aba813ce2806b3a0d9e6710a7724e90a6b9812187768a84c6044e71" exitCode=0
Sep 11 14:29:22.636239 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.635876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh" event={"ID":"d50a4b62-3851-41f9-8480-757842c394d0","Type":"ContainerDied","Data":"bcf89e624aba813ce2806b3a0d9e6710a7724e90a6b9812187768a84c6044e71"}
Sep 11 14:29:22.636239 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.635916    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh" event={"ID":"d50a4b62-3851-41f9-8480-757842c394d0","Type":"ContainerDied","Data":"d17124c3dac3c9b7413402353a124684992e6c0a1b9e09dee29a0f1426d30247"}
Sep 11 14:29:22.636239 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.635928    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d17124c3dac3c9b7413402353a124684992e6c0a1b9e09dee29a0f1426d30247"
Sep 11 14:29:22.649170 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.649100    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:29:22.735941 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.735913    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5mpc\" (UniqueName: \"kubernetes.io/projected/d50a4b62-3851-41f9-8480-757842c394d0-kube-api-access-v5mpc\") pod \"d50a4b62-3851-41f9-8480-757842c394d0\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") "
Sep 11 14:29:22.736084 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.736002    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-dshm\") pod \"d50a4b62-3851-41f9-8480-757842c394d0\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") "
Sep 11 14:29:22.736084 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.736027    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-tmp-dir\") pod \"d50a4b62-3851-41f9-8480-757842c394d0\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") "
Sep 11 14:29:22.736084 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.736055    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-model-cache\") pod \"d50a4b62-3851-41f9-8480-757842c394d0\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") "
Sep 11 14:29:22.736256 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.736091    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d50a4b62-3851-41f9-8480-757842c394d0-tls-certs\") pod \"d50a4b62-3851-41f9-8480-757842c394d0\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") "
Sep 11 14:29:22.736256 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.736110    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-home\") pod \"d50a4b62-3851-41f9-8480-757842c394d0\" (UID: \"d50a4b62-3851-41f9-8480-757842c394d0\") "
Sep 11 14:29:22.736477 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.736432    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "d50a4b62-3851-41f9-8480-757842c394d0" (UID: "d50a4b62-3851-41f9-8480-757842c394d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:22.736629 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.736607    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d50a4b62-3851-41f9-8480-757842c394d0" (UID: "d50a4b62-3851-41f9-8480-757842c394d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:22.736685 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.736623    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-home" (OuterVolumeSpecName: "home") pod "d50a4b62-3851-41f9-8480-757842c394d0" (UID: "d50a4b62-3851-41f9-8480-757842c394d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:22.738692 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.738657    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d50a4b62-3851-41f9-8480-757842c394d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d50a4b62-3851-41f9-8480-757842c394d0" (UID: "d50a4b62-3851-41f9-8480-757842c394d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:29:22.738768 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.738715    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-dshm" (OuterVolumeSpecName: "dshm") pod "d50a4b62-3851-41f9-8480-757842c394d0" (UID: "d50a4b62-3851-41f9-8480-757842c394d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:22.738768 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.738721    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d50a4b62-3851-41f9-8480-757842c394d0-kube-api-access-v5mpc" (OuterVolumeSpecName: "kube-api-access-v5mpc") pod "d50a4b62-3851-41f9-8480-757842c394d0" (UID: "d50a4b62-3851-41f9-8480-757842c394d0"). InnerVolumeSpecName "kube-api-access-v5mpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:22.836790 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.836767    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-dshm\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:22.836790 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.836789    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-tmp-dir\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:22.836922 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.836800    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-model-cache\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:22.836922 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.836809    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d50a4b62-3851-41f9-8480-757842c394d0-tls-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:22.836922 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.836817    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d50a4b62-3851-41f9-8480-757842c394d0-home\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:22.836922 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:22.836825    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5mpc\" (UniqueName: \"kubernetes.io/projected/d50a4b62-3851-41f9-8480-757842c394d0-kube-api-access-v5mpc\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:23.640584 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:23.640550    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"
Sep 11 14:29:23.666723 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:23.666692    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"]
Sep 11 14:29:23.668914 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:23.668890    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-422801d9-kserve-5644cd644c-stghh"]
Sep 11 14:29:23.859237 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:23.859207    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d50a4b62-3851-41f9-8480-757842c394d0" path="/var/lib/kubelet/pods/d50a4b62-3851-41f9-8480-757842c394d0/volumes"
Sep 11 14:29:34.916165 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:34.916121    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"]
Sep 11 14:29:44.780063 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.780028    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"]
Sep 11 14:29:44.780595 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.780575    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d50a4b62-3851-41f9-8480-757842c394d0" containerName="main"
Sep 11 14:29:44.780673 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.780600    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d50a4b62-3851-41f9-8480-757842c394d0" containerName="main"
Sep 11 14:29:44.780723 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.780686    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d50a4b62-3851-41f9-8480-757842c394d0" containerName="main"
Sep 11 14:29:44.782866 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.782847    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:44.785713 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.785691    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b6b864\"/\"test-model-b6b864-kserve-self-signed-certs\""
Sep 11 14:29:44.786531 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.786514    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b6b864\"/\"default-dockercfg-8rr2r\""
Sep 11 14:29:44.786599 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.786562    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b6b864\"/\"kube-root-ca.crt\""
Sep 11 14:29:44.786639 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.786562    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b6b864\"/\"openshift-service-ca.crt\""
Sep 11 14:29:44.795163 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.795124    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"]
Sep 11 14:29:44.928906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.928878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-model-cache\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:44.929068 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.928922    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbh7v\" (UniqueName: \"kubernetes.io/projected/0aad4628-cc79-499b-8e4b-430d1b51eee7-kube-api-access-vbh7v\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:44.929068 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.929016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-home\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:44.929183 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.929072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-dshm\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:44.929183 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.929099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-tmp-dir\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:44.929183 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:44.929129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0aad4628-cc79-499b-8e4b-430d1b51eee7-tls-certs\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.029648 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.029613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-home\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.029825 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.029661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-dshm\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.029825 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.029691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-tmp-dir\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.029825 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.029729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0aad4628-cc79-499b-8e4b-430d1b51eee7-tls-certs\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.029825 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.029759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-model-cache\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.029825 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.029809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbh7v\" (UniqueName: \"kubernetes.io/projected/0aad4628-cc79-499b-8e4b-430d1b51eee7-kube-api-access-vbh7v\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.030133 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.030078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-home\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.030133 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.030128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-tmp-dir\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.030299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.030226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-model-cache\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.032006 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.031985    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-dshm\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.032383 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.032364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0aad4628-cc79-499b-8e4b-430d1b51eee7-tls-certs\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.042519 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.042495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbh7v\" (UniqueName: \"kubernetes.io/projected/0aad4628-cc79-499b-8e4b-430d1b51eee7-kube-api-access-vbh7v\") pod \"test-model-b6b864-kserve-9d7dcdc8f-p2ssb\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") " pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.091797 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.091772    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:45.477012 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.476983    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"]
Sep 11 14:29:45.480589 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:29:45.480561    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0aad4628_cc79_499b_8e4b_430d1b51eee7.slice/crio-2e2341f82189a948ffeba70169f0aad6152091b2dc1e3347220a02b3608630cf WatchSource:0}: Error finding container 2e2341f82189a948ffeba70169f0aad6152091b2dc1e3347220a02b3608630cf: Status 404 returned error can't find the container with id 2e2341f82189a948ffeba70169f0aad6152091b2dc1e3347220a02b3608630cf
Sep 11 14:29:45.746908 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.746825    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb" event={"ID":"0aad4628-cc79-499b-8e4b-430d1b51eee7","Type":"ContainerStarted","Data":"b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4"}
Sep 11 14:29:45.746908 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.746877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb" event={"ID":"0aad4628-cc79-499b-8e4b-430d1b51eee7","Type":"ContainerStarted","Data":"2e2341f82189a948ffeba70169f0aad6152091b2dc1e3347220a02b3608630cf"}
Sep 11 14:29:45.791037 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:45.790979    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb" podStartSLOduration=1.790959696 podStartE2EDuration="1.790959696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:45.788368353 +0000 UTC m=+882.419119550" watchObservedRunningTime="2026-09-11 14:29:45.790959696 +0000 UTC m=+882.421710893"
Sep 11 14:29:49.934734 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:49.934698    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88" podUID="d7caae82-dcbc-408c-8822-08b8f9fe0fa0" containerName="main" containerID="cri-o://c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a" gracePeriod=45
Sep 11 14:29:50.172689 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.172665    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:29:50.272628 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.272594    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-dshm\") pod \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") "
Sep 11 14:29:50.272803 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.272671    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-home\") pod \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") "
Sep 11 14:29:50.272803 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.272697    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4rvq\" (UniqueName: \"kubernetes.io/projected/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-kube-api-access-v4rvq\") pod \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") "
Sep 11 14:29:50.272803 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.272734    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-model-cache\") pod \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") "
Sep 11 14:29:50.272803 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.272756    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tls-certs\") pod \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") "
Sep 11 14:29:50.273022 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.272809    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tmp-dir\") pod \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\" (UID: \"d7caae82-dcbc-408c-8822-08b8f9fe0fa0\") "
Sep 11 14:29:50.273022 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.272984    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-home" (OuterVolumeSpecName: "home") pod "d7caae82-dcbc-408c-8822-08b8f9fe0fa0" (UID: "d7caae82-dcbc-408c-8822-08b8f9fe0fa0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:50.273022 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.273003    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-model-cache" (OuterVolumeSpecName: "model-cache") pod "d7caae82-dcbc-408c-8822-08b8f9fe0fa0" (UID: "d7caae82-dcbc-408c-8822-08b8f9fe0fa0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:50.273220 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.273193    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d7caae82-dcbc-408c-8822-08b8f9fe0fa0" (UID: "d7caae82-dcbc-408c-8822-08b8f9fe0fa0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:50.274764 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.274740    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-dshm" (OuterVolumeSpecName: "dshm") pod "d7caae82-dcbc-408c-8822-08b8f9fe0fa0" (UID: "d7caae82-dcbc-408c-8822-08b8f9fe0fa0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:29:50.274875 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.274783    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-kube-api-access-v4rvq" (OuterVolumeSpecName: "kube-api-access-v4rvq") pod "d7caae82-dcbc-408c-8822-08b8f9fe0fa0" (UID: "d7caae82-dcbc-408c-8822-08b8f9fe0fa0"). InnerVolumeSpecName "kube-api-access-v4rvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:50.274919 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.274867    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d7caae82-dcbc-408c-8822-08b8f9fe0fa0" (UID: "d7caae82-dcbc-408c-8822-08b8f9fe0fa0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:29:50.373346 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.373317    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-home\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:50.373346 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.373342    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4rvq\" (UniqueName: \"kubernetes.io/projected/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-kube-api-access-v4rvq\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:50.373484 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.373353    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-model-cache\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:50.373484 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.373362    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tls-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:50.373484 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.373371    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-tmp-dir\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:50.373484 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.373378    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7caae82-dcbc-408c-8822-08b8f9fe0fa0-dshm\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:50.776755 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.776713    2581 generic.go:356] "Generic (PLEG): container finished" podID="d7caae82-dcbc-408c-8822-08b8f9fe0fa0" containerID="c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a" exitCode=0
Sep 11 14:29:50.776935 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.776798    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88" event={"ID":"d7caae82-dcbc-408c-8822-08b8f9fe0fa0","Type":"ContainerDied","Data":"c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a"}
Sep 11 14:29:50.776935 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.776834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88" event={"ID":"d7caae82-dcbc-408c-8822-08b8f9fe0fa0","Type":"ContainerDied","Data":"f7a604b1b9a2f50aedaf871ea215189a8d25da6daf85c8ad0baecb452d8b185b"}
Sep 11 14:29:50.776935 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.776866    2581 scope.go:117] "RemoveContainer" containerID="c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a"
Sep 11 14:29:50.777101 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.777058    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"
Sep 11 14:29:50.789057 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.789036    2581 scope.go:117] "RemoveContainer" containerID="c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a"
Sep 11 14:29:50.789413 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:29:50.789391    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a\": container with ID starting with c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a not found: ID does not exist" containerID="c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a"
Sep 11 14:29:50.789475 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.789421    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a"} err="failed to get container status \"c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a\": rpc error: code = NotFound desc = could not find container \"c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a\": container with ID starting with c7cc87c6e6c1224a52a7b683741cab67190872eaa57bf4fcb592edaddff3742a not found: ID does not exist"
Sep 11 14:29:50.822315 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.822284    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"]
Sep 11 14:29:50.827935 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:50.827910    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-422801d9-kserve-6cbb4d6c49-jbm88"]
Sep 11 14:29:51.562678 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.562647    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"]
Sep 11 14:29:51.563169 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.562999    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7caae82-dcbc-408c-8822-08b8f9fe0fa0" containerName="main"
Sep 11 14:29:51.563169 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.563014    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7caae82-dcbc-408c-8822-08b8f9fe0fa0" containerName="main"
Sep 11 14:29:51.563169 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.563073    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7caae82-dcbc-408c-8822-08b8f9fe0fa0" containerName="main"
Sep 11 14:29:51.567058 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.567029    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.569374 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.569353    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-696fee-serving-cert\""
Sep 11 14:29:51.579719 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.579696    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"]
Sep 11 14:29:51.583277 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.583253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-maas-api-tls\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.583377 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.583337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d8n7\" (UniqueName: \"kubernetes.io/projected/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-kube-api-access-2d8n7\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.583426 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.583403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-metrics-certs\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.583462 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.583426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-openshift-service-ca\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.684575 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.684545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d8n7\" (UniqueName: \"kubernetes.io/projected/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-kube-api-access-2d8n7\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.684731 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.684596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-metrics-certs\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.684731 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.684627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-openshift-service-ca\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.684731 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.684673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-maas-api-tls\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.684907 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:29:51.684825    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-serving-cert: secret "maas-api-e2e-explicit-696fee-serving-cert" not found
Sep 11 14:29:51.684964 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:29:51.684912    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-maas-api-tls podName:54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4 nodeName:}" failed. No retries permitted until 2026-09-11 14:29:52.184890565 +0000 UTC m=+888.815641753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-maas-api-tls") pod "maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll" (UID: "54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4") : secret "maas-api-e2e-explicit-696fee-serving-cert" not found
Sep 11 14:29:51.685405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.685387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-openshift-service-ca\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.687058 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.687026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-metrics-certs\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.695431 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.695409    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d8n7\" (UniqueName: \"kubernetes.io/projected/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-kube-api-access-2d8n7\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:51.859611 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:51.859538    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7caae82-dcbc-408c-8822-08b8f9fe0fa0" path="/var/lib/kubelet/pods/d7caae82-dcbc-408c-8822-08b8f9fe0fa0/volumes"
Sep 11 14:29:52.189231 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:52.189198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-maas-api-tls\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:52.191603 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:52.191581    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-maas-api-tls\") pod \"maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:52.478936 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:52.478859    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:52.755352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:52.755305    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"]
Sep 11 14:29:52.757589 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:29:52.757560    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54eaa23d_038e_40fa_ab6a_0cf4d7aab6f4.slice/crio-522e499b5c902d107666de186f8cca3282cc836516327aa8cb36bab9e640795e WatchSource:0}: Error finding container 522e499b5c902d107666de186f8cca3282cc836516327aa8cb36bab9e640795e: Status 404 returned error can't find the container with id 522e499b5c902d107666de186f8cca3282cc836516327aa8cb36bab9e640795e
Sep 11 14:29:52.790276 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:52.790244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll" event={"ID":"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4","Type":"ContainerStarted","Data":"522e499b5c902d107666de186f8cca3282cc836516327aa8cb36bab9e640795e"}
Sep 11 14:29:53.060258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.060174    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"]
Sep 11 14:29:53.060449 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.060403    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk" podUID="e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8" containerName="maas-api" containerID="cri-o://0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0" gracePeriod=30
Sep 11 14:29:53.315440 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.315386    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:53.399062 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.399033    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-metrics-certs\") pod \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") "
Sep 11 14:29:53.399260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.399081    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqfdv\" (UniqueName: \"kubernetes.io/projected/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-kube-api-access-bqfdv\") pod \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") "
Sep 11 14:29:53.399260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.399209    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-openshift-service-ca\") pod \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") "
Sep 11 14:29:53.399260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.399225    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-maas-api-tls\") pod \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\" (UID: \"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8\") "
Sep 11 14:29:53.399588 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.399561    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8" (UID: "e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:29:53.401392 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.401360    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8" (UID: "e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:29:53.401392 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.401384    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8" (UID: "e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:29:53.401572 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.401445    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-kube-api-access-bqfdv" (OuterVolumeSpecName: "kube-api-access-bqfdv") pod "e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8" (UID: "e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8"). InnerVolumeSpecName "kube-api-access-bqfdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:29:53.500185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.500136    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:53.500185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.500174    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:53.500185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.500183    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:53.500185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.500191    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqfdv\" (UniqueName: \"kubernetes.io/projected/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8-kube-api-access-bqfdv\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:29:53.799373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.799341    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll" event={"ID":"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4","Type":"ContainerStarted","Data":"a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346"}
Sep 11 14:29:53.799785 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.799399    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:29:53.800614 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.800589    2581 generic.go:356] "Generic (PLEG): container finished" podID="e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8" containerID="0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0" exitCode=0
Sep 11 14:29:53.800696 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.800631    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"
Sep 11 14:29:53.800696 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.800641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk" event={"ID":"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8","Type":"ContainerDied","Data":"0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0"}
Sep 11 14:29:53.800777 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.800696    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk" event={"ID":"e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8","Type":"ContainerDied","Data":"ddfa4cb6b511fd01d4c05ec4b3d9a430f8c845eff8808442a8d6bf3d6ea1bc28"}
Sep 11 14:29:53.800777 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.800726    2581 scope.go:117] "RemoveContainer" containerID="0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0"
Sep 11 14:29:53.810277 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.810259    2581 scope.go:117] "RemoveContainer" containerID="0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0"
Sep 11 14:29:53.810686 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:29:53.810662    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0\": container with ID starting with 0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0 not found: ID does not exist" containerID="0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0"
Sep 11 14:29:53.810779 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.810697    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0"} err="failed to get container status \"0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0\": rpc error: code = NotFound desc = could not find container \"0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0\": container with ID starting with 0d813eec43081a396735e82a7729c3d418ed84a1405e41b677e6810672a5cdf0 not found: ID does not exist"
Sep 11 14:29:53.822371 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.822331    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll" podStartSLOduration=2.5104834499999997 podStartE2EDuration="2.822316288s" totalImagesPullingTime="311.832838ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:53.820712648 +0000 UTC m=+890.451463848" watchObservedRunningTime="2026-09-11 14:29:53.822316288 +0000 UTC m=+890.453067505"
Sep 11 14:29:53.837657 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.837635    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"]
Sep 11 14:29:53.841907 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.841883    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0010444-5b6848d9dd-wc8jk"]
Sep 11 14:29:53.858831 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:53.858810    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8" path="/var/lib/kubelet/pods/e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8/volumes"
Sep 11 14:29:55.092267 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:55.092217    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:55.092739 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:55.092299    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:55.104551 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:55.104528    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:55.829066 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:55.829042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:29:59.817557 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:29:59.817479    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:30:03.834622 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:03.834592    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:30:03.837457 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:03.837435    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:30:50.340508 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.340461    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"]
Sep 11 14:30:50.341034 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.340716    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll" podUID="54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4" containerName="maas-api" containerID="cri-o://a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346" gracePeriod=30
Sep 11 14:30:50.587061 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.587037    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:30:50.689009 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.688986    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-maas-api-tls\") pod \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") "
Sep 11 14:30:50.689203 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.689019    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-openshift-service-ca\") pod \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") "
Sep 11 14:30:50.689203 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.689065    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d8n7\" (UniqueName: \"kubernetes.io/projected/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-kube-api-access-2d8n7\") pod \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") "
Sep 11 14:30:50.689203 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.689118    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-metrics-certs\") pod \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\" (UID: \"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4\") "
Sep 11 14:30:50.689503 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.689463    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4" (UID: "54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:30:50.691000 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.690973    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4" (UID: "54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:30:50.691161 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.691123    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4" (UID: "54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:30:50.691161 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.691135    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-kube-api-access-2d8n7" (OuterVolumeSpecName: "kube-api-access-2d8n7") pod "54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4" (UID: "54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4"). InnerVolumeSpecName "kube-api-access-2d8n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:30:50.789961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.789928    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d8n7\" (UniqueName: \"kubernetes.io/projected/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-kube-api-access-2d8n7\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:30:50.789961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.789955    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:30:50.789961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.789967    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:30:50.790202 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:50.789975    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:30:51.080516 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:51.080441    2581 generic.go:356] "Generic (PLEG): container finished" podID="54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4" containerID="a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346" exitCode=0
Sep 11 14:30:51.080516 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:51.080486    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"
Sep 11 14:30:51.080756 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:51.080490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll" event={"ID":"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4","Type":"ContainerDied","Data":"a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346"}
Sep 11 14:30:51.080756 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:51.080639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll" event={"ID":"54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4","Type":"ContainerDied","Data":"522e499b5c902d107666de186f8cca3282cc836516327aa8cb36bab9e640795e"}
Sep 11 14:30:51.080756 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:51.080676    2581 scope.go:117] "RemoveContainer" containerID="a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346"
Sep 11 14:30:51.089855 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:51.089837    2581 scope.go:117] "RemoveContainer" containerID="a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346"
Sep 11 14:30:51.090090 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:30:51.090074    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346\": container with ID starting with a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346 not found: ID does not exist" containerID="a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346"
Sep 11 14:30:51.090161 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:51.090097    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346"} err="failed to get container status \"a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346\": rpc error: code = NotFound desc = could not find container \"a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346\": container with ID starting with a7d5f834749de104b1e59d063fc12ed2d3aa548dd9190ceab5ef6c8fe4850346 not found: ID does not exist"
Sep 11 14:30:51.116933 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:51.116912    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"]
Sep 11 14:30:51.131580 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:51.131563    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-696fee-6b57bc97b5-bz5ll"]
Sep 11 14:30:51.860352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:30:51.860308    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4" path="/var/lib/kubelet/pods/54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4/volumes"
Sep 11 14:31:26.254604 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:26.254573    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"]
Sep 11 14:31:37.021346 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.021308    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"]
Sep 11 14:31:37.021728 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.021526    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2" podUID="5298e935-0b0e-4678-ac18-47e5d7c38376" containerName="maas-api" containerID="cri-o://f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8" gracePeriod=30
Sep 11 14:31:37.293526 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.293499    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:31:37.301621 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.301587    2581 generic.go:356] "Generic (PLEG): container finished" podID="5298e935-0b0e-4678-ac18-47e5d7c38376" containerID="f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8" exitCode=0
Sep 11 14:31:37.301767 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.301629    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"
Sep 11 14:31:37.301767 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.301664    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2" event={"ID":"5298e935-0b0e-4678-ac18-47e5d7c38376","Type":"ContainerDied","Data":"f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8"}
Sep 11 14:31:37.301767 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.301740    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2" event={"ID":"5298e935-0b0e-4678-ac18-47e5d7c38376","Type":"ContainerDied","Data":"facfd4f2a37e49c1b93c43db2a40ae82d07803576b09ee99ed3d7ae5c1238a95"}
Sep 11 14:31:37.301767 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.301764    2581 scope.go:117] "RemoveContainer" containerID="f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8"
Sep 11 14:31:37.309919 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.309898    2581 scope.go:117] "RemoveContainer" containerID="f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8"
Sep 11 14:31:37.310214 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:31:37.310189    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8\": container with ID starting with f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8 not found: ID does not exist" containerID="f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8"
Sep 11 14:31:37.310325 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.310223    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8"} err="failed to get container status \"f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8\": rpc error: code = NotFound desc = could not find container \"f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8\": container with ID starting with f610a19d3fad9ee56e132b1478b1104c52907063bf6d5f9ab7cae080ecd4dac8 not found: ID does not exist"
Sep 11 14:31:37.401293 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.401254    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-maas-api-tls\") pod \"5298e935-0b0e-4678-ac18-47e5d7c38376\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") "
Sep 11 14:31:37.401499 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.401331    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5298e935-0b0e-4678-ac18-47e5d7c38376-openshift-service-ca\") pod \"5298e935-0b0e-4678-ac18-47e5d7c38376\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") "
Sep 11 14:31:37.401499 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.401375    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq9nc\" (UniqueName: \"kubernetes.io/projected/5298e935-0b0e-4678-ac18-47e5d7c38376-kube-api-access-cq9nc\") pod \"5298e935-0b0e-4678-ac18-47e5d7c38376\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") "
Sep 11 14:31:37.401499 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.401409    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-metrics-certs\") pod \"5298e935-0b0e-4678-ac18-47e5d7c38376\" (UID: \"5298e935-0b0e-4678-ac18-47e5d7c38376\") "
Sep 11 14:31:37.401733 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.401705    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5298e935-0b0e-4678-ac18-47e5d7c38376-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5298e935-0b0e-4678-ac18-47e5d7c38376" (UID: "5298e935-0b0e-4678-ac18-47e5d7c38376"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:31:37.403579 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.403546    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5298e935-0b0e-4678-ac18-47e5d7c38376" (UID: "5298e935-0b0e-4678-ac18-47e5d7c38376"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:31:37.403704 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.403586    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5298e935-0b0e-4678-ac18-47e5d7c38376-kube-api-access-cq9nc" (OuterVolumeSpecName: "kube-api-access-cq9nc") pod "5298e935-0b0e-4678-ac18-47e5d7c38376" (UID: "5298e935-0b0e-4678-ac18-47e5d7c38376"). InnerVolumeSpecName "kube-api-access-cq9nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:31:37.403704 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.403640    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5298e935-0b0e-4678-ac18-47e5d7c38376" (UID: "5298e935-0b0e-4678-ac18-47e5d7c38376"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:31:37.502419 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.502381    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:37.502419 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.502412    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5298e935-0b0e-4678-ac18-47e5d7c38376-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:37.502419 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.502422    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq9nc\" (UniqueName: \"kubernetes.io/projected/5298e935-0b0e-4678-ac18-47e5d7c38376-kube-api-access-cq9nc\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:37.502419 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.502430    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298e935-0b0e-4678-ac18-47e5d7c38376-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:37.640688 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.640657    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"]
Sep 11 14:31:37.649430 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.649401    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a39864-55488b9cbb-zscj2"]
Sep 11 14:31:37.858618 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:37.858583    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5298e935-0b0e-4678-ac18-47e5d7c38376" path="/var/lib/kubelet/pods/5298e935-0b0e-4678-ac18-47e5d7c38376/volumes"
Sep 11 14:31:40.494886 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.494850    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"]
Sep 11 14:31:40.495271 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.495195    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8" containerName="maas-api"
Sep 11 14:31:40.495271 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.495206    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8" containerName="maas-api"
Sep 11 14:31:40.495271 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.495217    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5298e935-0b0e-4678-ac18-47e5d7c38376" containerName="maas-api"
Sep 11 14:31:40.495271 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.495222    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5298e935-0b0e-4678-ac18-47e5d7c38376" containerName="maas-api"
Sep 11 14:31:40.495271 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.495230    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4" containerName="maas-api"
Sep 11 14:31:40.495271 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.495236    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4" containerName="maas-api"
Sep 11 14:31:40.495495 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.495285    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="54eaa23d-038e-40fa-ab6a-0cf4d7aab6f4" containerName="maas-api"
Sep 11 14:31:40.495495 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.495293    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e816528e-b8f5-4f7d-8e7d-d5e3c9d43ef8" containerName="maas-api"
Sep 11 14:31:40.495495 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.495301    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5298e935-0b0e-4678-ac18-47e5d7c38376" containerName="maas-api"
Sep 11 14:31:40.499511 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.499489    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.502923 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.502903    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-02723795-serving-cert\""
Sep 11 14:31:40.513416 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.513393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"]
Sep 11 14:31:40.625778 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.625748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-maas-api-tls\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.625944 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.625784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-metrics-certs\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.625944 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.625826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4ea004-e084-4f59-a8fe-97520f5746c0-openshift-service-ca\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.625944 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.625869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zbkn\" (UniqueName: \"kubernetes.io/projected/be4ea004-e084-4f59-a8fe-97520f5746c0-kube-api-access-7zbkn\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.726970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.726943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-maas-api-tls\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.726970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.726975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-metrics-certs\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.727210 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.727015    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4ea004-e084-4f59-a8fe-97520f5746c0-openshift-service-ca\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.727210 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.727072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zbkn\" (UniqueName: \"kubernetes.io/projected/be4ea004-e084-4f59-a8fe-97520f5746c0-kube-api-access-7zbkn\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.727732 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.727703    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4ea004-e084-4f59-a8fe-97520f5746c0-openshift-service-ca\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.729351 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.729330    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-metrics-certs\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.729437 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.729403    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-maas-api-tls\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.736278 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.736256    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zbkn\" (UniqueName: \"kubernetes.io/projected/be4ea004-e084-4f59-a8fe-97520f5746c0-kube-api-access-7zbkn\") pod \"maas-api-e2e-mt-02723795-5c989d647b-9nnbw\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:40.810292 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:40.810187    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:41.092091 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.091953    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"]
Sep 11 14:31:41.094857 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:31:41.094807    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4ea004_e084_4f59_a8fe_97520f5746c0.slice/crio-2bd3b452b793e74ebf795c6a7ca1b4ba1f306d6688201c63cf2d7666d853e745 WatchSource:0}: Error finding container 2bd3b452b793e74ebf795c6a7ca1b4ba1f306d6688201c63cf2d7666d853e745: Status 404 returned error can't find the container with id 2bd3b452b793e74ebf795c6a7ca1b4ba1f306d6688201c63cf2d7666d853e745
Sep 11 14:31:41.100612 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.100584    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:31:41.273285 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.273239    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb" podUID="0aad4628-cc79-499b-8e4b-430d1b51eee7" containerName="main" containerID="cri-o://b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4" gracePeriod=45
Sep 11 14:31:41.323798 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.323765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw" event={"ID":"be4ea004-e084-4f59-a8fe-97520f5746c0","Type":"ContainerStarted","Data":"2bd3b452b793e74ebf795c6a7ca1b4ba1f306d6688201c63cf2d7666d853e745"}
Sep 11 14:31:41.508324 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.508301    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:31:41.634622 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.634589    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-model-cache\") pod \"0aad4628-cc79-499b-8e4b-430d1b51eee7\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") "
Sep 11 14:31:41.634774 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.634639    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-dshm\") pod \"0aad4628-cc79-499b-8e4b-430d1b51eee7\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") "
Sep 11 14:31:41.634774 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.634667    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-tmp-dir\") pod \"0aad4628-cc79-499b-8e4b-430d1b51eee7\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") "
Sep 11 14:31:41.634774 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.634698    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbh7v\" (UniqueName: \"kubernetes.io/projected/0aad4628-cc79-499b-8e4b-430d1b51eee7-kube-api-access-vbh7v\") pod \"0aad4628-cc79-499b-8e4b-430d1b51eee7\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") "
Sep 11 14:31:41.634774 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.634720    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0aad4628-cc79-499b-8e4b-430d1b51eee7-tls-certs\") pod \"0aad4628-cc79-499b-8e4b-430d1b51eee7\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") "
Sep 11 14:31:41.634985 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.634775    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-home\") pod \"0aad4628-cc79-499b-8e4b-430d1b51eee7\" (UID: \"0aad4628-cc79-499b-8e4b-430d1b51eee7\") "
Sep 11 14:31:41.634985 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.634937    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0aad4628-cc79-499b-8e4b-430d1b51eee7" (UID: "0aad4628-cc79-499b-8e4b-430d1b51eee7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:31:41.635175 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.635133    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-tmp-dir\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:41.635260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.635191    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-home" (OuterVolumeSpecName: "home") pod "0aad4628-cc79-499b-8e4b-430d1b51eee7" (UID: "0aad4628-cc79-499b-8e4b-430d1b51eee7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:31:41.635260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.635237    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-model-cache" (OuterVolumeSpecName: "model-cache") pod "0aad4628-cc79-499b-8e4b-430d1b51eee7" (UID: "0aad4628-cc79-499b-8e4b-430d1b51eee7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:31:41.637101 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.637073    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aad4628-cc79-499b-8e4b-430d1b51eee7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0aad4628-cc79-499b-8e4b-430d1b51eee7" (UID: "0aad4628-cc79-499b-8e4b-430d1b51eee7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:31:41.637232 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.637127    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aad4628-cc79-499b-8e4b-430d1b51eee7-kube-api-access-vbh7v" (OuterVolumeSpecName: "kube-api-access-vbh7v") pod "0aad4628-cc79-499b-8e4b-430d1b51eee7" (UID: "0aad4628-cc79-499b-8e4b-430d1b51eee7"). InnerVolumeSpecName "kube-api-access-vbh7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:31:41.637299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.637251    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-dshm" (OuterVolumeSpecName: "dshm") pod "0aad4628-cc79-499b-8e4b-430d1b51eee7" (UID: "0aad4628-cc79-499b-8e4b-430d1b51eee7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:31:41.736388 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.736357    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-dshm\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:41.736540 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.736392    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbh7v\" (UniqueName: \"kubernetes.io/projected/0aad4628-cc79-499b-8e4b-430d1b51eee7-kube-api-access-vbh7v\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:41.736540 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.736407    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0aad4628-cc79-499b-8e4b-430d1b51eee7-tls-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:41.736540 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.736420    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-home\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:41.736540 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:41.736431    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0aad4628-cc79-499b-8e4b-430d1b51eee7-model-cache\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:42.329214 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.329177    2581 generic.go:356] "Generic (PLEG): container finished" podID="0aad4628-cc79-499b-8e4b-430d1b51eee7" containerID="b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4" exitCode=0
Sep 11 14:31:42.329214 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.329223    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"
Sep 11 14:31:42.329561 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.329258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb" event={"ID":"0aad4628-cc79-499b-8e4b-430d1b51eee7","Type":"ContainerDied","Data":"b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4"}
Sep 11 14:31:42.329561 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.329297    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb" event={"ID":"0aad4628-cc79-499b-8e4b-430d1b51eee7","Type":"ContainerDied","Data":"2e2341f82189a948ffeba70169f0aad6152091b2dc1e3347220a02b3608630cf"}
Sep 11 14:31:42.329561 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.329320    2581 scope.go:117] "RemoveContainer" containerID="b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4"
Sep 11 14:31:42.331202 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.331173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw" event={"ID":"be4ea004-e084-4f59-a8fe-97520f5746c0","Type":"ContainerStarted","Data":"ad486047c43a6f291d105523941e083da5faa61a120c2e243c6cdc8a18f163e5"}
Sep 11 14:31:42.331339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.331309    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:42.338185 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.338170    2581 scope.go:117] "RemoveContainer" containerID="b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4"
Sep 11 14:31:42.338463 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:31:42.338446    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4\": container with ID starting with b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4 not found: ID does not exist" containerID="b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4"
Sep 11 14:31:42.338538 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.338470    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4"} err="failed to get container status \"b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4\": rpc error: code = NotFound desc = could not find container \"b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4\": container with ID starting with b16b1d634e10b2135ecae3f29278e1477c42838ae4797a557c82616e01140ac4 not found: ID does not exist"
Sep 11 14:31:42.354941 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.354903    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"]
Sep 11 14:31:42.357229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.357200    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b6b864/test-model-b6b864-kserve-9d7dcdc8f-p2ssb"]
Sep 11 14:31:42.386197 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:42.386110    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw" podStartSLOduration=1.979167661 podStartE2EDuration="2.386093061s" totalImagesPullingTime="406.9254ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:31:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:31:42.382969825 +0000 UTC m=+999.013721020" watchObservedRunningTime="2026-09-11 14:31:42.386093061 +0000 UTC m=+999.016844257"
Sep 11 14:31:43.859312 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:43.859275    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aad4628-cc79-499b-8e4b-430d1b51eee7" path="/var/lib/kubelet/pods/0aad4628-cc79-499b-8e4b-430d1b51eee7/volumes"
Sep 11 14:31:48.343347 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:48.343317    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:31:55.711620 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:55.711586    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"]
Sep 11 14:31:55.712043 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:55.711813    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5" podUID="66a2e2f8-f7e2-4642-ba13-c273501345e5" containerName="maas-api" containerID="cri-o://4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d" gracePeriod=30
Sep 11 14:31:55.814832 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:55.814793    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"]
Sep 11 14:31:55.815044 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:55.815019    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc" podUID="a806cb50-27d9-4917-a7ed-f100a73d42f7" containerName="payload-pre-processing" containerID="cri-o://89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576" gracePeriod=30
Sep 11 14:31:55.963028 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:55.962887    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:31:56.066542 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.066513    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-maas-api-tls\") pod \"66a2e2f8-f7e2-4642-ba13-c273501345e5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") "
Sep 11 14:31:56.066676 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.066604    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hws9g\" (UniqueName: \"kubernetes.io/projected/66a2e2f8-f7e2-4642-ba13-c273501345e5-kube-api-access-hws9g\") pod \"66a2e2f8-f7e2-4642-ba13-c273501345e5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") "
Sep 11 14:31:56.066676 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.066657    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66a2e2f8-f7e2-4642-ba13-c273501345e5-openshift-service-ca\") pod \"66a2e2f8-f7e2-4642-ba13-c273501345e5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") "
Sep 11 14:31:56.066772 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.066690    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-metrics-certs\") pod \"66a2e2f8-f7e2-4642-ba13-c273501345e5\" (UID: \"66a2e2f8-f7e2-4642-ba13-c273501345e5\") "
Sep 11 14:31:56.067071 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.067038    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66a2e2f8-f7e2-4642-ba13-c273501345e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "66a2e2f8-f7e2-4642-ba13-c273501345e5" (UID: "66a2e2f8-f7e2-4642-ba13-c273501345e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:31:56.068678 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.068652    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "66a2e2f8-f7e2-4642-ba13-c273501345e5" (UID: "66a2e2f8-f7e2-4642-ba13-c273501345e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:31:56.068777 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.068754    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66a2e2f8-f7e2-4642-ba13-c273501345e5-kube-api-access-hws9g" (OuterVolumeSpecName: "kube-api-access-hws9g") pod "66a2e2f8-f7e2-4642-ba13-c273501345e5" (UID: "66a2e2f8-f7e2-4642-ba13-c273501345e5"). InnerVolumeSpecName "kube-api-access-hws9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:31:56.068858 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.068837    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "66a2e2f8-f7e2-4642-ba13-c273501345e5" (UID: "66a2e2f8-f7e2-4642-ba13-c273501345e5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:31:56.070884 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.070865    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:31:56.168165 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.168112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq9lr\" (UniqueName: \"kubernetes.io/projected/a806cb50-27d9-4917-a7ed-f100a73d42f7-kube-api-access-zq9lr\") pod \"a806cb50-27d9-4917-a7ed-f100a73d42f7\" (UID: \"a806cb50-27d9-4917-a7ed-f100a73d42f7\") "
Sep 11 14:31:56.168346 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.168198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a806cb50-27d9-4917-a7ed-f100a73d42f7-plugins-config-volume\") pod \"a806cb50-27d9-4917-a7ed-f100a73d42f7\" (UID: \"a806cb50-27d9-4917-a7ed-f100a73d42f7\") "
Sep 11 14:31:56.168436 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.168418    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66a2e2f8-f7e2-4642-ba13-c273501345e5-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:56.168498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.168442    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:56.168498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.168456    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66a2e2f8-f7e2-4642-ba13-c273501345e5-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:56.168498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.168469    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hws9g\" (UniqueName: \"kubernetes.io/projected/66a2e2f8-f7e2-4642-ba13-c273501345e5-kube-api-access-hws9g\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:56.168598 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.168557    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a806cb50-27d9-4917-a7ed-f100a73d42f7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a806cb50-27d9-4917-a7ed-f100a73d42f7" (UID: "a806cb50-27d9-4917-a7ed-f100a73d42f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:31:56.170198 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.170176    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a806cb50-27d9-4917-a7ed-f100a73d42f7-kube-api-access-zq9lr" (OuterVolumeSpecName: "kube-api-access-zq9lr") pod "a806cb50-27d9-4917-a7ed-f100a73d42f7" (UID: "a806cb50-27d9-4917-a7ed-f100a73d42f7"). InnerVolumeSpecName "kube-api-access-zq9lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:31:56.269759 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.269699    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq9lr\" (UniqueName: \"kubernetes.io/projected/a806cb50-27d9-4917-a7ed-f100a73d42f7-kube-api-access-zq9lr\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:56.269759 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.269723    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a806cb50-27d9-4917-a7ed-f100a73d42f7-plugins-config-volume\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:31:56.401783 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.401752    2581 generic.go:356] "Generic (PLEG): container finished" podID="a806cb50-27d9-4917-a7ed-f100a73d42f7" containerID="89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576" exitCode=0
Sep 11 14:31:56.401914 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.401790    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"
Sep 11 14:31:56.401914 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.401835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc" event={"ID":"a806cb50-27d9-4917-a7ed-f100a73d42f7","Type":"ContainerDied","Data":"89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576"}
Sep 11 14:31:56.401914 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.401893    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc" event={"ID":"a806cb50-27d9-4917-a7ed-f100a73d42f7","Type":"ContainerDied","Data":"0eeb1490ffcd793594cf733e226fbf469835857b51166f517dd0e57b0909fbd8"}
Sep 11 14:31:56.402061 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.401923    2581 scope.go:117] "RemoveContainer" containerID="89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576"
Sep 11 14:31:56.403189 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.403165    2581 generic.go:356] "Generic (PLEG): container finished" podID="66a2e2f8-f7e2-4642-ba13-c273501345e5" containerID="4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d" exitCode=0
Sep 11 14:31:56.403299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.403198    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"
Sep 11 14:31:56.403299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.403218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5" event={"ID":"66a2e2f8-f7e2-4642-ba13-c273501345e5","Type":"ContainerDied","Data":"4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d"}
Sep 11 14:31:56.403299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.403258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5" event={"ID":"66a2e2f8-f7e2-4642-ba13-c273501345e5","Type":"ContainerDied","Data":"9fd9c95c16d995f65d87559f57d6c974217ff36d76785e253a01eff0766ddea8"}
Sep 11 14:31:56.414036 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.414001    2581 scope.go:117] "RemoveContainer" containerID="89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576"
Sep 11 14:31:56.414806 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:31:56.414781    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576\": container with ID starting with 89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576 not found: ID does not exist" containerID="89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576"
Sep 11 14:31:56.414898 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.414815    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576"} err="failed to get container status \"89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576\": rpc error: code = NotFound desc = could not find container \"89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576\": container with ID starting with 89717b5c67a36176502f564daa506e507b3778c450627b935d3023d135928576 not found: ID does not exist"
Sep 11 14:31:56.414898 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.414838    2581 scope.go:117] "RemoveContainer" containerID="4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d"
Sep 11 14:31:56.422571 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.422547    2581 scope.go:117] "RemoveContainer" containerID="4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d"
Sep 11 14:31:56.422921 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:31:56.422849    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d\": container with ID starting with 4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d not found: ID does not exist" containerID="4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d"
Sep 11 14:31:56.422921 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.422889    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d"} err="failed to get container status \"4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d\": rpc error: code = NotFound desc = could not find container \"4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d\": container with ID starting with 4e6c99be1c91aa26db17050c25e0241f255041f23fcf4dbcda2c0fdbcbebb36d not found: ID does not exist"
Sep 11 14:31:56.424851 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.424833    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"]
Sep 11 14:31:56.428864 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.428842    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-b6b864-56d94ffbf8-c8rjc"]
Sep 11 14:31:56.440200 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.440182    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"]
Sep 11 14:31:56.443951 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:56.443932    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b864-74d4577cdb-h5tl5"]
Sep 11 14:31:57.858856 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:57.858822    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66a2e2f8-f7e2-4642-ba13-c273501345e5" path="/var/lib/kubelet/pods/66a2e2f8-f7e2-4642-ba13-c273501345e5/volumes"
Sep 11 14:31:57.859329 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:31:57.859177    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a806cb50-27d9-4917-a7ed-f100a73d42f7" path="/var/lib/kubelet/pods/a806cb50-27d9-4917-a7ed-f100a73d42f7/volumes"
Sep 11 14:32:09.581406 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.581363    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"]
Sep 11 14:32:09.581911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.581841    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a806cb50-27d9-4917-a7ed-f100a73d42f7" containerName="payload-pre-processing"
Sep 11 14:32:09.581911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.581860    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a806cb50-27d9-4917-a7ed-f100a73d42f7" containerName="payload-pre-processing"
Sep 11 14:32:09.581911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.581887    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aad4628-cc79-499b-8e4b-430d1b51eee7" containerName="main"
Sep 11 14:32:09.581911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.581896    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aad4628-cc79-499b-8e4b-430d1b51eee7" containerName="main"
Sep 11 14:32:09.581911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.581909    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66a2e2f8-f7e2-4642-ba13-c273501345e5" containerName="maas-api"
Sep 11 14:32:09.582184 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.581918    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="66a2e2f8-f7e2-4642-ba13-c273501345e5" containerName="maas-api"
Sep 11 14:32:09.582184 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.582017    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="66a2e2f8-f7e2-4642-ba13-c273501345e5" containerName="maas-api"
Sep 11 14:32:09.582184 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.582030    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a806cb50-27d9-4917-a7ed-f100a73d42f7" containerName="payload-pre-processing"
Sep 11 14:32:09.582184 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.582043    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aad4628-cc79-499b-8e4b-430d1b51eee7" containerName="main"
Sep 11 14:32:09.586226 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.586205    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.589031 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.589014    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-72e046-serving-cert\""
Sep 11 14:32:09.601348 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.601327    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"]
Sep 11 14:32:09.780726 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.780695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.780911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.780770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkd89\" (UniqueName: \"kubernetes.io/projected/570ebffe-17b4-442e-af27-df1d3e7f8edd-kube-api-access-hkd89\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.780911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.780801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/570ebffe-17b4-442e-af27-df1d3e7f8edd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.780911 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.780848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.882051 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.881965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.882051 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.882023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkd89\" (UniqueName: \"kubernetes.io/projected/570ebffe-17b4-442e-af27-df1d3e7f8edd-kube-api-access-hkd89\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.882051 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.882042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/570ebffe-17b4-442e-af27-df1d3e7f8edd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.882361 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.882070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.882744 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.882724    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/570ebffe-17b4-442e-af27-df1d3e7f8edd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.884450 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.884427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.884550 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.884475    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.893255 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.893231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkd89\" (UniqueName: \"kubernetes.io/projected/570ebffe-17b4-442e-af27-df1d3e7f8edd-kube-api-access-hkd89\") pod \"maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:09.897069 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:09.897048    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:10.168594 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.168556    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"]
Sep 11 14:32:10.170412 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:32:10.170383    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570ebffe_17b4_442e_af27_df1d3e7f8edd.slice/crio-aba88846f756eee209de0f86c0126838aedab1eed9866940a193f12b669921b6 WatchSource:0}: Error finding container aba88846f756eee209de0f86c0126838aedab1eed9866940a193f12b669921b6: Status 404 returned error can't find the container with id aba88846f756eee209de0f86c0126838aedab1eed9866940a193f12b669921b6
Sep 11 14:32:10.305712 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.305679    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"]
Sep 11 14:32:10.310064 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.310042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:32:10.313610 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.313589    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-72e046-dockercfg-8l8xd\""
Sep 11 14:32:10.313720 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.313625    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-72e046\""
Sep 11 14:32:10.321672 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.321651    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"]
Sep 11 14:32:10.470166 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.470113    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz" event={"ID":"570ebffe-17b4-442e-af27-df1d3e7f8edd","Type":"ContainerStarted","Data":"aba88846f756eee209de0f86c0126838aedab1eed9866940a193f12b669921b6"}
Sep 11 14:32:10.488539 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.488511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxppj\" (UniqueName: \"kubernetes.io/projected/2a021e8b-8244-46b7-9500-087271830260-kube-api-access-xxppj\") pod \"payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs\" (UID: \"2a021e8b-8244-46b7-9500-087271830260\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:32:10.488647 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.488549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a021e8b-8244-46b7-9500-087271830260-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs\" (UID: \"2a021e8b-8244-46b7-9500-087271830260\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:32:10.589947 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.589921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxppj\" (UniqueName: \"kubernetes.io/projected/2a021e8b-8244-46b7-9500-087271830260-kube-api-access-xxppj\") pod \"payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs\" (UID: \"2a021e8b-8244-46b7-9500-087271830260\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:32:10.590264 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.589961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a021e8b-8244-46b7-9500-087271830260-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs\" (UID: \"2a021e8b-8244-46b7-9500-087271830260\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:32:10.590743 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.590723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a021e8b-8244-46b7-9500-087271830260-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs\" (UID: \"2a021e8b-8244-46b7-9500-087271830260\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:32:10.598902 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.598883    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxppj\" (UniqueName: \"kubernetes.io/projected/2a021e8b-8244-46b7-9500-087271830260-kube-api-access-xxppj\") pod \"payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs\" (UID: \"2a021e8b-8244-46b7-9500-087271830260\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:32:10.620746 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.620726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:32:10.896286 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:10.896262    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"]
Sep 11 14:32:10.898500 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:32:10.898476    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a021e8b_8244_46b7_9500_087271830260.slice/crio-154225c7fd83dd2634ac61a2a1b677587793562eace1f30ddcb02f4f11f465d5 WatchSource:0}: Error finding container 154225c7fd83dd2634ac61a2a1b677587793562eace1f30ddcb02f4f11f465d5: Status 404 returned error can't find the container with id 154225c7fd83dd2634ac61a2a1b677587793562eace1f30ddcb02f4f11f465d5
Sep 11 14:32:11.476495 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:11.476458    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz" event={"ID":"570ebffe-17b4-442e-af27-df1d3e7f8edd","Type":"ContainerStarted","Data":"e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88"}
Sep 11 14:32:11.476706 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:11.476527    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:11.478059 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:11.478029    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs" event={"ID":"2a021e8b-8244-46b7-9500-087271830260","Type":"ContainerStarted","Data":"aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa"}
Sep 11 14:32:11.478199 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:11.478070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs" event={"ID":"2a021e8b-8244-46b7-9500-087271830260","Type":"ContainerStarted","Data":"154225c7fd83dd2634ac61a2a1b677587793562eace1f30ddcb02f4f11f465d5"}
Sep 11 14:32:11.478199 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:11.478099    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:32:11.498970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:11.498920    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz" podStartSLOduration=2.159540625 podStartE2EDuration="2.498901215s" totalImagesPullingTime="339.36059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:32:11.497422262 +0000 UTC m=+1028.128173481" watchObservedRunningTime="2026-09-11 14:32:11.498901215 +0000 UTC m=+1028.129652413"
Sep 11 14:32:11.517014 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:11.516976    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs" podStartSLOduration=1.516963419 podStartE2EDuration="1.516963419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:32:11.515856191 +0000 UTC m=+1028.146607403" watchObservedRunningTime="2026-09-11 14:32:11.516963419 +0000 UTC m=+1028.147714616"
Sep 11 14:32:17.487884 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:17.487849    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:32:21.297713 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.297680    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"]
Sep 11 14:32:21.298190 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.297919    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw" podUID="be4ea004-e084-4f59-a8fe-97520f5746c0" containerName="maas-api" containerID="cri-o://ad486047c43a6f291d105523941e083da5faa61a120c2e243c6cdc8a18f163e5" gracePeriod=30
Sep 11 14:32:21.525405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.525368    2581 generic.go:356] "Generic (PLEG): container finished" podID="be4ea004-e084-4f59-a8fe-97520f5746c0" containerID="ad486047c43a6f291d105523941e083da5faa61a120c2e243c6cdc8a18f163e5" exitCode=0
Sep 11 14:32:21.525525 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.525447    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw" event={"ID":"be4ea004-e084-4f59-a8fe-97520f5746c0","Type":"ContainerDied","Data":"ad486047c43a6f291d105523941e083da5faa61a120c2e243c6cdc8a18f163e5"}
Sep 11 14:32:21.525525 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.525510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw" event={"ID":"be4ea004-e084-4f59-a8fe-97520f5746c0","Type":"ContainerDied","Data":"2bd3b452b793e74ebf795c6a7ca1b4ba1f306d6688201c63cf2d7666d853e745"}
Sep 11 14:32:21.525615 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.525534    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bd3b452b793e74ebf795c6a7ca1b4ba1f306d6688201c63cf2d7666d853e745"
Sep 11 14:32:21.540225 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.540201    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:32:21.578056 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.577996    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zbkn\" (UniqueName: \"kubernetes.io/projected/be4ea004-e084-4f59-a8fe-97520f5746c0-kube-api-access-7zbkn\") pod \"be4ea004-e084-4f59-a8fe-97520f5746c0\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") "
Sep 11 14:32:21.578056 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.578047    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-metrics-certs\") pod \"be4ea004-e084-4f59-a8fe-97520f5746c0\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") "
Sep 11 14:32:21.578229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.578099    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-maas-api-tls\") pod \"be4ea004-e084-4f59-a8fe-97520f5746c0\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") "
Sep 11 14:32:21.578229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.578126    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4ea004-e084-4f59-a8fe-97520f5746c0-openshift-service-ca\") pod \"be4ea004-e084-4f59-a8fe-97520f5746c0\" (UID: \"be4ea004-e084-4f59-a8fe-97520f5746c0\") "
Sep 11 14:32:21.578549 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.578513    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be4ea004-e084-4f59-a8fe-97520f5746c0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "be4ea004-e084-4f59-a8fe-97520f5746c0" (UID: "be4ea004-e084-4f59-a8fe-97520f5746c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:32:21.580179 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.580130    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "be4ea004-e084-4f59-a8fe-97520f5746c0" (UID: "be4ea004-e084-4f59-a8fe-97520f5746c0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:32:21.580287 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.580175    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "be4ea004-e084-4f59-a8fe-97520f5746c0" (UID: "be4ea004-e084-4f59-a8fe-97520f5746c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:32:21.580335 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.580315    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be4ea004-e084-4f59-a8fe-97520f5746c0-kube-api-access-7zbkn" (OuterVolumeSpecName: "kube-api-access-7zbkn") pod "be4ea004-e084-4f59-a8fe-97520f5746c0" (UID: "be4ea004-e084-4f59-a8fe-97520f5746c0"). InnerVolumeSpecName "kube-api-access-7zbkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:32:21.679426 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.679390    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zbkn\" (UniqueName: \"kubernetes.io/projected/be4ea004-e084-4f59-a8fe-97520f5746c0-kube-api-access-7zbkn\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:32:21.679426 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.679420    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:32:21.679426 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.679434    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4ea004-e084-4f59-a8fe-97520f5746c0-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:32:21.679661 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:21.679446    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4ea004-e084-4f59-a8fe-97520f5746c0-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:32:22.485063 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:22.485031    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:32:22.530963 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:22.530931    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"
Sep 11 14:32:22.554396 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:22.554361    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"]
Sep 11 14:32:22.562691 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:22.562667    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02723795-5c989d647b-9nnbw"]
Sep 11 14:32:23.859123 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:23.859092    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be4ea004-e084-4f59-a8fe-97520f5746c0" path="/var/lib/kubelet/pods/be4ea004-e084-4f59-a8fe-97520f5746c0/volumes"
Sep 11 14:32:33.573778 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.573744    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"]
Sep 11 14:32:33.574449 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.574053    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4ea004-e084-4f59-a8fe-97520f5746c0" containerName="maas-api"
Sep 11 14:32:33.574449 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.574063    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4ea004-e084-4f59-a8fe-97520f5746c0" containerName="maas-api"
Sep 11 14:32:33.574449 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.574131    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4ea004-e084-4f59-a8fe-97520f5746c0" containerName="maas-api"
Sep 11 14:32:33.576785 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.576759    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:33.579730 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.579708    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-344045-serving-cert\""
Sep 11 14:32:33.590745 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.590718    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"]
Sep 11 14:32:33.682044 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.682018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jg8l\" (UniqueName: \"kubernetes.io/projected/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-kube-api-access-6jg8l\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:33.682198 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.682053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:33.682198 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.682081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:33.682198 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.682128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:33.783096 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.783065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:33.783265 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.783120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:33.783265 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.783208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jg8l\" (UniqueName: \"kubernetes.io/projected/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-kube-api-access-6jg8l\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:33.783265 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.783248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:33.783374 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:32:33.783351    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-serving-cert: secret "maas-api-e2e-shared-b-w3-344045-serving-cert" not found
Sep 11 14:32:33.783434 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:32:33.783423    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-maas-api-tls podName:f335a9b3-c252-44cb-8f7f-07ff8f3acf92 nodeName:}" failed. No retries permitted until 2026-09-11 14:32:34.283401447 +0000 UTC m=+1050.914152623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-maas-api-tls") pod "maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6" (UID: "f335a9b3-c252-44cb-8f7f-07ff8f3acf92") : secret "maas-api-e2e-shared-b-w3-344045-serving-cert" not found
Sep 11 14:32:33.783854 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.783831    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:33.785693 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.785667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:33.793971 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:33.793950    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jg8l\" (UniqueName: \"kubernetes.io/projected/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-kube-api-access-6jg8l\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:34.288488 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:34.288452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:34.290751 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:34.290729    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:34.488397 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:34.488367    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:34.764338 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:34.764281    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"]
Sep 11 14:32:34.766596 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:32:34.766571    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf335a9b3_c252_44cb_8f7f_07ff8f3acf92.slice/crio-c2a8863a788ceb0e5ca569f17af66ac4b21f8fa04d0d50e4d87debd2c3194883 WatchSource:0}: Error finding container c2a8863a788ceb0e5ca569f17af66ac4b21f8fa04d0d50e4d87debd2c3194883: Status 404 returned error can't find the container with id c2a8863a788ceb0e5ca569f17af66ac4b21f8fa04d0d50e4d87debd2c3194883
Sep 11 14:32:35.589994 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:35.589958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6" event={"ID":"f335a9b3-c252-44cb-8f7f-07ff8f3acf92","Type":"ContainerStarted","Data":"d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672"}
Sep 11 14:32:35.590193 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:35.590043    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6" event={"ID":"f335a9b3-c252-44cb-8f7f-07ff8f3acf92","Type":"ContainerStarted","Data":"c2a8863a788ceb0e5ca569f17af66ac4b21f8fa04d0d50e4d87debd2c3194883"}
Sep 11 14:32:35.590193 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:35.590103    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:35.613377 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:35.613325    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6" podStartSLOduration=2.305725791 podStartE2EDuration="2.613310195s" totalImagesPullingTime="307.584404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:32:35.611784252 +0000 UTC m=+1052.242535447" watchObservedRunningTime="2026-09-11 14:32:35.613310195 +0000 UTC m=+1052.244061368"
Sep 11 14:32:41.599430 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:41.599400    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:32:51.521438 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.521403    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"]
Sep 11 14:32:51.530612 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.530585    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.533387 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.533362    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-b934e8-serving-cert\""
Sep 11 14:32:51.540361 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.540337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"]
Sep 11 14:32:51.639258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.639218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.639258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.639265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsfsg\" (UniqueName: \"kubernetes.io/projected/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-kube-api-access-tsfsg\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.639507 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.639298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.639507 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.639376    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.740493 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.740463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsfsg\" (UniqueName: \"kubernetes.io/projected/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-kube-api-access-tsfsg\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.740680 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.740504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.740680 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.740543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.740680 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.740576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.741221 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.741199    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.742983 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.742954    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.743091 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.743045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.752898 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.752877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsfsg\" (UniqueName: \"kubernetes.io/projected/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-kube-api-access-tsfsg\") pod \"maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:51.842770 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:51.842686    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:52.122961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.122936    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"]
Sep 11 14:32:52.125456 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:32:52.125427    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e467d9_7eb5_4fa5_9bc9_61a0a1487a3d.slice/crio-cdf8d05d69854b7a9275a2a4959c5fb80f8a3e187fb13bea8cbbf88ea6fb831c WatchSource:0}: Error finding container cdf8d05d69854b7a9275a2a4959c5fb80f8a3e187fb13bea8cbbf88ea6fb831c: Status 404 returned error can't find the container with id cdf8d05d69854b7a9275a2a4959c5fb80f8a3e187fb13bea8cbbf88ea6fb831c
Sep 11 14:32:52.286835 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.286808    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"]
Sep 11 14:32:52.291192 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.291176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:32:52.294266 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.294245    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-b934e8-dockercfg-sxnd9\""
Sep 11 14:32:52.294547 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.294529    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-b934e8\""
Sep 11 14:32:52.300441 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.300416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"]
Sep 11 14:32:52.446030 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.445995    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27gk7\" (UniqueName: \"kubernetes.io/projected/ef789688-c59f-4d4a-a09f-9648ceeee297-kube-api-access-27gk7\") pod \"payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9\" (UID: \"ef789688-c59f-4d4a-a09f-9648ceeee297\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:32:52.446215 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.446074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef789688-c59f-4d4a-a09f-9648ceeee297-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9\" (UID: \"ef789688-c59f-4d4a-a09f-9648ceeee297\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:32:52.547112 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.547085    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27gk7\" (UniqueName: \"kubernetes.io/projected/ef789688-c59f-4d4a-a09f-9648ceeee297-kube-api-access-27gk7\") pod \"payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9\" (UID: \"ef789688-c59f-4d4a-a09f-9648ceeee297\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:32:52.547483 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.547162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef789688-c59f-4d4a-a09f-9648ceeee297-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9\" (UID: \"ef789688-c59f-4d4a-a09f-9648ceeee297\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:32:52.547772 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.547753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef789688-c59f-4d4a-a09f-9648ceeee297-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9\" (UID: \"ef789688-c59f-4d4a-a09f-9648ceeee297\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:32:52.556984 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.556957    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27gk7\" (UniqueName: \"kubernetes.io/projected/ef789688-c59f-4d4a-a09f-9648ceeee297-kube-api-access-27gk7\") pod \"payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9\" (UID: \"ef789688-c59f-4d4a-a09f-9648ceeee297\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:32:52.602925 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.602901    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:32:52.669050 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.669017    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z" event={"ID":"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d","Type":"ContainerStarted","Data":"6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a"}
Sep 11 14:32:52.669190 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.669083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z" event={"ID":"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d","Type":"ContainerStarted","Data":"cdf8d05d69854b7a9275a2a4959c5fb80f8a3e187fb13bea8cbbf88ea6fb831c"}
Sep 11 14:32:52.669253 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.669228    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:32:52.699358 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.699272    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z" podStartSLOduration=1.2548710619999999 podStartE2EDuration="1.699250681s" totalImagesPullingTime="444.379619ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:32:52.697312083 +0000 UTC m=+1069.328063261" watchObservedRunningTime="2026-09-11 14:32:52.699250681 +0000 UTC m=+1069.330001878"
Sep 11 14:32:52.887991 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:52.887961    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"]
Sep 11 14:32:52.891465 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:32:52.891435    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef789688_c59f_4d4a_a09f_9648ceeee297.slice/crio-d4d178a5843192176c51506181e3a333493ab69386583430ea959199e6261fd1 WatchSource:0}: Error finding container d4d178a5843192176c51506181e3a333493ab69386583430ea959199e6261fd1: Status 404 returned error can't find the container with id d4d178a5843192176c51506181e3a333493ab69386583430ea959199e6261fd1
Sep 11 14:32:53.676356 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:53.676323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9" event={"ID":"ef789688-c59f-4d4a-a09f-9648ceeee297","Type":"ContainerStarted","Data":"2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861"}
Sep 11 14:32:53.676829 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:53.676375    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9" event={"ID":"ef789688-c59f-4d4a-a09f-9648ceeee297","Type":"ContainerStarted","Data":"d4d178a5843192176c51506181e3a333493ab69386583430ea959199e6261fd1"}
Sep 11 14:32:53.719375 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:53.719326    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9" podStartSLOduration=1.7193088539999999 podStartE2EDuration="1.719308854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:32:53.71668015 +0000 UTC m=+1070.347431346" watchObservedRunningTime="2026-09-11 14:32:53.719308854 +0000 UTC m=+1070.350060107"
Sep 11 14:32:54.680808 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:54.680778    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:32:58.681935 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:32:58.681863    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:33:05.687014 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:05.686983    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:33:21.682038 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.682007    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"]
Sep 11 14:33:21.686629 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.686607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.689527 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.689504    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-cd8e4a-serving-cert\""
Sep 11 14:33:21.695738 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.695717    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"]
Sep 11 14:33:21.775863 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.775829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.775987 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.775876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmpv6\" (UniqueName: \"kubernetes.io/projected/78c3042c-e338-4624-90cc-81558f35bd95-kube-api-access-pmpv6\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.775987 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.775950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.776085 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.776000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c3042c-e338-4624-90cc-81558f35bd95-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.877000 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.876966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.877000 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.876998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c3042c-e338-4624-90cc-81558f35bd95-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.877272 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.877080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.877272 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.877115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmpv6\" (UniqueName: \"kubernetes.io/projected/78c3042c-e338-4624-90cc-81558f35bd95-kube-api-access-pmpv6\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.877782 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.877759    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c3042c-e338-4624-90cc-81558f35bd95-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.879525 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.879504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.879618 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.879507    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.888240 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.888218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmpv6\" (UniqueName: \"kubernetes.io/projected/78c3042c-e338-4624-90cc-81558f35bd95-kube-api-access-pmpv6\") pod \"maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:21.997406 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:21.997375    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:22.273738 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:22.273698    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"]
Sep 11 14:33:22.275701 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:33:22.275670    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c3042c_e338_4624_90cc_81558f35bd95.slice/crio-04f301207133c01a39433516497a5af6a92b80758e01a11929ac35edba3434ee WatchSource:0}: Error finding container 04f301207133c01a39433516497a5af6a92b80758e01a11929ac35edba3434ee: Status 404 returned error can't find the container with id 04f301207133c01a39433516497a5af6a92b80758e01a11929ac35edba3434ee
Sep 11 14:33:22.816057 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:22.816027    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p" event={"ID":"78c3042c-e338-4624-90cc-81558f35bd95","Type":"ContainerStarted","Data":"544f8d48233d178ac965a3b77c0fc5149f671a1e90d2b0fc48c031efda388b23"}
Sep 11 14:33:22.816416 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:22.816081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p" event={"ID":"78c3042c-e338-4624-90cc-81558f35bd95","Type":"ContainerStarted","Data":"04f301207133c01a39433516497a5af6a92b80758e01a11929ac35edba3434ee"}
Sep 11 14:33:22.816416 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:22.816181    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:33:22.839923 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:22.839877    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p" podStartSLOduration=1.482796017 podStartE2EDuration="1.839862271s" totalImagesPullingTime="357.066254ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:22.838431548 +0000 UTC m=+1099.469182748" watchObservedRunningTime="2026-09-11 14:33:22.839862271 +0000 UTC m=+1099.470613468"
Sep 11 14:33:28.826608 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:33:28.826574    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:34:02.396683 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.396646    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"]
Sep 11 14:34:02.400258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.400242    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.402931 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.402912    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1c057e5e-serving-cert\""
Sep 11 14:34:02.411186 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.411161    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"]
Sep 11 14:34:02.507545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.507516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwhwj\" (UniqueName: \"kubernetes.io/projected/0fa900fd-16ea-4215-b3b8-f6087d488bc5-kube-api-access-fwhwj\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.507702 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.507554    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa900fd-16ea-4215-b3b8-f6087d488bc5-openshift-service-ca\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.507702 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.507624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-maas-api-tls\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.507702 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.507666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-metrics-certs\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.608575 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.608543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-metrics-certs\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.608760 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.608616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwhwj\" (UniqueName: \"kubernetes.io/projected/0fa900fd-16ea-4215-b3b8-f6087d488bc5-kube-api-access-fwhwj\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.608760 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.608643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa900fd-16ea-4215-b3b8-f6087d488bc5-openshift-service-ca\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.608760 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.608702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-maas-api-tls\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.609402 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.609376    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa900fd-16ea-4215-b3b8-f6087d488bc5-openshift-service-ca\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.610977 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.610953    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-maas-api-tls\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.611125 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.611106    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-metrics-certs\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.617924 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.617905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwhwj\" (UniqueName: \"kubernetes.io/projected/0fa900fd-16ea-4215-b3b8-f6087d488bc5-kube-api-access-fwhwj\") pod \"maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.711938 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.711910    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:02.987961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:02.987937    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"]
Sep 11 14:34:02.990997 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:34:02.990961    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa900fd_16ea_4215_b3b8_f6087d488bc5.slice/crio-4e71ccaaaebeb6007009cf64def72aa77ec8e1738210abf8af7cb7cc0f6c7a0c WatchSource:0}: Error finding container 4e71ccaaaebeb6007009cf64def72aa77ec8e1738210abf8af7cb7cc0f6c7a0c: Status 404 returned error can't find the container with id 4e71ccaaaebeb6007009cf64def72aa77ec8e1738210abf8af7cb7cc0f6c7a0c
Sep 11 14:34:03.007816 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:03.007790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf" event={"ID":"0fa900fd-16ea-4215-b3b8-f6087d488bc5","Type":"ContainerStarted","Data":"4e71ccaaaebeb6007009cf64def72aa77ec8e1738210abf8af7cb7cc0f6c7a0c"}
Sep 11 14:34:04.014219 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:04.014115    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf" event={"ID":"0fa900fd-16ea-4215-b3b8-f6087d488bc5","Type":"ContainerStarted","Data":"5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d"}
Sep 11 14:34:04.014567 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:04.014217    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:04.038666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:04.038613    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf" podStartSLOduration=1.2921359780000001 podStartE2EDuration="2.038597859s" totalImagesPullingTime="746.461881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:34:04.037462363 +0000 UTC m=+1140.668213559" watchObservedRunningTime="2026-09-11 14:34:04.038597859 +0000 UTC m=+1140.669349055"
Sep 11 14:34:10.024204 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:10.024173    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:34:38.588452 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.588367    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"]
Sep 11 14:34:38.592020 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.591998    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.594612 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.594586    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1c057e5e\"/\"default-dockercfg-6fqbv\""
Sep 11 14:34:38.594757 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.594740    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1c057e5e\"/\"kube-root-ca.crt\""
Sep 11 14:34:38.595614 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.595598    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1c057e5e\"/\"openshift-service-ca.crt\""
Sep 11 14:34:38.595683 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.595649    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1c057e5e\"/\"e2e-lifecycle-model-1c057e5e-kserve-self-signed-certs\""
Sep 11 14:34:38.608398 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.608378    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"]
Sep 11 14:34:38.696293 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.696260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-home\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.696469 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.696307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-dshm\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.696469 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.696329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tmp-dir\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.696469 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.696349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-model-cache\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.696469 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.696408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tls-certs\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.696656 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.696477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7whdc\" (UniqueName: \"kubernetes.io/projected/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-kube-api-access-7whdc\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.797116 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.797080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tmp-dir\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.797322 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.797121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-model-cache\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.797322 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.797170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tls-certs\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.797322 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.797200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7whdc\" (UniqueName: \"kubernetes.io/projected/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-kube-api-access-7whdc\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.797322 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.797315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-home\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.797546 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.797362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-dshm\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.797619 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.797590    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-model-cache\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.797777 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.797751    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tmp-dir\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.797875 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.797849    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-home\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.800600 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.800480    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tls-certs\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.801975 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.801949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-dshm\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.806650 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.806625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7whdc\" (UniqueName: \"kubernetes.io/projected/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-kube-api-access-7whdc\") pod \"e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") " pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:38.901029 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:38.900953    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:39.175909 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:39.175883    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"]
Sep 11 14:34:39.177870 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:34:39.177839    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bf4f834_9096_43ad_b30f_6e2f7f14b1fb.slice/crio-077529c11c884c8a8c947a1fedf61c022e4c26613a92b5459868e62c6112b455 WatchSource:0}: Error finding container 077529c11c884c8a8c947a1fedf61c022e4c26613a92b5459868e62c6112b455: Status 404 returned error can't find the container with id 077529c11c884c8a8c947a1fedf61c022e4c26613a92b5459868e62c6112b455
Sep 11 14:34:40.188540 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:40.188505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl" event={"ID":"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb","Type":"ContainerStarted","Data":"dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d"}
Sep 11 14:34:40.188954 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:40.188548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl" event={"ID":"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb","Type":"ContainerStarted","Data":"077529c11c884c8a8c947a1fedf61c022e4c26613a92b5459868e62c6112b455"}
Sep 11 14:34:40.211439 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:40.211387    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl" podStartSLOduration=2.211371429 podStartE2EDuration="2.211371429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:34:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:34:40.209596861 +0000 UTC m=+1176.840348060" watchObservedRunningTime="2026-09-11 14:34:40.211371429 +0000 UTC m=+1176.842122625"
Sep 11 14:34:48.901706 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:48.901670    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:48.902204 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:48.901720    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:48.914597 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:48.914573    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:34:49.242358 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:34:49.242332    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:35:03.864780 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:03.864751    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:35:03.868864 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:03.868832    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:35:03.941684 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:03.941655    2581 scope.go:117] "RemoveContainer" containerID="bcf89e624aba813ce2806b3a0d9e6710a7724e90a6b9812187768a84c6044e71"
Sep 11 14:35:30.348994 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.348958    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"]
Sep 11 14:35:30.349600 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.349175    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf" podUID="0fa900fd-16ea-4215-b3b8-f6087d488bc5" containerName="maas-api" containerID="cri-o://5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d" gracePeriod=30
Sep 11 14:35:30.585189 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.585160    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:35:30.639346 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.639267    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-maas-api-tls\") pod \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") "
Sep 11 14:35:30.639346 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.639311    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa900fd-16ea-4215-b3b8-f6087d488bc5-openshift-service-ca\") pod \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") "
Sep 11 14:35:30.639563 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.639357    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwhwj\" (UniqueName: \"kubernetes.io/projected/0fa900fd-16ea-4215-b3b8-f6087d488bc5-kube-api-access-fwhwj\") pod \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") "
Sep 11 14:35:30.639563 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.639389    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-metrics-certs\") pod \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\" (UID: \"0fa900fd-16ea-4215-b3b8-f6087d488bc5\") "
Sep 11 14:35:30.639777 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.639734    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fa900fd-16ea-4215-b3b8-f6087d488bc5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0fa900fd-16ea-4215-b3b8-f6087d488bc5" (UID: "0fa900fd-16ea-4215-b3b8-f6087d488bc5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:35:30.641632 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.641610    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0fa900fd-16ea-4215-b3b8-f6087d488bc5" (UID: "0fa900fd-16ea-4215-b3b8-f6087d488bc5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:35:30.641723 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.641641    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fa900fd-16ea-4215-b3b8-f6087d488bc5-kube-api-access-fwhwj" (OuterVolumeSpecName: "kube-api-access-fwhwj") pod "0fa900fd-16ea-4215-b3b8-f6087d488bc5" (UID: "0fa900fd-16ea-4215-b3b8-f6087d488bc5"). InnerVolumeSpecName "kube-api-access-fwhwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:35:30.641723 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.641650    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0fa900fd-16ea-4215-b3b8-f6087d488bc5" (UID: "0fa900fd-16ea-4215-b3b8-f6087d488bc5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:35:30.740747 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.740710    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:35:30.740747 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.740747    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fa900fd-16ea-4215-b3b8-f6087d488bc5-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:35:30.740954 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.740763    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa900fd-16ea-4215-b3b8-f6087d488bc5-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:35:30.740954 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:30.740778    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwhwj\" (UniqueName: \"kubernetes.io/projected/0fa900fd-16ea-4215-b3b8-f6087d488bc5-kube-api-access-fwhwj\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:35:31.431931 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:31.431899    2581 generic.go:356] "Generic (PLEG): container finished" podID="0fa900fd-16ea-4215-b3b8-f6087d488bc5" containerID="5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d" exitCode=0
Sep 11 14:35:31.432443 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:31.431943    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"
Sep 11 14:35:31.432443 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:31.431990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf" event={"ID":"0fa900fd-16ea-4215-b3b8-f6087d488bc5","Type":"ContainerDied","Data":"5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d"}
Sep 11 14:35:31.432443 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:31.432054    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf" event={"ID":"0fa900fd-16ea-4215-b3b8-f6087d488bc5","Type":"ContainerDied","Data":"4e71ccaaaebeb6007009cf64def72aa77ec8e1738210abf8af7cb7cc0f6c7a0c"}
Sep 11 14:35:31.432443 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:31.432108    2581 scope.go:117] "RemoveContainer" containerID="5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d"
Sep 11 14:35:31.442978 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:31.442956    2581 scope.go:117] "RemoveContainer" containerID="5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d"
Sep 11 14:35:31.443268 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:35:31.443249    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d\": container with ID starting with 5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d not found: ID does not exist" containerID="5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d"
Sep 11 14:35:31.443328 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:31.443276    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d"} err="failed to get container status \"5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d\": rpc error: code = NotFound desc = could not find container \"5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d\": container with ID starting with 5873a7d205478fe96e9efd629d14428ba83c62da59093cbbd4d1ece50fcc8e5d not found: ID does not exist"
Sep 11 14:35:31.498104 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:31.498074    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"]
Sep 11 14:35:31.502564 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:31.502542    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c057e5e-678fc5f69d-7tqkf"]
Sep 11 14:35:31.859750 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:31.859717    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fa900fd-16ea-4215-b3b8-f6087d488bc5" path="/var/lib/kubelet/pods/0fa900fd-16ea-4215-b3b8-f6087d488bc5/volumes"
Sep 11 14:35:39.128198 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:39.128167    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"]
Sep 11 14:35:54.147258 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.147217    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl" podUID="5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" containerName="main" containerID="cri-o://dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d" gracePeriod=45
Sep 11 14:35:54.395836 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.395814    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:35:54.543652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.543619    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tls-certs\") pod \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") "
Sep 11 14:35:54.543843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.543663    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-dshm\") pod \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") "
Sep 11 14:35:54.543843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.543700    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tmp-dir\") pod \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") "
Sep 11 14:35:54.543843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.543724    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7whdc\" (UniqueName: \"kubernetes.io/projected/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-kube-api-access-7whdc\") pod \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") "
Sep 11 14:35:54.543843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.543763    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-home\") pod \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") "
Sep 11 14:35:54.543843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.543801    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-model-cache\") pod \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\" (UID: \"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb\") "
Sep 11 14:35:54.544113 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.544012    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" (UID: "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:54.544241 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.544219    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tmp-dir\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:35:54.544318 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.544276    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-model-cache" (OuterVolumeSpecName: "model-cache") pod "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" (UID: "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:54.544374 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.544333    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-home" (OuterVolumeSpecName: "home") pod "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" (UID: "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:54.545948 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.545922    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" (UID: "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:35:54.546231 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.546207    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-dshm" (OuterVolumeSpecName: "dshm") pod "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" (UID: "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:54.546314 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.546209    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-kube-api-access-7whdc" (OuterVolumeSpecName: "kube-api-access-7whdc") pod "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" (UID: "5bf4f834-9096-43ad-b30f-6e2f7f14b1fb"). InnerVolumeSpecName "kube-api-access-7whdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:35:54.548554 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.548527    2581 generic.go:356] "Generic (PLEG): container finished" podID="5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" containerID="dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d" exitCode=0
Sep 11 14:35:54.548663 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.548599    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"
Sep 11 14:35:54.548663 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.548609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl" event={"ID":"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb","Type":"ContainerDied","Data":"dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d"}
Sep 11 14:35:54.548663 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.548651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl" event={"ID":"5bf4f834-9096-43ad-b30f-6e2f7f14b1fb","Type":"ContainerDied","Data":"077529c11c884c8a8c947a1fedf61c022e4c26613a92b5459868e62c6112b455"}
Sep 11 14:35:54.548792 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.548668    2581 scope.go:117] "RemoveContainer" containerID="dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d"
Sep 11 14:35:54.566231 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.566211    2581 scope.go:117] "RemoveContainer" containerID="dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d"
Sep 11 14:35:54.566487 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:35:54.566469    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d\": container with ID starting with dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d not found: ID does not exist" containerID="dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d"
Sep 11 14:35:54.566532 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.566497    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d"} err="failed to get container status \"dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d\": rpc error: code = NotFound desc = could not find container \"dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d\": container with ID starting with dc936818d2513520f275937f80651e35584015e38d3166632d7a0117b0f6338d not found: ID does not exist"
Sep 11 14:35:54.576792 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.576775    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"]
Sep 11 14:35:54.583335 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.583317    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-1c057e5e/e2e-lifecycle-model-1c057e5e-kserve-7fc5f4487f-kb6pl"]
Sep 11 14:35:54.645567 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.645548    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-model-cache\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:35:54.645567 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.645567    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-tls-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:35:54.645692 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.645575    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-dshm\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:35:54.645692 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.645584    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7whdc\" (UniqueName: \"kubernetes.io/projected/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-kube-api-access-7whdc\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:35:54.645692 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:54.645592    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb-home\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:35:55.859372 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:35:55.859341    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" path="/var/lib/kubelet/pods/5bf4f834-9096-43ad-b30f-6e2f7f14b1fb/volumes"
Sep 11 14:36:20.486710 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.486678    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"]
Sep 11 14:36:20.487286 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.487240    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa900fd-16ea-4215-b3b8-f6087d488bc5" containerName="maas-api"
Sep 11 14:36:20.487286 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.487261    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa900fd-16ea-4215-b3b8-f6087d488bc5" containerName="maas-api"
Sep 11 14:36:20.487418 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.487287    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" containerName="main"
Sep 11 14:36:20.487418 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.487297    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" containerName="main"
Sep 11 14:36:20.487418 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.487411    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf4f834-9096-43ad-b30f-6e2f7f14b1fb" containerName="main"
Sep 11 14:36:20.487572 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.487427    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa900fd-16ea-4215-b3b8-f6087d488bc5" containerName="maas-api"
Sep 11 14:36:20.491957 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.491936    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.494837 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.494807    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"openshift-service-ca.crt\""
Sep 11 14:36:20.495716 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.495693    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"kube-root-ca.crt\""
Sep 11 14:36:20.495836 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.495760    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"default-dockercfg-xd8jr\""
Sep 11 14:36:20.496056 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.496035    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-72e046\"/\"sub-test-model-72e046-kserve-self-signed-certs\""
Sep 11 14:36:20.501377 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.501351    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"]
Sep 11 14:36:20.559449 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.559414    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-tmp-dir\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.559646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.559468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-dshm\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.559646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.559541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-model-cache\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.559646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.559595    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/829527b2-fa00-42ef-b81d-2d7222fe1447-tls-certs\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.559646 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.559634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-home\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.559895 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.559656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9b56\" (UniqueName: \"kubernetes.io/projected/829527b2-fa00-42ef-b81d-2d7222fe1447-kube-api-access-s9b56\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.660723 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.660687    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-tmp-dir\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.661090 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.661056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-dshm\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.661323 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.661287    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-model-cache\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.661477 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.661461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/829527b2-fa00-42ef-b81d-2d7222fe1447-tls-certs\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.661600 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.661586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-home\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.661691 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.661666    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-model-cache\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.661771 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.661757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9b56\" (UniqueName: \"kubernetes.io/projected/829527b2-fa00-42ef-b81d-2d7222fe1447-kube-api-access-s9b56\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.662531 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.662508    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-home\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.662694 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.661298    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-tmp-dir\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.668209 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.663905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-dshm\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.668979 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.668952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/829527b2-fa00-42ef-b81d-2d7222fe1447-tls-certs\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.671124 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.671104    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9b56\" (UniqueName: \"kubernetes.io/projected/829527b2-fa00-42ef-b81d-2d7222fe1447-kube-api-access-s9b56\") pod \"sub-test-model-72e046-kserve-756cd6f5d7-z2j5j\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") " pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:20.803066 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:20.802998    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:21.080706 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:21.080683    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"]
Sep 11 14:36:21.082877 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:36:21.082853    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod829527b2_fa00_42ef_b81d_2d7222fe1447.slice/crio-7eca9cf015b779806ff7a00b2cc004f713e5e09e335ac70b7021654c8e13e801 WatchSource:0}: Error finding container 7eca9cf015b779806ff7a00b2cc004f713e5e09e335ac70b7021654c8e13e801: Status 404 returned error can't find the container with id 7eca9cf015b779806ff7a00b2cc004f713e5e09e335ac70b7021654c8e13e801
Sep 11 14:36:21.679842 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:21.679807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j" event={"ID":"829527b2-fa00-42ef-b81d-2d7222fe1447","Type":"ContainerStarted","Data":"afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db"}
Sep 11 14:36:21.680246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:21.679853    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j" event={"ID":"829527b2-fa00-42ef-b81d-2d7222fe1447","Type":"ContainerStarted","Data":"7eca9cf015b779806ff7a00b2cc004f713e5e09e335ac70b7021654c8e13e801"}
Sep 11 14:36:21.699108 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:21.699058    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j" podStartSLOduration=1.699043155 podStartE2EDuration="1.699043155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:36:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:36:21.697973871 +0000 UTC m=+1278.328725068" watchObservedRunningTime="2026-09-11 14:36:21.699043155 +0000 UTC m=+1278.329794406"
Sep 11 14:36:30.804060 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:30.804024    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:30.804507 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:30.804088    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:30.816419 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:30.816396    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:31.738405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:31.738369    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:36:56.852485 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:56.852451    2581 generic.go:356] "Generic (PLEG): container finished" podID="3b42be2e-0b59-43a7-987b-852ec4791c87" containerID="6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2" exitCode=0
Sep 11 14:36:56.853002 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:56.852509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r" event={"ID":"3b42be2e-0b59-43a7-987b-852ec4791c87","Type":"ContainerDied","Data":"6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2"}
Sep 11 14:36:56.853002 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:56.852873    2581 scope.go:117] "RemoveContainer" containerID="6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2"
Sep 11 14:36:57.859902 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:57.859820    2581 generic.go:356] "Generic (PLEG): container finished" podID="aaa069e6-e382-4cbe-a17e-4b41b2a748cb" containerID="56302a061522e275265ad3004b6a73afd78a4cb45adf0feb3e6af54a5b8d4b96" exitCode=1
Sep 11 14:36:57.859902 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:57.859887    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq" event={"ID":"aaa069e6-e382-4cbe-a17e-4b41b2a748cb","Type":"ContainerDied","Data":"56302a061522e275265ad3004b6a73afd78a4cb45adf0feb3e6af54a5b8d4b96"}
Sep 11 14:36:57.860333 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:57.860207    2581 scope.go:117] "RemoveContainer" containerID="56302a061522e275265ad3004b6a73afd78a4cb45adf0feb3e6af54a5b8d4b96"
Sep 11 14:36:57.867652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:57.867440    2581 generic.go:356] "Generic (PLEG): container finished" podID="b723064c-66f4-48a7-aafb-41256d2d598f" containerID="a9884e5dbff13e6cd5dcf9e9aff18c323f4e3927975412d89102ec3278089c29" exitCode=1
Sep 11 14:36:57.867652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:57.867620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rf66q" event={"ID":"b723064c-66f4-48a7-aafb-41256d2d598f","Type":"ContainerDied","Data":"a9884e5dbff13e6cd5dcf9e9aff18c323f4e3927975412d89102ec3278089c29"}
Sep 11 14:36:57.867972 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:57.867956    2581 scope.go:117] "RemoveContainer" containerID="a9884e5dbff13e6cd5dcf9e9aff18c323f4e3927975412d89102ec3278089c29"
Sep 11 14:36:57.870166 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:57.870127    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r" event={"ID":"3b42be2e-0b59-43a7-987b-852ec4791c87","Type":"ContainerStarted","Data":"99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc"}
Sep 11 14:36:57.870352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:57.870327    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:36:58.881028 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:58.880989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq" event={"ID":"aaa069e6-e382-4cbe-a17e-4b41b2a748cb","Type":"ContainerStarted","Data":"70fb0888753fb4f409426b793d07dea011932c9277dd0e7fb1bfb040276d1fa2"}
Sep 11 14:36:58.881530 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:58.881234    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"
Sep 11 14:36:58.882964 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:58.882931    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rf66q" event={"ID":"b723064c-66f4-48a7-aafb-41256d2d598f","Type":"ContainerStarted","Data":"addcf50725532233c0d6c5d079cc762548b34d5c6bc5eacb8b82c0b1fc8f8c53"}
Sep 11 14:36:58.883276 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:36:58.883259    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-rf66q"
Sep 11 14:37:08.885000 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:08.884964    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:37:09.889750 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:09.889724    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r65pq"
Sep 11 14:37:09.890118 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:09.889782    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-rf66q"
Sep 11 14:37:56.514633 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.514605    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"]
Sep 11 14:37:56.517820 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.517804    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.524586 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.524228    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2cabda-serving-cert\""
Sep 11 14:37:56.534854 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.534833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"]
Sep 11 14:37:56.571811 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.571784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-metrics-certs\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.571933 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.571814    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f489e473-98fd-45ab-8a32-8757ce1af1de-openshift-service-ca\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.571933 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.571844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-maas-api-tls\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.572027 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.571952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njnwf\" (UniqueName: \"kubernetes.io/projected/f489e473-98fd-45ab-8a32-8757ce1af1de-kube-api-access-njnwf\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.672574 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.672548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njnwf\" (UniqueName: \"kubernetes.io/projected/f489e473-98fd-45ab-8a32-8757ce1af1de-kube-api-access-njnwf\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.672714 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.672620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-metrics-certs\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.672714 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.672651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f489e473-98fd-45ab-8a32-8757ce1af1de-openshift-service-ca\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.672714 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.672695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-maas-api-tls\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.673347 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.673319    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f489e473-98fd-45ab-8a32-8757ce1af1de-openshift-service-ca\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.675509 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.675483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-metrics-certs\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.675623 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.675573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-maas-api-tls\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.682976 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.682948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njnwf\" (UniqueName: \"kubernetes.io/projected/f489e473-98fd-45ab-8a32-8757ce1af1de-kube-api-access-njnwf\") pod \"maas-api-e2e-api-a-2cabda-5b664c9485-fqrth\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:56.828094 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:56.828022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:37:57.112461 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:57.112438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"]
Sep 11 14:37:57.114580 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:37:57.114550    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf489e473_98fd_45ab_8a32_8757ce1af1de.slice/crio-243a373f153d277bf653b8761008ee46f7e27bb3136f87edf40f82885fb64e3b WatchSource:0}: Error finding container 243a373f153d277bf653b8761008ee46f7e27bb3136f87edf40f82885fb64e3b: Status 404 returned error can't find the container with id 243a373f153d277bf653b8761008ee46f7e27bb3136f87edf40f82885fb64e3b
Sep 11 14:37:57.116362 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:57.116344    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:37:57.160004 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:57.159970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth" event={"ID":"f489e473-98fd-45ab-8a32-8757ce1af1de","Type":"ContainerStarted","Data":"243a373f153d277bf653b8761008ee46f7e27bb3136f87edf40f82885fb64e3b"}
Sep 11 14:37:58.166679 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:58.166602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth" event={"ID":"f489e473-98fd-45ab-8a32-8757ce1af1de","Type":"ContainerStarted","Data":"8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0"}
Sep 11 14:37:58.166679 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:37:58.166664    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:38:03.984899 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:03.984870    2581 scope.go:117] "RemoveContainer" containerID="ad486047c43a6f291d105523941e083da5faa61a120c2e243c6cdc8a18f163e5"
Sep 11 14:38:04.177891 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:04.177864    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:38:04.198215 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:04.198169    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth" podStartSLOduration=7.42859337 podStartE2EDuration="8.19815424s" totalImagesPullingTime="769.56087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:37:58.20565214 +0000 UTC m=+1374.836403337" watchObservedRunningTime="2026-09-11 14:38:04.19815424 +0000 UTC m=+1380.828905427"
Sep 11 14:38:13.374800 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:13.374764    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"]
Sep 11 14:38:28.393264 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.393221    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j" podUID="829527b2-fa00-42ef-b81d-2d7222fe1447" containerName="main" containerID="cri-o://afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db" gracePeriod=45
Sep 11 14:38:28.633197 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.633169    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:38:28.751017 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.750991    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-tmp-dir\") pod \"829527b2-fa00-42ef-b81d-2d7222fe1447\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") "
Sep 11 14:38:28.751165 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.751028    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9b56\" (UniqueName: \"kubernetes.io/projected/829527b2-fa00-42ef-b81d-2d7222fe1447-kube-api-access-s9b56\") pod \"829527b2-fa00-42ef-b81d-2d7222fe1447\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") "
Sep 11 14:38:28.751165 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.751046    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-dshm\") pod \"829527b2-fa00-42ef-b81d-2d7222fe1447\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") "
Sep 11 14:38:28.751165 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.751074    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/829527b2-fa00-42ef-b81d-2d7222fe1447-tls-certs\") pod \"829527b2-fa00-42ef-b81d-2d7222fe1447\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") "
Sep 11 14:38:28.751291 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.751191    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-home\") pod \"829527b2-fa00-42ef-b81d-2d7222fe1447\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") "
Sep 11 14:38:28.751331 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.751289    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-model-cache\") pod \"829527b2-fa00-42ef-b81d-2d7222fe1447\" (UID: \"829527b2-fa00-42ef-b81d-2d7222fe1447\") "
Sep 11 14:38:28.751331 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.751290    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "829527b2-fa00-42ef-b81d-2d7222fe1447" (UID: "829527b2-fa00-42ef-b81d-2d7222fe1447"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:28.751454 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.751426    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-home" (OuterVolumeSpecName: "home") pod "829527b2-fa00-42ef-b81d-2d7222fe1447" (UID: "829527b2-fa00-42ef-b81d-2d7222fe1447"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:28.751563 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.751541    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-model-cache" (OuterVolumeSpecName: "model-cache") pod "829527b2-fa00-42ef-b81d-2d7222fe1447" (UID: "829527b2-fa00-42ef-b81d-2d7222fe1447"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:28.751632 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.751590    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-tmp-dir\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:38:28.751632 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.751609    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-home\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:38:28.753229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.753209    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/829527b2-fa00-42ef-b81d-2d7222fe1447-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "829527b2-fa00-42ef-b81d-2d7222fe1447" (UID: "829527b2-fa00-42ef-b81d-2d7222fe1447"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:38:28.753567 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.753548    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-dshm" (OuterVolumeSpecName: "dshm") pod "829527b2-fa00-42ef-b81d-2d7222fe1447" (UID: "829527b2-fa00-42ef-b81d-2d7222fe1447"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:28.753657 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.753580    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/829527b2-fa00-42ef-b81d-2d7222fe1447-kube-api-access-s9b56" (OuterVolumeSpecName: "kube-api-access-s9b56") pod "829527b2-fa00-42ef-b81d-2d7222fe1447" (UID: "829527b2-fa00-42ef-b81d-2d7222fe1447"). InnerVolumeSpecName "kube-api-access-s9b56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:38:28.852726 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.852701    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9b56\" (UniqueName: \"kubernetes.io/projected/829527b2-fa00-42ef-b81d-2d7222fe1447-kube-api-access-s9b56\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:38:28.852726 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.852725    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-dshm\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:38:28.852864 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.852734    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/829527b2-fa00-42ef-b81d-2d7222fe1447-tls-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:38:28.852864 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:28.852743    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/829527b2-fa00-42ef-b81d-2d7222fe1447-model-cache\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:38:29.327628 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:29.327595    2581 generic.go:356] "Generic (PLEG): container finished" podID="829527b2-fa00-42ef-b81d-2d7222fe1447" containerID="afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db" exitCode=0
Sep 11 14:38:29.327801 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:29.327640    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"
Sep 11 14:38:29.327801 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:29.327682    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j" event={"ID":"829527b2-fa00-42ef-b81d-2d7222fe1447","Type":"ContainerDied","Data":"afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db"}
Sep 11 14:38:29.327801 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:29.327724    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j" event={"ID":"829527b2-fa00-42ef-b81d-2d7222fe1447","Type":"ContainerDied","Data":"7eca9cf015b779806ff7a00b2cc004f713e5e09e335ac70b7021654c8e13e801"}
Sep 11 14:38:29.327801 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:29.327744    2581 scope.go:117] "RemoveContainer" containerID="afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db"
Sep 11 14:38:29.337382 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:29.337362    2581 scope.go:117] "RemoveContainer" containerID="afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db"
Sep 11 14:38:29.337690 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:38:29.337669    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db\": container with ID starting with afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db not found: ID does not exist" containerID="afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db"
Sep 11 14:38:29.337795 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:29.337697    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db"} err="failed to get container status \"afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db\": rpc error: code = NotFound desc = could not find container \"afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db\": container with ID starting with afc4fcefd093ef1b12dea0fc9ad56c6d574f23ef9fc61eae544f69d0aacc60db not found: ID does not exist"
Sep 11 14:38:35.366379 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:35.366346    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"]
Sep 11 14:38:36.558847 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:36.558817    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-72e046/sub-test-model-72e046-kserve-756cd6f5d7-z2j5j"]
Sep 11 14:38:37.859210 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:37.859177    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="829527b2-fa00-42ef-b81d-2d7222fe1447" path="/var/lib/kubelet/pods/829527b2-fa00-42ef-b81d-2d7222fe1447/volumes"
Sep 11 14:38:54.661747 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.661716    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"]
Sep 11 14:38:54.662226 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.662061    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="829527b2-fa00-42ef-b81d-2d7222fe1447" containerName="main"
Sep 11 14:38:54.662226 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.662072    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="829527b2-fa00-42ef-b81d-2d7222fe1447" containerName="main"
Sep 11 14:38:54.662226 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.662170    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="829527b2-fa00-42ef-b81d-2d7222fe1447" containerName="main"
Sep 11 14:38:54.665568 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.665542    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.668199 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.668176    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-96e743-serving-cert\""
Sep 11 14:38:54.678574 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.678550    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"]
Sep 11 14:38:54.768594 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.768564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c21ebd3d-e55e-423d-9476-4f04e122f459-openshift-service-ca\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.768594 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.768597    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq5bg\" (UniqueName: \"kubernetes.io/projected/c21ebd3d-e55e-423d-9476-4f04e122f459-kube-api-access-dq5bg\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.768801 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.768632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-maas-api-tls\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.768801 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.768673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-metrics-certs\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.869463 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.869430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c21ebd3d-e55e-423d-9476-4f04e122f459-openshift-service-ca\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.869463 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.869463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq5bg\" (UniqueName: \"kubernetes.io/projected/c21ebd3d-e55e-423d-9476-4f04e122f459-kube-api-access-dq5bg\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.869659 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.869493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-maas-api-tls\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.869659 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.869517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-metrics-certs\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.870323 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.870297    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c21ebd3d-e55e-423d-9476-4f04e122f459-openshift-service-ca\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.871870 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.871844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-maas-api-tls\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.872013 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.871990    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-metrics-certs\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.881565 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.881543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq5bg\" (UniqueName: \"kubernetes.io/projected/c21ebd3d-e55e-423d-9476-4f04e122f459-kube-api-access-dq5bg\") pod \"maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:54.976538 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:54.976513    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:55.261936 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.261911    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"]
Sep 11 14:38:55.264060 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:38:55.264033    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21ebd3d_e55e_423d_9476_4f04e122f459.slice/crio-12edc69cf814ef16b15d8da64efc6d139d3ab7a3b5de77fd916d59e694152ef0 WatchSource:0}: Error finding container 12edc69cf814ef16b15d8da64efc6d139d3ab7a3b5de77fd916d59e694152ef0: Status 404 returned error can't find the container with id 12edc69cf814ef16b15d8da64efc6d139d3ab7a3b5de77fd916d59e694152ef0
Sep 11 14:38:55.459080 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.459045    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk" event={"ID":"c21ebd3d-e55e-423d-9476-4f04e122f459","Type":"ContainerStarted","Data":"12edc69cf814ef16b15d8da64efc6d139d3ab7a3b5de77fd916d59e694152ef0"}
Sep 11 14:38:55.532704 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.532608    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"]
Sep 11 14:38:55.536790 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.536763    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:38:55.540219 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.540189    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-96e743\""
Sep 11 14:38:55.540518 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.540496    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-96e743-dockercfg-n9mwt\""
Sep 11 14:38:55.551864 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.551842    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"]
Sep 11 14:38:55.576457 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.576428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brfq4\" (UniqueName: \"kubernetes.io/projected/85537415-c11c-47e5-a17b-37ccac7f1c6a-kube-api-access-brfq4\") pod \"payload-processing-e2e-api-b-96e743-b8457d749-sdhlb\" (UID: \"85537415-c11c-47e5-a17b-37ccac7f1c6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:38:55.576563 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.576469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85537415-c11c-47e5-a17b-37ccac7f1c6a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-96e743-b8457d749-sdhlb\" (UID: \"85537415-c11c-47e5-a17b-37ccac7f1c6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:38:55.677571 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.677538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brfq4\" (UniqueName: \"kubernetes.io/projected/85537415-c11c-47e5-a17b-37ccac7f1c6a-kube-api-access-brfq4\") pod \"payload-processing-e2e-api-b-96e743-b8457d749-sdhlb\" (UID: \"85537415-c11c-47e5-a17b-37ccac7f1c6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:38:55.677910 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.677583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85537415-c11c-47e5-a17b-37ccac7f1c6a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-96e743-b8457d749-sdhlb\" (UID: \"85537415-c11c-47e5-a17b-37ccac7f1c6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:38:55.678308 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.678288    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85537415-c11c-47e5-a17b-37ccac7f1c6a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-96e743-b8457d749-sdhlb\" (UID: \"85537415-c11c-47e5-a17b-37ccac7f1c6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:38:55.688635 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.688612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brfq4\" (UniqueName: \"kubernetes.io/projected/85537415-c11c-47e5-a17b-37ccac7f1c6a-kube-api-access-brfq4\") pod \"payload-processing-e2e-api-b-96e743-b8457d749-sdhlb\" (UID: \"85537415-c11c-47e5-a17b-37ccac7f1c6a\") " pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:38:55.849235 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:55.849159    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:38:56.134780 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:56.134339    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"]
Sep 11 14:38:56.137618 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:38:56.137583    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85537415_c11c_47e5_a17b_37ccac7f1c6a.slice/crio-c67d5ae2bf848c54c087f9c81533cb2f3c59bc167b3185087f72940ef11c01ae WatchSource:0}: Error finding container c67d5ae2bf848c54c087f9c81533cb2f3c59bc167b3185087f72940ef11c01ae: Status 404 returned error can't find the container with id c67d5ae2bf848c54c087f9c81533cb2f3c59bc167b3185087f72940ef11c01ae
Sep 11 14:38:56.465733 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:56.465698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb" event={"ID":"85537415-c11c-47e5-a17b-37ccac7f1c6a","Type":"ContainerStarted","Data":"39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423"}
Sep 11 14:38:56.465925 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:56.465767    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:38:56.465925 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:56.465792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb" event={"ID":"85537415-c11c-47e5-a17b-37ccac7f1c6a","Type":"ContainerStarted","Data":"c67d5ae2bf848c54c087f9c81533cb2f3c59bc167b3185087f72940ef11c01ae"}
Sep 11 14:38:56.467257 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:56.467234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk" event={"ID":"c21ebd3d-e55e-423d-9476-4f04e122f459","Type":"ContainerStarted","Data":"ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db"}
Sep 11 14:38:56.467373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:56.467350    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:38:56.496064 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:56.496011    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb" podStartSLOduration=1.49599097 podStartE2EDuration="1.49599097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:56.492254008 +0000 UTC m=+1433.123005204" watchObservedRunningTime="2026-09-11 14:38:56.49599097 +0000 UTC m=+1433.126742169"
Sep 11 14:38:56.529065 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:38:56.529022    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk" podStartSLOduration=2.226143492 podStartE2EDuration="2.529007101s" totalImagesPullingTime="302.863609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:56.5253178 +0000 UTC m=+1433.156068996" watchObservedRunningTime="2026-09-11 14:38:56.529007101 +0000 UTC m=+1433.159758297"
Sep 11 14:39:02.477665 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:02.477636    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:39:07.475225 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:07.475193    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:39:37.213930 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.213901    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"]
Sep 11 14:39:37.214414 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.214105    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth" podUID="f489e473-98fd-45ab-8a32-8757ce1af1de" containerName="maas-api" containerID="cri-o://8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0" gracePeriod=30
Sep 11 14:39:37.491472 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.491448    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:39:37.530295 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.530265    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-metrics-certs\") pod \"f489e473-98fd-45ab-8a32-8757ce1af1de\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") "
Sep 11 14:39:37.530449 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.530346    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f489e473-98fd-45ab-8a32-8757ce1af1de-openshift-service-ca\") pod \"f489e473-98fd-45ab-8a32-8757ce1af1de\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") "
Sep 11 14:39:37.530449 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.530385    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-maas-api-tls\") pod \"f489e473-98fd-45ab-8a32-8757ce1af1de\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") "
Sep 11 14:39:37.530449 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.530410    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njnwf\" (UniqueName: \"kubernetes.io/projected/f489e473-98fd-45ab-8a32-8757ce1af1de-kube-api-access-njnwf\") pod \"f489e473-98fd-45ab-8a32-8757ce1af1de\" (UID: \"f489e473-98fd-45ab-8a32-8757ce1af1de\") "
Sep 11 14:39:37.530861 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.530835    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f489e473-98fd-45ab-8a32-8757ce1af1de-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f489e473-98fd-45ab-8a32-8757ce1af1de" (UID: "f489e473-98fd-45ab-8a32-8757ce1af1de"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:39:37.532961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.532924    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f489e473-98fd-45ab-8a32-8757ce1af1de" (UID: "f489e473-98fd-45ab-8a32-8757ce1af1de"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:39:37.532961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.532940    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f489e473-98fd-45ab-8a32-8757ce1af1de" (UID: "f489e473-98fd-45ab-8a32-8757ce1af1de"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:39:37.533100 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.533022    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f489e473-98fd-45ab-8a32-8757ce1af1de-kube-api-access-njnwf" (OuterVolumeSpecName: "kube-api-access-njnwf") pod "f489e473-98fd-45ab-8a32-8757ce1af1de" (UID: "f489e473-98fd-45ab-8a32-8757ce1af1de"). InnerVolumeSpecName "kube-api-access-njnwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:39:37.631600 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.631573    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f489e473-98fd-45ab-8a32-8757ce1af1de-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:39:37.631600 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.631599    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:39:37.631766 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.631608    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njnwf\" (UniqueName: \"kubernetes.io/projected/f489e473-98fd-45ab-8a32-8757ce1af1de-kube-api-access-njnwf\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:39:37.631766 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.631618    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f489e473-98fd-45ab-8a32-8757ce1af1de-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:39:37.679647 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.679612    2581 generic.go:356] "Generic (PLEG): container finished" podID="f489e473-98fd-45ab-8a32-8757ce1af1de" containerID="8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0" exitCode=0
Sep 11 14:39:37.679799 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.679662    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"
Sep 11 14:39:37.679799 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.679698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth" event={"ID":"f489e473-98fd-45ab-8a32-8757ce1af1de","Type":"ContainerDied","Data":"8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0"}
Sep 11 14:39:37.679799 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.679749    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth" event={"ID":"f489e473-98fd-45ab-8a32-8757ce1af1de","Type":"ContainerDied","Data":"243a373f153d277bf653b8761008ee46f7e27bb3136f87edf40f82885fb64e3b"}
Sep 11 14:39:37.679799 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.679772    2581 scope.go:117] "RemoveContainer" containerID="8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0"
Sep 11 14:39:37.691028 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.691013    2581 scope.go:117] "RemoveContainer" containerID="8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0"
Sep 11 14:39:37.691403 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:39:37.691379    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0\": container with ID starting with 8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0 not found: ID does not exist" containerID="8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0"
Sep 11 14:39:37.691476 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.691415    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0"} err="failed to get container status \"8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0\": rpc error: code = NotFound desc = could not find container \"8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0\": container with ID starting with 8441dd2317a918afcdfe38ac3e1812a99ec6eabfaab7c9820b893c43f7199da0 not found: ID does not exist"
Sep 11 14:39:37.712304 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.712285    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"]
Sep 11 14:39:37.718659 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.718638    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2cabda-5b664c9485-fqrth"]
Sep 11 14:39:37.859132 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:39:37.859040    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f489e473-98fd-45ab-8a32-8757ce1af1de" path="/var/lib/kubelet/pods/f489e473-98fd-45ab-8a32-8757ce1af1de/volumes"
Sep 11 14:40:02.297717 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.297680    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"]
Sep 11 14:40:02.298346 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.297949    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk" podUID="c21ebd3d-e55e-423d-9476-4f04e122f459" containerName="maas-api" containerID="cri-o://ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db" gracePeriod=30
Sep 11 14:40:02.368989 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.368959    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"]
Sep 11 14:40:02.369199 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.369175    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb" podUID="85537415-c11c-47e5-a17b-37ccac7f1c6a" containerName="payload-processing" containerID="cri-o://39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423" gracePeriod=30
Sep 11 14:40:02.473832 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.473788    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk" podUID="c21ebd3d-e55e-423d-9476-4f04e122f459" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.56:8443/health\": dial tcp 10.133.0.56:8443: connect: connection refused"
Sep 11 14:40:02.637613 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.637557    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:40:02.644403 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.644379    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:40:02.747818 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.747787    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-maas-api-tls\") pod \"c21ebd3d-e55e-423d-9476-4f04e122f459\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") "
Sep 11 14:40:02.748020 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.747831    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85537415-c11c-47e5-a17b-37ccac7f1c6a-plugins-config-volume\") pod \"85537415-c11c-47e5-a17b-37ccac7f1c6a\" (UID: \"85537415-c11c-47e5-a17b-37ccac7f1c6a\") "
Sep 11 14:40:02.748020 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.747885    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brfq4\" (UniqueName: \"kubernetes.io/projected/85537415-c11c-47e5-a17b-37ccac7f1c6a-kube-api-access-brfq4\") pod \"85537415-c11c-47e5-a17b-37ccac7f1c6a\" (UID: \"85537415-c11c-47e5-a17b-37ccac7f1c6a\") "
Sep 11 14:40:02.748020 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.747918    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-metrics-certs\") pod \"c21ebd3d-e55e-423d-9476-4f04e122f459\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") "
Sep 11 14:40:02.748020 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.747975    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c21ebd3d-e55e-423d-9476-4f04e122f459-openshift-service-ca\") pod \"c21ebd3d-e55e-423d-9476-4f04e122f459\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") "
Sep 11 14:40:02.748020 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.748017    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq5bg\" (UniqueName: \"kubernetes.io/projected/c21ebd3d-e55e-423d-9476-4f04e122f459-kube-api-access-dq5bg\") pod \"c21ebd3d-e55e-423d-9476-4f04e122f459\" (UID: \"c21ebd3d-e55e-423d-9476-4f04e122f459\") "
Sep 11 14:40:02.748368 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.748330    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85537415-c11c-47e5-a17b-37ccac7f1c6a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85537415-c11c-47e5-a17b-37ccac7f1c6a" (UID: "85537415-c11c-47e5-a17b-37ccac7f1c6a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:40:02.748441 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.748415    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c21ebd3d-e55e-423d-9476-4f04e122f459-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c21ebd3d-e55e-423d-9476-4f04e122f459" (UID: "c21ebd3d-e55e-423d-9476-4f04e122f459"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:40:02.750083 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.750054    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85537415-c11c-47e5-a17b-37ccac7f1c6a-kube-api-access-brfq4" (OuterVolumeSpecName: "kube-api-access-brfq4") pod "85537415-c11c-47e5-a17b-37ccac7f1c6a" (UID: "85537415-c11c-47e5-a17b-37ccac7f1c6a"). InnerVolumeSpecName "kube-api-access-brfq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:40:02.750204 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.750126    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c21ebd3d-e55e-423d-9476-4f04e122f459-kube-api-access-dq5bg" (OuterVolumeSpecName: "kube-api-access-dq5bg") pod "c21ebd3d-e55e-423d-9476-4f04e122f459" (UID: "c21ebd3d-e55e-423d-9476-4f04e122f459"). InnerVolumeSpecName "kube-api-access-dq5bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:40:02.750426 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.750400    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c21ebd3d-e55e-423d-9476-4f04e122f459" (UID: "c21ebd3d-e55e-423d-9476-4f04e122f459"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:40:02.750426 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.750414    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c21ebd3d-e55e-423d-9476-4f04e122f459" (UID: "c21ebd3d-e55e-423d-9476-4f04e122f459"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:40:02.802081 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.802054    2581 generic.go:356] "Generic (PLEG): container finished" podID="85537415-c11c-47e5-a17b-37ccac7f1c6a" containerID="39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423" exitCode=0
Sep 11 14:40:02.802241 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.802096    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"
Sep 11 14:40:02.802241 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.802167    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb" event={"ID":"85537415-c11c-47e5-a17b-37ccac7f1c6a","Type":"ContainerDied","Data":"39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423"}
Sep 11 14:40:02.802241 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.802231    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb" event={"ID":"85537415-c11c-47e5-a17b-37ccac7f1c6a","Type":"ContainerDied","Data":"c67d5ae2bf848c54c087f9c81533cb2f3c59bc167b3185087f72940ef11c01ae"}
Sep 11 14:40:02.802410 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.802263    2581 scope.go:117] "RemoveContainer" containerID="39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423"
Sep 11 14:40:02.803528 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.803500    2581 generic.go:356] "Generic (PLEG): container finished" podID="c21ebd3d-e55e-423d-9476-4f04e122f459" containerID="ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db" exitCode=0
Sep 11 14:40:02.803635 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.803540    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"
Sep 11 14:40:02.803635 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.803588    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk" event={"ID":"c21ebd3d-e55e-423d-9476-4f04e122f459","Type":"ContainerDied","Data":"ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db"}
Sep 11 14:40:02.803735 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.803636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk" event={"ID":"c21ebd3d-e55e-423d-9476-4f04e122f459","Type":"ContainerDied","Data":"12edc69cf814ef16b15d8da64efc6d139d3ab7a3b5de77fd916d59e694152ef0"}
Sep 11 14:40:02.810758 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.810630    2581 scope.go:117] "RemoveContainer" containerID="39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423"
Sep 11 14:40:02.810969 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:40:02.810939    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423\": container with ID starting with 39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423 not found: ID does not exist" containerID="39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423"
Sep 11 14:40:02.811067 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.810978    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423"} err="failed to get container status \"39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423\": rpc error: code = NotFound desc = could not find container \"39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423\": container with ID starting with 39824806ac1c82a65c51a317d261c3227d8ada338173f05e086651f56c100423 not found: ID does not exist"
Sep 11 14:40:02.811067 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.811005    2581 scope.go:117] "RemoveContainer" containerID="ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db"
Sep 11 14:40:02.818994 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.818977    2581 scope.go:117] "RemoveContainer" containerID="ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db"
Sep 11 14:40:02.819324 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:40:02.819308    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db\": container with ID starting with ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db not found: ID does not exist" containerID="ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db"
Sep 11 14:40:02.819380 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.819329    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db"} err="failed to get container status \"ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db\": rpc error: code = NotFound desc = could not find container \"ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db\": container with ID starting with ef06e3e6ecd808cfdfe71ca74a606bfbcb13dad2e0119f0ef999c5872a07b2db not found: ID does not exist"
Sep 11 14:40:02.842353 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.842319    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"]
Sep 11 14:40:02.848766 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.848748    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:02.848857 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.848770    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85537415-c11c-47e5-a17b-37ccac7f1c6a-plugins-config-volume\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:02.848857 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.848783    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brfq4\" (UniqueName: \"kubernetes.io/projected/85537415-c11c-47e5-a17b-37ccac7f1c6a-kube-api-access-brfq4\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:02.848857 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.848799    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c21ebd3d-e55e-423d-9476-4f04e122f459-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:02.848857 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.848812    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c21ebd3d-e55e-423d-9476-4f04e122f459-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:02.848857 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.848824    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq5bg\" (UniqueName: \"kubernetes.io/projected/c21ebd3d-e55e-423d-9476-4f04e122f459-kube-api-access-dq5bg\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:02.849751 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.849730    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-96e743-7bfc7b566c-2k4nk"]
Sep 11 14:40:02.864473 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.864448    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"]
Sep 11 14:40:02.866987 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:02.866968    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-96e743-b8457d749-sdhlb"]
Sep 11 14:40:03.859696 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:03.859668    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85537415-c11c-47e5-a17b-37ccac7f1c6a" path="/var/lib/kubelet/pods/85537415-c11c-47e5-a17b-37ccac7f1c6a/volumes"
Sep 11 14:40:03.860086 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:03.860072    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c21ebd3d-e55e-423d-9476-4f04e122f459" path="/var/lib/kubelet/pods/c21ebd3d-e55e-423d-9476-4f04e122f459/volumes"
Sep 11 14:40:03.892497 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:03.892470    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:40:03.897925 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:03.897906    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:40:14.786556 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.786525    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"]
Sep 11 14:40:14.787021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.786869    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85537415-c11c-47e5-a17b-37ccac7f1c6a" containerName="payload-processing"
Sep 11 14:40:14.787021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.786881    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="85537415-c11c-47e5-a17b-37ccac7f1c6a" containerName="payload-processing"
Sep 11 14:40:14.787021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.786892    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c21ebd3d-e55e-423d-9476-4f04e122f459" containerName="maas-api"
Sep 11 14:40:14.787021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.786899    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c21ebd3d-e55e-423d-9476-4f04e122f459" containerName="maas-api"
Sep 11 14:40:14.787021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.786911    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f489e473-98fd-45ab-8a32-8757ce1af1de" containerName="maas-api"
Sep 11 14:40:14.787021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.786916    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f489e473-98fd-45ab-8a32-8757ce1af1de" containerName="maas-api"
Sep 11 14:40:14.787021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.786980    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c21ebd3d-e55e-423d-9476-4f04e122f459" containerName="maas-api"
Sep 11 14:40:14.787021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.786991    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="85537415-c11c-47e5-a17b-37ccac7f1c6a" containerName="payload-processing"
Sep 11 14:40:14.787021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.786997    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f489e473-98fd-45ab-8a32-8757ce1af1de" containerName="maas-api"
Sep 11 14:40:14.789924 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.789908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:14.792658 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.792636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-a6c3fc-serving-cert\""
Sep 11 14:40:14.803933 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.803907    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"]
Sep 11 14:40:14.955666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.955627    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:14.955666 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.955669    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8f4df37-0a83-4016-891b-2e30bd29d0b6-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:14.955905 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.955758    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-metrics-certs\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:14.955905 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:14.955824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jctbc\" (UniqueName: \"kubernetes.io/projected/e8f4df37-0a83-4016-891b-2e30bd29d0b6-kube-api-access-jctbc\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:15.056687 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.056608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-metrics-certs\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:15.056687 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.056644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jctbc\" (UniqueName: \"kubernetes.io/projected/e8f4df37-0a83-4016-891b-2e30bd29d0b6-kube-api-access-jctbc\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:15.056866 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.056770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:15.056866 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.056791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8f4df37-0a83-4016-891b-2e30bd29d0b6-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:15.057421 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.057401    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8f4df37-0a83-4016-891b-2e30bd29d0b6-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:15.059182 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.059156    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:15.059182 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.059165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-metrics-certs\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:15.065695 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.065669    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jctbc\" (UniqueName: \"kubernetes.io/projected/e8f4df37-0a83-4016-891b-2e30bd29d0b6-kube-api-access-jctbc\") pod \"maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:15.100273 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.100247    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:15.377354 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.377326    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"]
Sep 11 14:40:15.379773 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:40:15.379747    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f4df37_0a83_4016_891b_2e30bd29d0b6.slice/crio-8c0a8449e5d9ab2ceb4587a1918f18a46c9c3ac156f6b332db05ef66b033d510 WatchSource:0}: Error finding container 8c0a8449e5d9ab2ceb4587a1918f18a46c9c3ac156f6b332db05ef66b033d510: Status 404 returned error can't find the container with id 8c0a8449e5d9ab2ceb4587a1918f18a46c9c3ac156f6b332db05ef66b033d510
Sep 11 14:40:15.871331 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.871303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9" event={"ID":"e8f4df37-0a83-4016-891b-2e30bd29d0b6","Type":"ContainerStarted","Data":"88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e"}
Sep 11 14:40:15.871652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.871351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:15.871652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.871368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9" event={"ID":"e8f4df37-0a83-4016-891b-2e30bd29d0b6","Type":"ContainerStarted","Data":"8c0a8449e5d9ab2ceb4587a1918f18a46c9c3ac156f6b332db05ef66b033d510"}
Sep 11 14:40:15.892647 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:15.892603    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9" podStartSLOduration=1.471915467 podStartE2EDuration="1.892587371s" totalImagesPullingTime="420.671904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:40:15.890633287 +0000 UTC m=+1512.521384484" watchObservedRunningTime="2026-09-11 14:40:15.892587371 +0000 UTC m=+1512.523338566"
Sep 11 14:40:21.880357 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:21.880328    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:40:23.292654 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.292618    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"]
Sep 11 14:40:23.293113 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.292828    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z" podUID="c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d" containerName="maas-api" containerID="cri-o://6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a" gracePeriod=30
Sep 11 14:40:23.404734 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.404703    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"]
Sep 11 14:40:23.404981 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.404911    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9" podUID="ef789688-c59f-4d4a-a09f-9648ceeee297" containerName="payload-processing" containerID="cri-o://2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861" gracePeriod=30
Sep 11 14:40:23.553861 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.553802    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:40:23.656283 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.656256    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:40:23.729158 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.729106    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-maas-api-tls\") pod \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") "
Sep 11 14:40:23.729333 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.729197    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsfsg\" (UniqueName: \"kubernetes.io/projected/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-kube-api-access-tsfsg\") pod \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") "
Sep 11 14:40:23.729333 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.729283    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-metrics-certs\") pod \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") "
Sep 11 14:40:23.729469 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.729364    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-openshift-service-ca\") pod \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\" (UID: \"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d\") "
Sep 11 14:40:23.729978 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.729946    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d" (UID: "c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:40:23.731539 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.731505    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d" (UID: "c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:40:23.731539 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.731530    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d" (UID: "c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:40:23.731781 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.731757    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-kube-api-access-tsfsg" (OuterVolumeSpecName: "kube-api-access-tsfsg") pod "c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d" (UID: "c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d"). InnerVolumeSpecName "kube-api-access-tsfsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:40:23.830549 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.830476    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef789688-c59f-4d4a-a09f-9648ceeee297-plugins-config-volume\") pod \"ef789688-c59f-4d4a-a09f-9648ceeee297\" (UID: \"ef789688-c59f-4d4a-a09f-9648ceeee297\") "
Sep 11 14:40:23.830549 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.830516    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27gk7\" (UniqueName: \"kubernetes.io/projected/ef789688-c59f-4d4a-a09f-9648ceeee297-kube-api-access-27gk7\") pod \"ef789688-c59f-4d4a-a09f-9648ceeee297\" (UID: \"ef789688-c59f-4d4a-a09f-9648ceeee297\") "
Sep 11 14:40:23.830758 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.830739    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:23.830798 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.830766    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:23.830798 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.830783    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsfsg\" (UniqueName: \"kubernetes.io/projected/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-kube-api-access-tsfsg\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:23.830870 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.830797    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:23.830905 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.830868    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef789688-c59f-4d4a-a09f-9648ceeee297-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ef789688-c59f-4d4a-a09f-9648ceeee297" (UID: "ef789688-c59f-4d4a-a09f-9648ceeee297"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:40:23.832538 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.832509    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef789688-c59f-4d4a-a09f-9648ceeee297-kube-api-access-27gk7" (OuterVolumeSpecName: "kube-api-access-27gk7") pod "ef789688-c59f-4d4a-a09f-9648ceeee297" (UID: "ef789688-c59f-4d4a-a09f-9648ceeee297"). InnerVolumeSpecName "kube-api-access-27gk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:40:23.908032 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.908003    2581 generic.go:356] "Generic (PLEG): container finished" podID="c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d" containerID="6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a" exitCode=0
Sep 11 14:40:23.908165 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.908063    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"
Sep 11 14:40:23.908165 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.908100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z" event={"ID":"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d","Type":"ContainerDied","Data":"6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a"}
Sep 11 14:40:23.908308 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.908184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z" event={"ID":"c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d","Type":"ContainerDied","Data":"cdf8d05d69854b7a9275a2a4959c5fb80f8a3e187fb13bea8cbbf88ea6fb831c"}
Sep 11 14:40:23.908308 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.908220    2581 scope.go:117] "RemoveContainer" containerID="6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a"
Sep 11 14:40:23.909573 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.909549    2581 generic.go:356] "Generic (PLEG): container finished" podID="ef789688-c59f-4d4a-a09f-9648ceeee297" containerID="2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861" exitCode=0
Sep 11 14:40:23.909653 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.909597    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"
Sep 11 14:40:23.909710 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.909593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9" event={"ID":"ef789688-c59f-4d4a-a09f-9648ceeee297","Type":"ContainerDied","Data":"2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861"}
Sep 11 14:40:23.909710 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.909699    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9" event={"ID":"ef789688-c59f-4d4a-a09f-9648ceeee297","Type":"ContainerDied","Data":"d4d178a5843192176c51506181e3a333493ab69386583430ea959199e6261fd1"}
Sep 11 14:40:23.916830 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.916814    2581 scope.go:117] "RemoveContainer" containerID="6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a"
Sep 11 14:40:23.917102 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:40:23.917083    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a\": container with ID starting with 6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a not found: ID does not exist" containerID="6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a"
Sep 11 14:40:23.917201 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.917112    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a"} err="failed to get container status \"6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a\": rpc error: code = NotFound desc = could not find container \"6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a\": container with ID starting with 6321ef7d6ee834384652086b39fcbf1275be61ef6294752f0825058bb2fa8a7a not found: ID does not exist"
Sep 11 14:40:23.917201 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.917134    2581 scope.go:117] "RemoveContainer" containerID="2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861"
Sep 11 14:40:23.924419 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.924390    2581 scope.go:117] "RemoveContainer" containerID="2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861"
Sep 11 14:40:23.924694 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:40:23.924675    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861\": container with ID starting with 2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861 not found: ID does not exist" containerID="2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861"
Sep 11 14:40:23.924757 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.924701    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861"} err="failed to get container status \"2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861\": rpc error: code = NotFound desc = could not find container \"2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861\": container with ID starting with 2f8dd0b1f334ddcd68865c932a8a8b0b3b2017c95c8e7e8b0e47cb7465330861 not found: ID does not exist"
Sep 11 14:40:23.932084 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.932066    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef789688-c59f-4d4a-a09f-9648ceeee297-plugins-config-volume\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:23.932216 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.932086    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27gk7\" (UniqueName: \"kubernetes.io/projected/ef789688-c59f-4d4a-a09f-9648ceeee297-kube-api-access-27gk7\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:23.937637 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.937609    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"]
Sep 11 14:40:23.945457 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.945438    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b934e8-544d4f99bd-wmd6z"]
Sep 11 14:40:23.974913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.974892    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"]
Sep 11 14:40:23.987405 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:23.987384    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b934e8-798557867f-72fb9"]
Sep 11 14:40:25.859834 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:25.859803    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d" path="/var/lib/kubelet/pods/c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d/volumes"
Sep 11 14:40:25.860222 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:25.860152    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef789688-c59f-4d4a-a09f-9648ceeee297" path="/var/lib/kubelet/pods/ef789688-c59f-4d4a-a09f-9648ceeee297/volumes"
Sep 11 14:40:38.267398 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.267319    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"]
Sep 11 14:40:38.267734 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.267658    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef789688-c59f-4d4a-a09f-9648ceeee297" containerName="payload-processing"
Sep 11 14:40:38.267734 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.267669    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef789688-c59f-4d4a-a09f-9648ceeee297" containerName="payload-processing"
Sep 11 14:40:38.267734 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.267680    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d" containerName="maas-api"
Sep 11 14:40:38.267734 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.267685    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d" containerName="maas-api"
Sep 11 14:40:38.267861 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.267740    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7e467d9-7eb5-4fa5-9bc9-61a0a1487a3d" containerName="maas-api"
Sep 11 14:40:38.267861 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.267748    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef789688-c59f-4d4a-a09f-9648ceeee297" containerName="payload-processing"
Sep 11 14:40:38.270682 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.270665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.273545 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.273520    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-625d10-serving-cert\""
Sep 11 14:40:38.282480 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.282458    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"]
Sep 11 14:40:38.352304 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.352279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.352442 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.352336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whkgg\" (UniqueName: \"kubernetes.io/projected/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-kube-api-access-whkgg\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.352442 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.352395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-metrics-certs\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.352528 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.352457    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.453329 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.453295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whkgg\" (UniqueName: \"kubernetes.io/projected/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-kube-api-access-whkgg\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.453329 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.453333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-metrics-certs\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.453585 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.453357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.453585 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.453397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.453585 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:40:38.453502    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-serving-cert: secret "maas-api-e2e-ipp-b-625d10-serving-cert" not found
Sep 11 14:40:38.453585 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:40:38.453578    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-maas-api-tls podName:2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0 nodeName:}" failed. No retries permitted until 2026-09-11 14:40:38.953558161 +0000 UTC m=+1535.584309336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-maas-api-tls") pod "maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp" (UID: "2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0") : secret "maas-api-e2e-ipp-b-625d10-serving-cert" not found
Sep 11 14:40:38.453976 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.453957    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.455795 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.455771    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-metrics-certs\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.462644 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.462625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whkgg\" (UniqueName: \"kubernetes.io/projected/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-kube-api-access-whkgg\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.955204 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.955167    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"]
Sep 11 14:40:38.956821 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.956793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.958856 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.958836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:40:38.959290 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.959271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:38.961575 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.961559    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-625d10-dockercfg-xgrdk\""
Sep 11 14:40:38.961652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.961597    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-625d10\""
Sep 11 14:40:38.973220 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:38.973201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"]
Sep 11 14:40:39.058098 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.058065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95mcx\" (UniqueName: \"kubernetes.io/projected/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-kube-api-access-95mcx\") pod \"payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh\" (UID: \"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:40:39.058265 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.058132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh\" (UID: \"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:40:39.159085 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.159047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95mcx\" (UniqueName: \"kubernetes.io/projected/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-kube-api-access-95mcx\") pod \"payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh\" (UID: \"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:40:39.159287 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.159112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh\" (UID: \"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:40:39.159796 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.159776    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh\" (UID: \"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:40:39.170412 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.170391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95mcx\" (UniqueName: \"kubernetes.io/projected/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-kube-api-access-95mcx\") pod \"payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh\" (UID: \"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:40:39.181318 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.181299    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:39.276358 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.276328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:40:39.460927 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.460891    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"]
Sep 11 14:40:39.462384 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:40:39.462358    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2139bfc8_cec9_49a6_a6e4_c4fecf07f0d0.slice/crio-5e4315041cf8a495977b54fa32a0de7aac9e4e9d9d0f9dcc30157f07ebdb4960 WatchSource:0}: Error finding container 5e4315041cf8a495977b54fa32a0de7aac9e4e9d9d0f9dcc30157f07ebdb4960: Status 404 returned error can't find the container with id 5e4315041cf8a495977b54fa32a0de7aac9e4e9d9d0f9dcc30157f07ebdb4960
Sep 11 14:40:39.553886 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.553862    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"]
Sep 11 14:40:39.555855 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:40:39.555829    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cea5b0_0cf5_4856_8d1f_cf5fbb7dba59.slice/crio-b3e907a911e382675ed729183f72dfed496f174eb4f2d3a200e9d3b480ccfe3a WatchSource:0}: Error finding container b3e907a911e382675ed729183f72dfed496f174eb4f2d3a200e9d3b480ccfe3a: Status 404 returned error can't find the container with id b3e907a911e382675ed729183f72dfed496f174eb4f2d3a200e9d3b480ccfe3a
Sep 11 14:40:39.989116 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.989091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh" event={"ID":"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59","Type":"ContainerStarted","Data":"89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43"}
Sep 11 14:40:39.989228 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.989163    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh" event={"ID":"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59","Type":"ContainerStarted","Data":"b3e907a911e382675ed729183f72dfed496f174eb4f2d3a200e9d3b480ccfe3a"}
Sep 11 14:40:39.989228 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.989192    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:40:39.990544 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:39.990520    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp" event={"ID":"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0","Type":"ContainerStarted","Data":"5e4315041cf8a495977b54fa32a0de7aac9e4e9d9d0f9dcc30157f07ebdb4960"}
Sep 11 14:40:40.013196 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:40.013132    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh" podStartSLOduration=2.013112695 podStartE2EDuration="2.013112695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:40:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:40:40.010352843 +0000 UTC m=+1536.641104040" watchObservedRunningTime="2026-09-11 14:40:40.013112695 +0000 UTC m=+1536.643863892"
Sep 11 14:40:40.996716 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:40.996676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp" event={"ID":"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0","Type":"ContainerStarted","Data":"315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e"}
Sep 11 14:40:41.022689 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:41.022640    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp" podStartSLOduration=2.541861461 podStartE2EDuration="3.022625007s" totalImagesPullingTime="480.763546ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:40:41.020488156 +0000 UTC m=+1537.651239356" watchObservedRunningTime="2026-09-11 14:40:41.022625007 +0000 UTC m=+1537.653376203"
Sep 11 14:40:42.002342 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:42.002314    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:43.866531 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:43.866501    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"]
Sep 11 14:40:43.866983 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:43.866711    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p" podUID="78c3042c-e338-4624-90cc-81558f35bd95" containerName="maas-api" containerID="cri-o://544f8d48233d178ac965a3b77c0fc5149f671a1e90d2b0fc48c031efda388b23" gracePeriod=30
Sep 11 14:40:44.015130 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.015098    2581 generic.go:356] "Generic (PLEG): container finished" podID="78c3042c-e338-4624-90cc-81558f35bd95" containerID="544f8d48233d178ac965a3b77c0fc5149f671a1e90d2b0fc48c031efda388b23" exitCode=0
Sep 11 14:40:44.015303 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.015169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p" event={"ID":"78c3042c-e338-4624-90cc-81558f35bd95","Type":"ContainerDied","Data":"544f8d48233d178ac965a3b77c0fc5149f671a1e90d2b0fc48c031efda388b23"}
Sep 11 14:40:44.109349 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.109327    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:40:44.204678 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.204650    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmpv6\" (UniqueName: \"kubernetes.io/projected/78c3042c-e338-4624-90cc-81558f35bd95-kube-api-access-pmpv6\") pod \"78c3042c-e338-4624-90cc-81558f35bd95\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") "
Sep 11 14:40:44.204843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.204695    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c3042c-e338-4624-90cc-81558f35bd95-openshift-service-ca\") pod \"78c3042c-e338-4624-90cc-81558f35bd95\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") "
Sep 11 14:40:44.204843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.204742    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-maas-api-tls\") pod \"78c3042c-e338-4624-90cc-81558f35bd95\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") "
Sep 11 14:40:44.204843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.204789    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-metrics-certs\") pod \"78c3042c-e338-4624-90cc-81558f35bd95\" (UID: \"78c3042c-e338-4624-90cc-81558f35bd95\") "
Sep 11 14:40:44.205080 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.205056    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78c3042c-e338-4624-90cc-81558f35bd95-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "78c3042c-e338-4624-90cc-81558f35bd95" (UID: "78c3042c-e338-4624-90cc-81558f35bd95"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:40:44.206892 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.206866    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "78c3042c-e338-4624-90cc-81558f35bd95" (UID: "78c3042c-e338-4624-90cc-81558f35bd95"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:40:44.206892 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.206881    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78c3042c-e338-4624-90cc-81558f35bd95-kube-api-access-pmpv6" (OuterVolumeSpecName: "kube-api-access-pmpv6") pod "78c3042c-e338-4624-90cc-81558f35bd95" (UID: "78c3042c-e338-4624-90cc-81558f35bd95"). InnerVolumeSpecName "kube-api-access-pmpv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:40:44.207051 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.206891    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "78c3042c-e338-4624-90cc-81558f35bd95" (UID: "78c3042c-e338-4624-90cc-81558f35bd95"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:40:44.306067 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.306036    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:44.306067 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.306062    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmpv6\" (UniqueName: \"kubernetes.io/projected/78c3042c-e338-4624-90cc-81558f35bd95-kube-api-access-pmpv6\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:44.306067 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.306073    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78c3042c-e338-4624-90cc-81558f35bd95-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:44.306317 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:44.306082    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78c3042c-e338-4624-90cc-81558f35bd95-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:40:45.021630 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:45.021603    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"
Sep 11 14:40:45.021630 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:45.021621    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p" event={"ID":"78c3042c-e338-4624-90cc-81558f35bd95","Type":"ContainerDied","Data":"04f301207133c01a39433516497a5af6a92b80758e01a11929ac35edba3434ee"}
Sep 11 14:40:45.022201 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:45.021672    2581 scope.go:117] "RemoveContainer" containerID="544f8d48233d178ac965a3b77c0fc5149f671a1e90d2b0fc48c031efda388b23"
Sep 11 14:40:45.046630 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:45.046603    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"]
Sep 11 14:40:45.052064 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:45.052042    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-cd8e4a-7b75b44947-9kq5p"]
Sep 11 14:40:45.859718 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:45.859689    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78c3042c-e338-4624-90cc-81558f35bd95" path="/var/lib/kubelet/pods/78c3042c-e338-4624-90cc-81558f35bd95/volumes"
Sep 11 14:40:48.012958 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:48.012928    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:40:50.999161 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:40:50.999116    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:41:00.217495 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:00.217464    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh_82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59/payload-processing/0.log"
Sep 11 14:41:51.745596 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:51.745566    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh_82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59/payload-processing/0.log"
Sep 11 14:41:59.563877 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.563798    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"]
Sep 11 14:41:59.564410 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.564270    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78c3042c-e338-4624-90cc-81558f35bd95" containerName="maas-api"
Sep 11 14:41:59.564410 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.564287    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78c3042c-e338-4624-90cc-81558f35bd95" containerName="maas-api"
Sep 11 14:41:59.564410 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.564368    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78c3042c-e338-4624-90cc-81558f35bd95" containerName="maas-api"
Sep 11 14:41:59.567572 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.567553    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.570445 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.570428    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-902e45-serving-cert\""
Sep 11 14:41:59.580412 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.580388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"]
Sep 11 14:41:59.746608 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.746570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd4ft\" (UniqueName: \"kubernetes.io/projected/c578531c-181b-4009-b418-8ab2bbee3f66-kube-api-access-cd4ft\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.746795 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.746640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.746795 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.746668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c578531c-181b-4009-b418-8ab2bbee3f66-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.746795 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.746706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.848102 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.848014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd4ft\" (UniqueName: \"kubernetes.io/projected/c578531c-181b-4009-b418-8ab2bbee3f66-kube-api-access-cd4ft\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.848102 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.848069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.848102 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.848093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c578531c-181b-4009-b418-8ab2bbee3f66-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.848406 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.848117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.848750 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.848728    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c578531c-181b-4009-b418-8ab2bbee3f66-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.850532 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.850512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.850669 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.850652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.858048 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.858024    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd4ft\" (UniqueName: \"kubernetes.io/projected/c578531c-181b-4009-b418-8ab2bbee3f66-kube-api-access-cd4ft\") pod \"maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:41:59.878250 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:41:59.878227    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:42:00.157735 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:00.157685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"]
Sep 11 14:42:00.160046 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:42:00.160000    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc578531c_181b_4009_b418_8ab2bbee3f66.slice/crio-a245dab89fbcc72d3f54a27631424985babdb932fbc5e64e36f34b059c664ed8 WatchSource:0}: Error finding container a245dab89fbcc72d3f54a27631424985babdb932fbc5e64e36f34b059c664ed8: Status 404 returned error can't find the container with id a245dab89fbcc72d3f54a27631424985babdb932fbc5e64e36f34b059c664ed8
Sep 11 14:42:00.382603 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:00.382566    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx" event={"ID":"c578531c-181b-4009-b418-8ab2bbee3f66","Type":"ContainerStarted","Data":"a245dab89fbcc72d3f54a27631424985babdb932fbc5e64e36f34b059c664ed8"}
Sep 11 14:42:01.388479 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:01.388443    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx" event={"ID":"c578531c-181b-4009-b418-8ab2bbee3f66","Type":"ContainerStarted","Data":"08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd"}
Sep 11 14:42:01.388863 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:01.388509    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:42:01.411178 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:01.411114    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx" podStartSLOduration=1.967578423 podStartE2EDuration="2.411071601s" totalImagesPullingTime="443.493178ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:42:01.410583709 +0000 UTC m=+1618.041334905" watchObservedRunningTime="2026-09-11 14:42:01.411071601 +0000 UTC m=+1618.041822798"
Sep 11 14:42:07.399000 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:07.398972    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:42:38.062162 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.062106    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"]
Sep 11 14:42:38.062701 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.062330    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx" podUID="c578531c-181b-4009-b418-8ab2bbee3f66" containerName="maas-api" containerID="cri-o://08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd" gracePeriod=30
Sep 11 14:42:38.299040 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.299017    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:42:38.367034 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.366951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd4ft\" (UniqueName: \"kubernetes.io/projected/c578531c-181b-4009-b418-8ab2bbee3f66-kube-api-access-cd4ft\") pod \"c578531c-181b-4009-b418-8ab2bbee3f66\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") "
Sep 11 14:42:38.367229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.367093    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-maas-api-tls\") pod \"c578531c-181b-4009-b418-8ab2bbee3f66\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") "
Sep 11 14:42:38.367229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.367150    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c578531c-181b-4009-b418-8ab2bbee3f66-openshift-service-ca\") pod \"c578531c-181b-4009-b418-8ab2bbee3f66\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") "
Sep 11 14:42:38.367229 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.367219    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-metrics-certs\") pod \"c578531c-181b-4009-b418-8ab2bbee3f66\" (UID: \"c578531c-181b-4009-b418-8ab2bbee3f66\") "
Sep 11 14:42:38.367602 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.367572    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c578531c-181b-4009-b418-8ab2bbee3f66-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c578531c-181b-4009-b418-8ab2bbee3f66" (UID: "c578531c-181b-4009-b418-8ab2bbee3f66"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:42:38.369301 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.369246    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c578531c-181b-4009-b418-8ab2bbee3f66-kube-api-access-cd4ft" (OuterVolumeSpecName: "kube-api-access-cd4ft") pod "c578531c-181b-4009-b418-8ab2bbee3f66" (UID: "c578531c-181b-4009-b418-8ab2bbee3f66"). InnerVolumeSpecName "kube-api-access-cd4ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:42:38.369627 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.369603    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c578531c-181b-4009-b418-8ab2bbee3f66" (UID: "c578531c-181b-4009-b418-8ab2bbee3f66"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:42:38.369745 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.369723    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c578531c-181b-4009-b418-8ab2bbee3f66" (UID: "c578531c-181b-4009-b418-8ab2bbee3f66"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:42:38.468203 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.468169    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd4ft\" (UniqueName: \"kubernetes.io/projected/c578531c-181b-4009-b418-8ab2bbee3f66-kube-api-access-cd4ft\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:42:38.468203 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.468207    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:42:38.468392 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.468223    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c578531c-181b-4009-b418-8ab2bbee3f66-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:42:38.468392 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.468236    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c578531c-181b-4009-b418-8ab2bbee3f66-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:42:38.569663 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.569632    2581 generic.go:356] "Generic (PLEG): container finished" podID="c578531c-181b-4009-b418-8ab2bbee3f66" containerID="08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd" exitCode=0
Sep 11 14:42:38.569799 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.569679    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"
Sep 11 14:42:38.569799 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.569717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx" event={"ID":"c578531c-181b-4009-b418-8ab2bbee3f66","Type":"ContainerDied","Data":"08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd"}
Sep 11 14:42:38.569799 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.569773    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx" event={"ID":"c578531c-181b-4009-b418-8ab2bbee3f66","Type":"ContainerDied","Data":"a245dab89fbcc72d3f54a27631424985babdb932fbc5e64e36f34b059c664ed8"}
Sep 11 14:42:38.569913 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.569801    2581 scope.go:117] "RemoveContainer" containerID="08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd"
Sep 11 14:42:38.580021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.580006    2581 scope.go:117] "RemoveContainer" containerID="08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd"
Sep 11 14:42:38.580289 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:42:38.580271    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd\": container with ID starting with 08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd not found: ID does not exist" containerID="08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd"
Sep 11 14:42:38.580345 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.580298    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd"} err="failed to get container status \"08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd\": rpc error: code = NotFound desc = could not find container \"08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd\": container with ID starting with 08638165ae8ed269a03eb2cdc7a67c47d4c13fc76d4cd5be3d6594389b653ddd not found: ID does not exist"
Sep 11 14:42:38.592385 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.592365    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"]
Sep 11 14:42:38.596316 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:38.596293    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-902e45-55df6dfbf-rmsmx"]
Sep 11 14:42:39.858903 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:42:39.858867    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c578531c-181b-4009-b418-8ab2bbee3f66" path="/var/lib/kubelet/pods/c578531c-181b-4009-b418-8ab2bbee3f66/volumes"
Sep 11 14:43:05.165158 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.165108    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"]
Sep 11 14:43:05.165547 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.165368    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9" podUID="e8f4df37-0a83-4016-891b-2e30bd29d0b6" containerName="maas-api" containerID="cri-o://88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e" gracePeriod=30
Sep 11 14:43:05.405906 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.405882    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:43:05.499299 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.499270    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-maas-api-tls\") pod \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") "
Sep 11 14:43:05.499477 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.499318    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-metrics-certs\") pod \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") "
Sep 11 14:43:05.499477 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.499373    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jctbc\" (UniqueName: \"kubernetes.io/projected/e8f4df37-0a83-4016-891b-2e30bd29d0b6-kube-api-access-jctbc\") pod \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") "
Sep 11 14:43:05.499477 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.499407    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8f4df37-0a83-4016-891b-2e30bd29d0b6-openshift-service-ca\") pod \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\" (UID: \"e8f4df37-0a83-4016-891b-2e30bd29d0b6\") "
Sep 11 14:43:05.499830 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.499801    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8f4df37-0a83-4016-891b-2e30bd29d0b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8f4df37-0a83-4016-891b-2e30bd29d0b6" (UID: "e8f4df37-0a83-4016-891b-2e30bd29d0b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:43:05.501561 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.501531    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8f4df37-0a83-4016-891b-2e30bd29d0b6" (UID: "e8f4df37-0a83-4016-891b-2e30bd29d0b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:43:05.501714 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.501686    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8f4df37-0a83-4016-891b-2e30bd29d0b6-kube-api-access-jctbc" (OuterVolumeSpecName: "kube-api-access-jctbc") pod "e8f4df37-0a83-4016-891b-2e30bd29d0b6" (UID: "e8f4df37-0a83-4016-891b-2e30bd29d0b6"). InnerVolumeSpecName "kube-api-access-jctbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:43:05.501759 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.501731    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e8f4df37-0a83-4016-891b-2e30bd29d0b6" (UID: "e8f4df37-0a83-4016-891b-2e30bd29d0b6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:43:05.600809 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.600784    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:43:05.600809 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.600805    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8f4df37-0a83-4016-891b-2e30bd29d0b6-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:43:05.600809 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.600815    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jctbc\" (UniqueName: \"kubernetes.io/projected/e8f4df37-0a83-4016-891b-2e30bd29d0b6-kube-api-access-jctbc\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:43:05.601001 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.600824    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8f4df37-0a83-4016-891b-2e30bd29d0b6-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:43:05.695094 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.695057    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8f4df37-0a83-4016-891b-2e30bd29d0b6" containerID="88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e" exitCode=0
Sep 11 14:43:05.695302 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.695099    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"
Sep 11 14:43:05.695302 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.695158    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9" event={"ID":"e8f4df37-0a83-4016-891b-2e30bd29d0b6","Type":"ContainerDied","Data":"88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e"}
Sep 11 14:43:05.695302 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.695214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9" event={"ID":"e8f4df37-0a83-4016-891b-2e30bd29d0b6","Type":"ContainerDied","Data":"8c0a8449e5d9ab2ceb4587a1918f18a46c9c3ac156f6b332db05ef66b033d510"}
Sep 11 14:43:05.695302 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.695238    2581 scope.go:117] "RemoveContainer" containerID="88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e"
Sep 11 14:43:05.704656 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.704639    2581 scope.go:117] "RemoveContainer" containerID="88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e"
Sep 11 14:43:05.704919 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:43:05.704902    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e\": container with ID starting with 88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e not found: ID does not exist" containerID="88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e"
Sep 11 14:43:05.704967 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.704943    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e"} err="failed to get container status \"88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e\": rpc error: code = NotFound desc = could not find container \"88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e\": container with ID starting with 88521465f480655819a3876733c296f28bd220899e720bfadca80040ea24532e not found: ID does not exist"
Sep 11 14:43:05.723164 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.723101    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"]
Sep 11 14:43:05.725016 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.724997    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a6c3fc-77444c5577-78fj9"]
Sep 11 14:43:05.858695 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:43:05.858633    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8f4df37-0a83-4016-891b-2e30bd29d0b6" path="/var/lib/kubelet/pods/e8f4df37-0a83-4016-891b-2e30bd29d0b6/volumes"
Sep 11 14:44:06.490457 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.490424    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"]
Sep 11 14:44:06.491266 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.490654    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp" podUID="2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0" containerName="maas-api" containerID="cri-o://315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e" gracePeriod=30
Sep 11 14:44:06.559574 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.559538    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"]
Sep 11 14:44:06.559870 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.559811    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh" podUID="82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59" containerName="payload-processing" containerID="cri-o://89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43" gracePeriod=30
Sep 11 14:44:06.796329 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.796308    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:44:06.829151 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.829113    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:44:06.896936 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.896908    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-plugins-config-volume\") pod \"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59\" (UID: \"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59\") "
Sep 11 14:44:06.897074 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.896956    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-metrics-certs\") pod \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") "
Sep 11 14:44:06.897074 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.896998    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95mcx\" (UniqueName: \"kubernetes.io/projected/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-kube-api-access-95mcx\") pod \"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59\" (UID: \"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59\") "
Sep 11 14:44:06.897074 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.897031    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-maas-api-tls\") pod \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") "
Sep 11 14:44:06.897218 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.897189    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whkgg\" (UniqueName: \"kubernetes.io/projected/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-kube-api-access-whkgg\") pod \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") "
Sep 11 14:44:06.897259 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.897242    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-openshift-service-ca\") pod \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\" (UID: \"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0\") "
Sep 11 14:44:06.897392 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.897357    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59" (UID: "82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:06.897694 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.897546    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-plugins-config-volume\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:06.897775 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.897687    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0" (UID: "2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:06.899260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.899235    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0" (UID: "2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:06.899356 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.899292    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0" (UID: "2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:06.899356 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.899307    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-kube-api-access-95mcx" (OuterVolumeSpecName: "kube-api-access-95mcx") pod "82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59" (UID: "82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59"). InnerVolumeSpecName "kube-api-access-95mcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:06.899356 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.899317    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-kube-api-access-whkgg" (OuterVolumeSpecName: "kube-api-access-whkgg") pod "2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0" (UID: "2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0"). InnerVolumeSpecName "kube-api-access-whkgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:06.991734 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.991701    2581 generic.go:356] "Generic (PLEG): container finished" podID="82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59" containerID="89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43" exitCode=0
Sep 11 14:44:06.991734 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.991744    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"
Sep 11 14:44:06.991986 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.991771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh" event={"ID":"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59","Type":"ContainerDied","Data":"89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43"}
Sep 11 14:44:06.991986 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.991832    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh" event={"ID":"82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59","Type":"ContainerDied","Data":"b3e907a911e382675ed729183f72dfed496f174eb4f2d3a200e9d3b480ccfe3a"}
Sep 11 14:44:06.991986 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.991868    2581 scope.go:117] "RemoveContainer" containerID="89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43"
Sep 11 14:44:06.993373 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.993346    2581 generic.go:356] "Generic (PLEG): container finished" podID="2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0" containerID="315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e" exitCode=0
Sep 11 14:44:06.993480 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.993396    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"
Sep 11 14:44:06.993480 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.993417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp" event={"ID":"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0","Type":"ContainerDied","Data":"315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e"}
Sep 11 14:44:06.993480 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.993458    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp" event={"ID":"2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0","Type":"ContainerDied","Data":"5e4315041cf8a495977b54fa32a0de7aac9e4e9d9d0f9dcc30157f07ebdb4960"}
Sep 11 14:44:06.998009 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.997981    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95mcx\" (UniqueName: \"kubernetes.io/projected/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59-kube-api-access-95mcx\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:06.998176 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.998012    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:06.998176 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.998029    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whkgg\" (UniqueName: \"kubernetes.io/projected/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-kube-api-access-whkgg\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:06.998176 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.998043    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:06.998176 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:06.998055    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:07.001105 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:07.001080    2581 scope.go:117] "RemoveContainer" containerID="89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43"
Sep 11 14:44:07.001485 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:44:07.001438    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43\": container with ID starting with 89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43 not found: ID does not exist" containerID="89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43"
Sep 11 14:44:07.001580 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:07.001494    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43"} err="failed to get container status \"89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43\": rpc error: code = NotFound desc = could not find container \"89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43\": container with ID starting with 89d442b7d67e1bcce6d3ea241889b6be19465b2c37de186b2ab1f1df7444db43 not found: ID does not exist"
Sep 11 14:44:07.001580 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:07.001517    2581 scope.go:117] "RemoveContainer" containerID="315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e"
Sep 11 14:44:07.011369 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:07.011327    2581 scope.go:117] "RemoveContainer" containerID="315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e"
Sep 11 14:44:07.011742 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:44:07.011720    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e\": container with ID starting with 315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e not found: ID does not exist" containerID="315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e"
Sep 11 14:44:07.011811 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:07.011750    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e"} err="failed to get container status \"315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e\": rpc error: code = NotFound desc = could not find container \"315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e\": container with ID starting with 315774a523bfdd5d0c6c59abb38434fb6f12e7ad697c75d888b0a7827c40eb8e not found: ID does not exist"
Sep 11 14:44:07.017246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:07.017225    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"]
Sep 11 14:44:07.023209 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:07.023190    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-625d10-6dcdd9fb4c-f2thh"]
Sep 11 14:44:07.036271 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:07.036249    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"]
Sep 11 14:44:07.038235 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:07.038209    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-625d10-6d68d5458-z29mp"]
Sep 11 14:44:07.859233 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:07.859134    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0" path="/var/lib/kubelet/pods/2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0/volumes"
Sep 11 14:44:07.859572 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:07.859507    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59" path="/var/lib/kubelet/pods/82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59/volumes"
Sep 11 14:44:26.188982 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.188951    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"]
Sep 11 14:44:26.189515 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.189169    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz" podUID="570ebffe-17b4-442e-af27-df1d3e7f8edd" containerName="maas-api" containerID="cri-o://e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88" gracePeriod=30
Sep 11 14:44:26.261846 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.261815    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"]
Sep 11 14:44:26.262087 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.262047    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs" podUID="2a021e8b-8244-46b7-9500-087271830260" containerName="payload-processing" containerID="cri-o://aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa" gracePeriod=30
Sep 11 14:44:26.495480 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.495450    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:44:26.546428 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.546398    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:44:26.659220 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.659192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-metrics-certs\") pod \"570ebffe-17b4-442e-af27-df1d3e7f8edd\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") "
Sep 11 14:44:26.659419 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.659237    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/570ebffe-17b4-442e-af27-df1d3e7f8edd-openshift-service-ca\") pod \"570ebffe-17b4-442e-af27-df1d3e7f8edd\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") "
Sep 11 14:44:26.659419 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.659270    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxppj\" (UniqueName: \"kubernetes.io/projected/2a021e8b-8244-46b7-9500-087271830260-kube-api-access-xxppj\") pod \"2a021e8b-8244-46b7-9500-087271830260\" (UID: \"2a021e8b-8244-46b7-9500-087271830260\") "
Sep 11 14:44:26.659419 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.659312    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkd89\" (UniqueName: \"kubernetes.io/projected/570ebffe-17b4-442e-af27-df1d3e7f8edd-kube-api-access-hkd89\") pod \"570ebffe-17b4-442e-af27-df1d3e7f8edd\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") "
Sep 11 14:44:26.659419 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.659334    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a021e8b-8244-46b7-9500-087271830260-plugins-config-volume\") pod \"2a021e8b-8244-46b7-9500-087271830260\" (UID: \"2a021e8b-8244-46b7-9500-087271830260\") "
Sep 11 14:44:26.659419 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.659415    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-maas-api-tls\") pod \"570ebffe-17b4-442e-af27-df1d3e7f8edd\" (UID: \"570ebffe-17b4-442e-af27-df1d3e7f8edd\") "
Sep 11 14:44:26.659705 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.659671    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/570ebffe-17b4-442e-af27-df1d3e7f8edd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "570ebffe-17b4-442e-af27-df1d3e7f8edd" (UID: "570ebffe-17b4-442e-af27-df1d3e7f8edd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:26.659771 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.659743    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a021e8b-8244-46b7-9500-087271830260-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2a021e8b-8244-46b7-9500-087271830260" (UID: "2a021e8b-8244-46b7-9500-087271830260"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:26.661544 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.661516    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "570ebffe-17b4-442e-af27-df1d3e7f8edd" (UID: "570ebffe-17b4-442e-af27-df1d3e7f8edd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:26.661655 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.661540    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/570ebffe-17b4-442e-af27-df1d3e7f8edd-kube-api-access-hkd89" (OuterVolumeSpecName: "kube-api-access-hkd89") pod "570ebffe-17b4-442e-af27-df1d3e7f8edd" (UID: "570ebffe-17b4-442e-af27-df1d3e7f8edd"). InnerVolumeSpecName "kube-api-access-hkd89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:26.661821 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.661796    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "570ebffe-17b4-442e-af27-df1d3e7f8edd" (UID: "570ebffe-17b4-442e-af27-df1d3e7f8edd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:26.661821 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.661810    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a021e8b-8244-46b7-9500-087271830260-kube-api-access-xxppj" (OuterVolumeSpecName: "kube-api-access-xxppj") pod "2a021e8b-8244-46b7-9500-087271830260" (UID: "2a021e8b-8244-46b7-9500-087271830260"). InnerVolumeSpecName "kube-api-access-xxppj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:26.760652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.760584    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:26.760652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.760608    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570ebffe-17b4-442e-af27-df1d3e7f8edd-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:26.760652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.760618    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/570ebffe-17b4-442e-af27-df1d3e7f8edd-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:26.760652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.760628    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxppj\" (UniqueName: \"kubernetes.io/projected/2a021e8b-8244-46b7-9500-087271830260-kube-api-access-xxppj\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:26.760652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.760638    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkd89\" (UniqueName: \"kubernetes.io/projected/570ebffe-17b4-442e-af27-df1d3e7f8edd-kube-api-access-hkd89\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:26.760652 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:26.760647    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a021e8b-8244-46b7-9500-087271830260-plugins-config-volume\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:27.088350 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.088266    2581 generic.go:356] "Generic (PLEG): container finished" podID="2a021e8b-8244-46b7-9500-087271830260" containerID="aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa" exitCode=0
Sep 11 14:44:27.088350 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.088318    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"
Sep 11 14:44:27.088561 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.088351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs" event={"ID":"2a021e8b-8244-46b7-9500-087271830260","Type":"ContainerDied","Data":"aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa"}
Sep 11 14:44:27.088561 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.088400    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs" event={"ID":"2a021e8b-8244-46b7-9500-087271830260","Type":"ContainerDied","Data":"154225c7fd83dd2634ac61a2a1b677587793562eace1f30ddcb02f4f11f465d5"}
Sep 11 14:44:27.088561 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.088427    2581 scope.go:117] "RemoveContainer" containerID="aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa"
Sep 11 14:44:27.089847 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.089821    2581 generic.go:356] "Generic (PLEG): container finished" podID="570ebffe-17b4-442e-af27-df1d3e7f8edd" containerID="e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88" exitCode=0
Sep 11 14:44:27.089960 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.089870    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"
Sep 11 14:44:27.089960 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.089872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz" event={"ID":"570ebffe-17b4-442e-af27-df1d3e7f8edd","Type":"ContainerDied","Data":"e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88"}
Sep 11 14:44:27.090079 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.089997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz" event={"ID":"570ebffe-17b4-442e-af27-df1d3e7f8edd","Type":"ContainerDied","Data":"aba88846f756eee209de0f86c0126838aedab1eed9866940a193f12b669921b6"}
Sep 11 14:44:27.098071 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.098047    2581 scope.go:117] "RemoveContainer" containerID="aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa"
Sep 11 14:44:27.098388 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:44:27.098368    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa\": container with ID starting with aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa not found: ID does not exist" containerID="aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa"
Sep 11 14:44:27.098467 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.098397    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa"} err="failed to get container status \"aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa\": rpc error: code = NotFound desc = could not find container \"aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa\": container with ID starting with aae6fc6005eeb84cb9c86f19155e39f86315554c8f6933f8a2246d251b39b9fa not found: ID does not exist"
Sep 11 14:44:27.098467 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.098421    2581 scope.go:117] "RemoveContainer" containerID="e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88"
Sep 11 14:44:27.105989 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.105972    2581 scope.go:117] "RemoveContainer" containerID="e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88"
Sep 11 14:44:27.106274 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:44:27.106253    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88\": container with ID starting with e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88 not found: ID does not exist" containerID="e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88"
Sep 11 14:44:27.106346 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.106283    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88"} err="failed to get container status \"e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88\": rpc error: code = NotFound desc = could not find container \"e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88\": container with ID starting with e6a4a3583be50ddebf0f1ff79387f62bbb551128fd628174b6df5cfcb589fa88 not found: ID does not exist"
Sep 11 14:44:27.115172 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.115135    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"]
Sep 11 14:44:27.121002 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.120978    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72e046-68b568f6c5-ljqrs"]
Sep 11 14:44:27.131830 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.131806    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"]
Sep 11 14:44:27.136539 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.136514    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-72e046-7bd8f67876-2znjz"]
Sep 11 14:44:27.858645 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.858612    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a021e8b-8244-46b7-9500-087271830260" path="/var/lib/kubelet/pods/2a021e8b-8244-46b7-9500-087271830260/volumes"
Sep 11 14:44:27.859018 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:27.858990    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="570ebffe-17b4-442e-af27-df1d3e7f8edd" path="/var/lib/kubelet/pods/570ebffe-17b4-442e-af27-df1d3e7f8edd/volumes"
Sep 11 14:44:45.105202 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.105169    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"]
Sep 11 14:44:45.105733 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.105411    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6" podUID="f335a9b3-c252-44cb-8f7f-07ff8f3acf92" containerName="maas-api" containerID="cri-o://d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672" gracePeriod=30
Sep 11 14:44:45.350180 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.350157    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:44:45.507259 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.507229    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-metrics-certs\") pod \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") "
Sep 11 14:44:45.507420 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.507301    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-openshift-service-ca\") pod \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") "
Sep 11 14:44:45.507420 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.507337    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jg8l\" (UniqueName: \"kubernetes.io/projected/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-kube-api-access-6jg8l\") pod \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") "
Sep 11 14:44:45.507420 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.507351    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-maas-api-tls\") pod \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\" (UID: \"f335a9b3-c252-44cb-8f7f-07ff8f3acf92\") "
Sep 11 14:44:45.507655 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.507632    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f335a9b3-c252-44cb-8f7f-07ff8f3acf92" (UID: "f335a9b3-c252-44cb-8f7f-07ff8f3acf92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:45.509368 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.509336    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f335a9b3-c252-44cb-8f7f-07ff8f3acf92" (UID: "f335a9b3-c252-44cb-8f7f-07ff8f3acf92"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:45.509471 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.509347    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f335a9b3-c252-44cb-8f7f-07ff8f3acf92" (UID: "f335a9b3-c252-44cb-8f7f-07ff8f3acf92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:45.509471 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.509440    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-kube-api-access-6jg8l" (OuterVolumeSpecName: "kube-api-access-6jg8l") pod "f335a9b3-c252-44cb-8f7f-07ff8f3acf92" (UID: "f335a9b3-c252-44cb-8f7f-07ff8f3acf92"). InnerVolumeSpecName "kube-api-access-6jg8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:45.608767 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.608736    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:45.608767 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.608762    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jg8l\" (UniqueName: \"kubernetes.io/projected/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-kube-api-access-6jg8l\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:45.608767 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.608774    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:45.608999 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:45.608782    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f335a9b3-c252-44cb-8f7f-07ff8f3acf92-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:44:46.187838 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:46.187803    2581 generic.go:356] "Generic (PLEG): container finished" podID="f335a9b3-c252-44cb-8f7f-07ff8f3acf92" containerID="d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672" exitCode=0
Sep 11 14:44:46.188285 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:46.187862    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"
Sep 11 14:44:46.188285 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:46.187882    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6" event={"ID":"f335a9b3-c252-44cb-8f7f-07ff8f3acf92","Type":"ContainerDied","Data":"d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672"}
Sep 11 14:44:46.188285 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:46.187935    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6" event={"ID":"f335a9b3-c252-44cb-8f7f-07ff8f3acf92","Type":"ContainerDied","Data":"c2a8863a788ceb0e5ca569f17af66ac4b21f8fa04d0d50e4d87debd2c3194883"}
Sep 11 14:44:46.188285 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:46.187959    2581 scope.go:117] "RemoveContainer" containerID="d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672"
Sep 11 14:44:46.196670 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:46.196656    2581 scope.go:117] "RemoveContainer" containerID="d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672"
Sep 11 14:44:46.196927 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:44:46.196905    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672\": container with ID starting with d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672 not found: ID does not exist" containerID="d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672"
Sep 11 14:44:46.196989 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:46.196938    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672"} err="failed to get container status \"d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672\": rpc error: code = NotFound desc = could not find container \"d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672\": container with ID starting with d0a4c2446c5ad0c8c1029bc6db882769fac989755bd9d38bdf8f33e009810672 not found: ID does not exist"
Sep 11 14:44:46.212333 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:46.212307    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"]
Sep 11 14:44:46.224232 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:46.224210    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-344045-5cff95cb77-ljwr6"]
Sep 11 14:44:47.858489 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:44:47.858453    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f335a9b3-c252-44cb-8f7f-07ff8f3acf92" path="/var/lib/kubelet/pods/f335a9b3-c252-44cb-8f7f-07ff8f3acf92/volumes"
Sep 11 14:45:03.918212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:45:03.918177    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:45:03.924778 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:45:03.924757    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:47:36.932721 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:36.932679    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"]
Sep 11 14:47:36.933369 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:36.932921    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r" podUID="3b42be2e-0b59-43a7-987b-852ec4791c87" containerName="manager" containerID="cri-o://99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc" gracePeriod=10
Sep 11 14:47:37.175654 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.175627    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:47:37.239741 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.239713    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq8ww\" (UniqueName: \"kubernetes.io/projected/3b42be2e-0b59-43a7-987b-852ec4791c87-kube-api-access-kq8ww\") pod \"3b42be2e-0b59-43a7-987b-852ec4791c87\" (UID: \"3b42be2e-0b59-43a7-987b-852ec4791c87\") "
Sep 11 14:47:37.239914 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.239755    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b42be2e-0b59-43a7-987b-852ec4791c87-extensions-socket-volume\") pod \"3b42be2e-0b59-43a7-987b-852ec4791c87\" (UID: \"3b42be2e-0b59-43a7-987b-852ec4791c87\") "
Sep 11 14:47:37.240100 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.240075    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b42be2e-0b59-43a7-987b-852ec4791c87-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3b42be2e-0b59-43a7-987b-852ec4791c87" (UID: "3b42be2e-0b59-43a7-987b-852ec4791c87"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:47:37.241719 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.241699    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b42be2e-0b59-43a7-987b-852ec4791c87-kube-api-access-kq8ww" (OuterVolumeSpecName: "kube-api-access-kq8ww") pod "3b42be2e-0b59-43a7-987b-852ec4791c87" (UID: "3b42be2e-0b59-43a7-987b-852ec4791c87"). InnerVolumeSpecName "kube-api-access-kq8ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:47:37.340572 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.340539    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq8ww\" (UniqueName: \"kubernetes.io/projected/3b42be2e-0b59-43a7-987b-852ec4791c87-kube-api-access-kq8ww\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:47:37.340572 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.340566    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b42be2e-0b59-43a7-987b-852ec4791c87-extensions-socket-volume\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:47:37.953939 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.953904    2581 generic.go:356] "Generic (PLEG): container finished" podID="3b42be2e-0b59-43a7-987b-852ec4791c87" containerID="99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc" exitCode=0
Sep 11 14:47:37.954322 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.953966    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"
Sep 11 14:47:37.954322 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.953986    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r" event={"ID":"3b42be2e-0b59-43a7-987b-852ec4791c87","Type":"ContainerDied","Data":"99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc"}
Sep 11 14:47:37.954322 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.954041    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r" event={"ID":"3b42be2e-0b59-43a7-987b-852ec4791c87","Type":"ContainerDied","Data":"a0dac37d0c6d3286e1194859e6b96a7492038543028a022dd1b7838b014f4027"}
Sep 11 14:47:37.954322 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.954063    2581 scope.go:117] "RemoveContainer" containerID="99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc"
Sep 11 14:47:37.962809 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.962789    2581 scope.go:117] "RemoveContainer" containerID="6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2"
Sep 11 14:47:37.970852 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.970836    2581 scope.go:117] "RemoveContainer" containerID="99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc"
Sep 11 14:47:37.971240 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:47:37.971213    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc\": container with ID starting with 99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc not found: ID does not exist" containerID="99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc"
Sep 11 14:47:37.971355 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.971248    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc"} err="failed to get container status \"99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc\": rpc error: code = NotFound desc = could not find container \"99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc\": container with ID starting with 99b2887f85eb7a91d7d559ccec27e910a2ac31cea9f7c9baa2a4807bc8485efc not found: ID does not exist"
Sep 11 14:47:37.971355 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.971273    2581 scope.go:117] "RemoveContainer" containerID="6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2"
Sep 11 14:47:37.971624 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:47:37.971599    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2\": container with ID starting with 6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2 not found: ID does not exist" containerID="6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2"
Sep 11 14:47:37.971624 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.971629    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2"} err="failed to get container status \"6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2\": rpc error: code = NotFound desc = could not find container \"6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2\": container with ID starting with 6d57a1fd47ed04485373c6e77d7457f9165a826e13d40cc18ab3cf83ecae15d2 not found: ID does not exist"
Sep 11 14:47:37.972342 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.972319    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"]
Sep 11 14:47:37.978371 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:37.978352    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-c8g6r"]
Sep 11 14:47:39.858375 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:47:39.858337    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b42be2e-0b59-43a7-987b-852ec4791c87" path="/var/lib/kubelet/pods/3b42be2e-0b59-43a7-987b-852ec4791c87/volumes"
Sep 11 14:48:37.684066 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684033    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"]
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684336    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684347    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684358    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b42be2e-0b59-43a7-987b-852ec4791c87" containerName="manager"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684365    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b42be2e-0b59-43a7-987b-852ec4791c87" containerName="manager"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684374    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c578531c-181b-4009-b418-8ab2bbee3f66" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684379    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c578531c-181b-4009-b418-8ab2bbee3f66" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684388    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8f4df37-0a83-4016-891b-2e30bd29d0b6" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684393    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8f4df37-0a83-4016-891b-2e30bd29d0b6" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684401    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a021e8b-8244-46b7-9500-087271830260" containerName="payload-processing"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684408    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a021e8b-8244-46b7-9500-087271830260" containerName="payload-processing"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684414    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f335a9b3-c252-44cb-8f7f-07ff8f3acf92" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684419    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f335a9b3-c252-44cb-8f7f-07ff8f3acf92" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684425    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59" containerName="payload-processing"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684430    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59" containerName="payload-processing"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684436    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="570ebffe-17b4-442e-af27-df1d3e7f8edd" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684442    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="570ebffe-17b4-442e-af27-df1d3e7f8edd" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684491    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b42be2e-0b59-43a7-987b-852ec4791c87" containerName="manager"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684498    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b42be2e-0b59-43a7-987b-852ec4791c87" containerName="manager"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684503    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="570ebffe-17b4-442e-af27-df1d3e7f8edd" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684508    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="82cea5b0-0cf5-4856-8d1f-cf5fbb7dba59" containerName="payload-processing"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684514    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f335a9b3-c252-44cb-8f7f-07ff8f3acf92" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684520    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8f4df37-0a83-4016-891b-2e30bd29d0b6" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684527    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2139bfc8-cec9-49a6-a6e4-c4fecf07f0d0" containerName="maas-api"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684532    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a021e8b-8244-46b7-9500-087271830260" containerName="payload-processing"
Sep 11 14:48:37.684548 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.684537    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c578531c-181b-4009-b418-8ab2bbee3f66" containerName="maas-api"
Sep 11 14:48:37.687316 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.687301    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"
Sep 11 14:48:37.690462 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.690440    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-btkwl\""
Sep 11 14:48:37.701787 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.701764    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"]
Sep 11 14:48:37.805380 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.805351    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl2vq\" (UniqueName: \"kubernetes.io/projected/0222abe3-85ee-44c1-90f1-686b817fc203-kube-api-access-hl2vq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-z2b6m\" (UID: \"0222abe3-85ee-44c1-90f1-686b817fc203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"
Sep 11 14:48:37.805498 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.805411    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0222abe3-85ee-44c1-90f1-686b817fc203-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-z2b6m\" (UID: \"0222abe3-85ee-44c1-90f1-686b817fc203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"
Sep 11 14:48:37.905884 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.905856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0222abe3-85ee-44c1-90f1-686b817fc203-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-z2b6m\" (UID: \"0222abe3-85ee-44c1-90f1-686b817fc203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"
Sep 11 14:48:37.905993 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.905901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl2vq\" (UniqueName: \"kubernetes.io/projected/0222abe3-85ee-44c1-90f1-686b817fc203-kube-api-access-hl2vq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-z2b6m\" (UID: \"0222abe3-85ee-44c1-90f1-686b817fc203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"
Sep 11 14:48:37.906246 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.906229    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0222abe3-85ee-44c1-90f1-686b817fc203-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-z2b6m\" (UID: \"0222abe3-85ee-44c1-90f1-686b817fc203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"
Sep 11 14:48:37.915536 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.915509    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl2vq\" (UniqueName: \"kubernetes.io/projected/0222abe3-85ee-44c1-90f1-686b817fc203-kube-api-access-hl2vq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-z2b6m\" (UID: \"0222abe3-85ee-44c1-90f1-686b817fc203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"
Sep 11 14:48:37.996804 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:37.996779    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"
Sep 11 14:48:38.281817 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:38.281737    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"]
Sep 11 14:48:38.286163 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:48:38.286107    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0222abe3_85ee_44c1_90f1_686b817fc203.slice/crio-5283b57f28a685247d4f2280ce0cd13c548de5f9ae943442183e9abed8bb9239 WatchSource:0}: Error finding container 5283b57f28a685247d4f2280ce0cd13c548de5f9ae943442183e9abed8bb9239: Status 404 returned error can't find the container with id 5283b57f28a685247d4f2280ce0cd13c548de5f9ae943442183e9abed8bb9239
Sep 11 14:48:39.212835 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:39.212801    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m" event={"ID":"0222abe3-85ee-44c1-90f1-686b817fc203","Type":"ContainerStarted","Data":"6d9b1c1d5d952fdecceeff688e2bf3fc6741a8f6ec58d0492f8c5895af8cebcd"}
Sep 11 14:48:39.213262 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:39.212847    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m" event={"ID":"0222abe3-85ee-44c1-90f1-686b817fc203","Type":"ContainerStarted","Data":"5283b57f28a685247d4f2280ce0cd13c548de5f9ae943442183e9abed8bb9239"}
Sep 11 14:48:39.213262 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:39.212904    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"
Sep 11 14:48:39.241574 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:39.241527    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m" podStartSLOduration=2.24151314 podStartE2EDuration="2.24151314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:48:39.239649055 +0000 UTC m=+2015.870400264" watchObservedRunningTime="2026-09-11 14:48:39.24151314 +0000 UTC m=+2015.872264335"
Sep 11 14:48:50.220155 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:48:50.220107    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z2b6m"
Sep 11 14:49:19.387943 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.387908    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"]
Sep 11 14:49:19.388532 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.388395    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b42be2e-0b59-43a7-987b-852ec4791c87" containerName="manager"
Sep 11 14:49:19.388532 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.388416    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b42be2e-0b59-43a7-987b-852ec4791c87" containerName="manager"
Sep 11 14:49:19.391596 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.391576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.394115 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.394094    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-d67d15eb-kserve-self-signed-certs\""
Sep 11 14:49:19.405671 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.405648    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"]
Sep 11 14:49:19.442081 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.442054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tls-certs\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.442081 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.442083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-model-cache\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.442277 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.442102    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-home\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.442277 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.442120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tmp-dir\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.442277 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.442150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-dshm\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.442277 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.442221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkwtd\" (UniqueName: \"kubernetes.io/projected/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-kube-api-access-nkwtd\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.543176 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.543126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tls-certs\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.543313 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.543191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-model-cache\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.543313 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.543228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-home\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.543313 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.543257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tmp-dir\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.543313 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.543283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-dshm\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.543518 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.543321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkwtd\" (UniqueName: \"kubernetes.io/projected/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-kube-api-access-nkwtd\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.543655 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.543632    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-model-cache\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.543890 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.543864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-home\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.543890 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.543884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tmp-dir\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.545731 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.545708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-dshm\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.545898 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.545881    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tls-certs\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.560532 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.560509    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkwtd\" (UniqueName: \"kubernetes.io/projected/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-kube-api-access-nkwtd\") pod \"e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") " pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.700966 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.700941    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:19.972130 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:19.971958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"]
Sep 11 14:49:19.974743 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:49:19.974719    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2aa4cf80_e51b_4446_b07e_c0a269ff24c7.slice/crio-fffa09cfb9c529620d36bc5cb78b3406ab84e69e115d699926854fbd12427c05 WatchSource:0}: Error finding container fffa09cfb9c529620d36bc5cb78b3406ab84e69e115d699926854fbd12427c05: Status 404 returned error can't find the container with id fffa09cfb9c529620d36bc5cb78b3406ab84e69e115d699926854fbd12427c05
Sep 11 14:49:20.398060 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:20.397978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5" event={"ID":"2aa4cf80-e51b-4446-b07e-c0a269ff24c7","Type":"ContainerStarted","Data":"d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69"}
Sep 11 14:49:20.398060 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:20.398015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5" event={"ID":"2aa4cf80-e51b-4446-b07e-c0a269ff24c7","Type":"ContainerStarted","Data":"fffa09cfb9c529620d36bc5cb78b3406ab84e69e115d699926854fbd12427c05"}
Sep 11 14:49:20.419216 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:20.419168    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5" podStartSLOduration=1.419128277 podStartE2EDuration="1.419128277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:49:20.417925176 +0000 UTC m=+2057.048676373" watchObservedRunningTime="2026-09-11 14:49:20.419128277 +0000 UTC m=+2057.049879472"
Sep 11 14:49:29.702186 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:29.702091    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:29.702575 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:29.702181    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:29.714834 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:29.714814    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:49:30.452731 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:49:30.452701    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:50:02.282850 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:02.282820    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"]
Sep 11 14:50:03.945638 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:03.945608    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:50:03.952899 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:03.952878    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:50:17.301115 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.301056    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5" podUID="2aa4cf80-e51b-4446-b07e-c0a269ff24c7" containerName="main" containerID="cri-o://d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69" gracePeriod=45
Sep 11 14:50:17.544492 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.544465    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:50:17.647707 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.647640    2581 generic.go:356] "Generic (PLEG): container finished" podID="2aa4cf80-e51b-4446-b07e-c0a269ff24c7" containerID="d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69" exitCode=0
Sep 11 14:50:17.647707 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.647682    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"
Sep 11 14:50:17.647860 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.647710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5" event={"ID":"2aa4cf80-e51b-4446-b07e-c0a269ff24c7","Type":"ContainerDied","Data":"d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69"}
Sep 11 14:50:17.647860 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.647748    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5" event={"ID":"2aa4cf80-e51b-4446-b07e-c0a269ff24c7","Type":"ContainerDied","Data":"fffa09cfb9c529620d36bc5cb78b3406ab84e69e115d699926854fbd12427c05"}
Sep 11 14:50:17.647860 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.647770    2581 scope.go:117] "RemoveContainer" containerID="d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69"
Sep 11 14:50:17.655620 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.655610    2581 scope.go:117] "RemoveContainer" containerID="d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69"
Sep 11 14:50:17.655896 ip-10-0-134-221 kubenswrapper[2581]: E0911 14:50:17.655879    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69\": container with ID starting with d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69 not found: ID does not exist" containerID="d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69"
Sep 11 14:50:17.655963 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.655908    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69"} err="failed to get container status \"d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69\": rpc error: code = NotFound desc = could not find container \"d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69\": container with ID starting with d2edc881212ff8c50bd31c694daea29b0a50eafc9ffb3ee1e351f28922fb6b69 not found: ID does not exist"
Sep 11 14:50:17.694875 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.694849    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tls-certs\") pod \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") "
Sep 11 14:50:17.694961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.694893    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tmp-dir\") pod \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") "
Sep 11 14:50:17.694961 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.694925    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkwtd\" (UniqueName: \"kubernetes.io/projected/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-kube-api-access-nkwtd\") pod \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") "
Sep 11 14:50:17.695042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.694987    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-home\") pod \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") "
Sep 11 14:50:17.695042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.695014    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-model-cache\") pod \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") "
Sep 11 14:50:17.695042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.695038    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-dshm\") pod \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\" (UID: \"2aa4cf80-e51b-4446-b07e-c0a269ff24c7\") "
Sep 11 14:50:17.695224 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.695187    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2aa4cf80-e51b-4446-b07e-c0a269ff24c7" (UID: "2aa4cf80-e51b-4446-b07e-c0a269ff24c7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:17.695287 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.695271    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tmp-dir\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:50:17.695339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.695293    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-home" (OuterVolumeSpecName: "home") pod "2aa4cf80-e51b-4446-b07e-c0a269ff24c7" (UID: "2aa4cf80-e51b-4446-b07e-c0a269ff24c7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:17.695339 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.695309    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-model-cache" (OuterVolumeSpecName: "model-cache") pod "2aa4cf80-e51b-4446-b07e-c0a269ff24c7" (UID: "2aa4cf80-e51b-4446-b07e-c0a269ff24c7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:17.696843 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.696818    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2aa4cf80-e51b-4446-b07e-c0a269ff24c7" (UID: "2aa4cf80-e51b-4446-b07e-c0a269ff24c7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:50:17.696955 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.696938    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-kube-api-access-nkwtd" (OuterVolumeSpecName: "kube-api-access-nkwtd") pod "2aa4cf80-e51b-4446-b07e-c0a269ff24c7" (UID: "2aa4cf80-e51b-4446-b07e-c0a269ff24c7"). InnerVolumeSpecName "kube-api-access-nkwtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:50:17.697005 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.696993    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-dshm" (OuterVolumeSpecName: "dshm") pod "2aa4cf80-e51b-4446-b07e-c0a269ff24c7" (UID: "2aa4cf80-e51b-4446-b07e-c0a269ff24c7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:17.796149 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.796119    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkwtd\" (UniqueName: \"kubernetes.io/projected/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-kube-api-access-nkwtd\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:50:17.796267 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.796167    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-home\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:50:17.796267 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.796178    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-model-cache\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:50:17.796267 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.796187    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-dshm\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:50:17.796267 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.796195    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa4cf80-e51b-4446-b07e-c0a269ff24c7-tls-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:50:17.966477 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.966443    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"]
Sep 11 14:50:17.970979 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:17.970955    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-d67d15eb-kserve-845cdd7cff-psbv5"]
Sep 11 14:50:19.858574 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:19.858541    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aa4cf80-e51b-4446-b07e-c0a269ff24c7" path="/var/lib/kubelet/pods/2aa4cf80-e51b-4446-b07e-c0a269ff24c7/volumes"
Sep 11 14:50:20.567237 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.567199    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"]
Sep 11 14:50:20.567742 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.567721    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aa4cf80-e51b-4446-b07e-c0a269ff24c7" containerName="main"
Sep 11 14:50:20.567798 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.567745    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aa4cf80-e51b-4446-b07e-c0a269ff24c7" containerName="main"
Sep 11 14:50:20.567851 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.567839    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aa4cf80-e51b-4446-b07e-c0a269ff24c7" containerName="main"
Sep 11 14:50:20.572623 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.572603    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.578217 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.575570    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tvhzt\""
Sep 11 14:50:20.587595 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.587573    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"]
Sep 11 14:50:20.616158 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.616115    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnxtw\" (UniqueName: \"kubernetes.io/projected/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-kube-api-access-mnxtw\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.616250 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.616162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-openshift-service-ca\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.616250 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.616191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-metrics-certs\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.616371 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.616251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-maas-api-tls\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.717062 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.717033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnxtw\" (UniqueName: \"kubernetes.io/projected/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-kube-api-access-mnxtw\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.717266 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.717082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-openshift-service-ca\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.717266 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.717123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-metrics-certs\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.717266 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.717161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-maas-api-tls\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.717798 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.717775    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-openshift-service-ca\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.719617 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.719597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-maas-api-tls\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.719705 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.719622    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-metrics-certs\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.726970 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.726947    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnxtw\" (UniqueName: \"kubernetes.io/projected/fd1f6d6f-26e2-41a0-85e0-af8b0194b33c-kube-api-access-mnxtw\") pod \"maas-api-5c65c6f845-ktmnb\" (UID: \"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c\") " pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:20.887293 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:20.887219    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:21.162594 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:21.162567    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"]
Sep 11 14:50:21.164331 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:50:21.164303    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1f6d6f_26e2_41a0_85e0_af8b0194b33c.slice/crio-7e68d8d297c41b51adfb973047881c7f2db54b61f48ca9decd00def098876100 WatchSource:0}: Error finding container 7e68d8d297c41b51adfb973047881c7f2db54b61f48ca9decd00def098876100: Status 404 returned error can't find the container with id 7e68d8d297c41b51adfb973047881c7f2db54b61f48ca9decd00def098876100
Sep 11 14:50:21.165598 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:21.165580    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:50:21.669074 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:21.669041    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb" event={"ID":"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c","Type":"ContainerStarted","Data":"8ceacb26203fed88442593d86998f808d481504b67554625d9b7cc0522a858ae"}
Sep 11 14:50:21.669218 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:21.669102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb" event={"ID":"fd1f6d6f-26e2-41a0-85e0-af8b0194b33c","Type":"ContainerStarted","Data":"7e68d8d297c41b51adfb973047881c7f2db54b61f48ca9decd00def098876100"}
Sep 11 14:50:21.669218 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:21.669188    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:21.692376 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:21.692331    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb" podStartSLOduration=1.249523261 podStartE2EDuration="1.692315468s" totalImagesPullingTime="442.792207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:50:21.691067878 +0000 UTC m=+2118.321819073" watchObservedRunningTime="2026-09-11 14:50:21.692315468 +0000 UTC m=+2118.323066664"
Sep 11 14:50:27.679223 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:27.679197    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c65c6f845-ktmnb"
Sep 11 14:50:36.572260 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:36.572228    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"]
Sep 11 14:50:36.572676 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:36.572422    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f" podUID="0c6b4ae2-2f09-459b-93c1-724196b1604c" containerName="maas-api" containerID="cri-o://9061daaab4f14a92f3a3b1e2822935469bf3ec8e7ac9e754b4d3e8b458949020" gracePeriod=30
Sep 11 14:50:37.218993 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.218956    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f" podUID="0c6b4ae2-2f09-459b-93c1-724196b1604c" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.29:8443/health\": dial tcp 10.133.0.29:8443: connect: connection refused"
Sep 11 14:50:37.742737 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.742698    2581 generic.go:356] "Generic (PLEG): container finished" podID="0c6b4ae2-2f09-459b-93c1-724196b1604c" containerID="9061daaab4f14a92f3a3b1e2822935469bf3ec8e7ac9e754b4d3e8b458949020" exitCode=0
Sep 11 14:50:37.743062 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.742765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f" event={"ID":"0c6b4ae2-2f09-459b-93c1-724196b1604c","Type":"ContainerDied","Data":"9061daaab4f14a92f3a3b1e2822935469bf3ec8e7ac9e754b4d3e8b458949020"}
Sep 11 14:50:37.812884 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.812861    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:50:37.850021 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.849996    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c6b4ae2-2f09-459b-93c1-724196b1604c-openshift-service-ca\") pod \"0c6b4ae2-2f09-459b-93c1-724196b1604c\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") "
Sep 11 14:50:37.850212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.850052    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5kp5\" (UniqueName: \"kubernetes.io/projected/0c6b4ae2-2f09-459b-93c1-724196b1604c-kube-api-access-m5kp5\") pod \"0c6b4ae2-2f09-459b-93c1-724196b1604c\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") "
Sep 11 14:50:37.850212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.850106    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-metrics-certs\") pod \"0c6b4ae2-2f09-459b-93c1-724196b1604c\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") "
Sep 11 14:50:37.850212 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.850148    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-maas-api-tls\") pod \"0c6b4ae2-2f09-459b-93c1-724196b1604c\" (UID: \"0c6b4ae2-2f09-459b-93c1-724196b1604c\") "
Sep 11 14:50:37.850424 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.850388    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c6b4ae2-2f09-459b-93c1-724196b1604c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c6b4ae2-2f09-459b-93c1-724196b1604c" (UID: "0c6b4ae2-2f09-459b-93c1-724196b1604c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:50:37.852343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.852318    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c6b4ae2-2f09-459b-93c1-724196b1604c-kube-api-access-m5kp5" (OuterVolumeSpecName: "kube-api-access-m5kp5") pod "0c6b4ae2-2f09-459b-93c1-724196b1604c" (UID: "0c6b4ae2-2f09-459b-93c1-724196b1604c"). InnerVolumeSpecName "kube-api-access-m5kp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:50:37.852451 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.852317    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c6b4ae2-2f09-459b-93c1-724196b1604c" (UID: "0c6b4ae2-2f09-459b-93c1-724196b1604c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:50:37.852451 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.852326    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0c6b4ae2-2f09-459b-93c1-724196b1604c" (UID: "0c6b4ae2-2f09-459b-93c1-724196b1604c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:50:37.951042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.951020    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5kp5\" (UniqueName: \"kubernetes.io/projected/0c6b4ae2-2f09-459b-93c1-724196b1604c-kube-api-access-m5kp5\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:50:37.951042 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.951042    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-metrics-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:50:37.951219 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.951051    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c6b4ae2-2f09-459b-93c1-724196b1604c-maas-api-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:50:37.951219 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:37.951059    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c6b4ae2-2f09-459b-93c1-724196b1604c-openshift-service-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\""
Sep 11 14:50:38.748520 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:38.748485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f" event={"ID":"0c6b4ae2-2f09-459b-93c1-724196b1604c","Type":"ContainerDied","Data":"c2ed6b88d2bf89c855d4e211ba19dc06b9be028432a844a787d087457bcf5ce4"}
Sep 11 14:50:38.748925 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:38.748527    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"
Sep 11 14:50:38.748925 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:38.748560    2581 scope.go:117] "RemoveContainer" containerID="9061daaab4f14a92f3a3b1e2822935469bf3ec8e7ac9e754b4d3e8b458949020"
Sep 11 14:50:38.765490 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:38.765469    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"]
Sep 11 14:50:38.772195 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:38.772174    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c98db545c-7zl8f"]
Sep 11 14:50:39.858182 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:39.858128    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c6b4ae2-2f09-459b-93c1-724196b1604c" path="/var/lib/kubelet/pods/0c6b4ae2-2f09-459b-93c1-724196b1604c/volumes"
Sep 11 14:50:55.712319 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:55.712289    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74798b5f56-6ljh5_ca7b7a78-2564-48fd-b149-15d5de96de14/manager/0.log"
Sep 11 14:50:55.719206 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:55.719185    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74798b5f56-6ljh5_ca7b7a78-2564-48fd-b149-15d5de96de14/copy-manifests/0.log"
Sep 11 14:50:56.467329 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:56.467298    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5c65c6f845-ktmnb_fd1f6d6f-26e2-41a0-85e0-af8b0194b33c/maas-api/0.log"
Sep 11 14:50:57.772381 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:57.772349    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rf66q_b723064c-66f4-48a7-aafb-41256d2d598f/manager/1.log"
Sep 11 14:50:58.128194 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:58.128123    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-z2b6m_0222abe3-85ee-44c1-90f1-686b817fc203/manager/0.log"
Sep 11 14:50:58.397160 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:58.397077    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-r65pq_aaa069e6-e382-4cbe-a17e-4b41b2a748cb/manager/1.log"
Sep 11 14:50:58.904003 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:58.903974    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4fj2p_b5d1381d-2842-485b-a936-d68e570da133/discovery/0.log"
Sep 11 14:50:59.019178 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:50:59.019156    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f974d944c-9ljbn_0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0/kube-auth-proxy/0.log"
Sep 11 14:51:00.157394 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:00.157355    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-wcd7c_8a9a02cf-11d4-41b8-81a8-2aeeb7ec5ac7/main/0.log"
Sep 11 14:51:00.391348 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:00.391321    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-z955t_708bd1b0-161d-4fca-868e-859f5f296850/main/0.log"
Sep 11 14:51:09.873490 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:09.873460    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lltwm_1066f894-f0db-4259-8508-dbd6d0bf8009/global-pull-secret-syncer/0.log"
Sep 11 14:51:10.144344 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:10.144264    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xnwmb_a9458942-9c62-4f2d-89b5-9ec9085f42ba/konnectivity-agent/0.log"
Sep 11 14:51:10.252418 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:10.252383    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-221.ec2.internal_cf9210cb0f0acda6060912348c982576/haproxy/0.log"
Sep 11 14:51:14.902619 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:14.902572    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rf66q_b723064c-66f4-48a7-aafb-41256d2d598f/manager/1.log"
Sep 11 14:51:14.905521 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:14.905488    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rf66q_b723064c-66f4-48a7-aafb-41256d2d598f/manager/0.log"
Sep 11 14:51:14.998705 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:14.998678    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-z2b6m_0222abe3-85ee-44c1-90f1-686b817fc203/manager/0.log"
Sep 11 14:51:15.095768 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:15.095745    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-r65pq_aaa069e6-e382-4cbe-a17e-4b41b2a748cb/manager/1.log"
Sep 11 14:51:15.097365 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:15.097348    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-r65pq_aaa069e6-e382-4cbe-a17e-4b41b2a748cb/manager/0.log"
Sep 11 14:51:17.430938 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:17.430905    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mplz7_e402d86b-e14a-4efe-a405-b5e105e91f59/node-exporter/0.log"
Sep 11 14:51:17.461954 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:17.461932    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mplz7_e402d86b-e14a-4efe-a405-b5e105e91f59/kube-rbac-proxy/0.log"
Sep 11 14:51:17.499511 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:17.499489    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mplz7_e402d86b-e14a-4efe-a405-b5e105e91f59/init-textfile/0.log"
Sep 11 14:51:19.690951 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.690925    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"]
Sep 11 14:51:19.691343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.691238    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c6b4ae2-2f09-459b-93c1-724196b1604c" containerName="maas-api"
Sep 11 14:51:19.691343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.691251    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c6b4ae2-2f09-459b-93c1-724196b1604c" containerName="maas-api"
Sep 11 14:51:19.691343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.691327    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c6b4ae2-2f09-459b-93c1-724196b1604c" containerName="maas-api"
Sep 11 14:51:19.694244 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.694217    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.697279 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.697252    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q5bsg\"/\"default-dockercfg-lmmcf\""
Sep 11 14:51:19.698531 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.698510    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q5bsg\"/\"openshift-service-ca.crt\""
Sep 11 14:51:19.698630 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.698579    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q5bsg\"/\"kube-root-ca.crt\""
Sep 11 14:51:19.709588 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.709568    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"]
Sep 11 14:51:19.780738 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.780715    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-podres\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.780738 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.780745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq5v4\" (UniqueName: \"kubernetes.io/projected/2587ca50-4e50-42ac-961f-630e3343c4f9-kube-api-access-tq5v4\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.780917 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.780780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-proc\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.780917 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.780845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-sys\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.780917 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.780886    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-lib-modules\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.881465 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.881440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-lib-modules\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.881576 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.881490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-podres\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.881576 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.881510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq5v4\" (UniqueName: \"kubernetes.io/projected/2587ca50-4e50-42ac-961f-630e3343c4f9-kube-api-access-tq5v4\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.881576 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.881549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-proc\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.881576 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.881569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-sys\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.881768 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.881600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-podres\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.881768 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.881602    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-lib-modules\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.881768 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.881651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-proc\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.881768 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.881707    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2587ca50-4e50-42ac-961f-630e3343c4f9-sys\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:19.891167 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:19.891120    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq5v4\" (UniqueName: \"kubernetes.io/projected/2587ca50-4e50-42ac-961f-630e3343c4f9-kube-api-access-tq5v4\") pod \"perf-node-gather-daemonset-n6skh\" (UID: \"2587ca50-4e50-42ac-961f-630e3343c4f9\") " pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:20.004070 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:20.004003    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:20.285352 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:20.285322    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"]
Sep 11 14:51:20.286268 ip-10-0-134-221 kubenswrapper[2581]: W0911 14:51:20.286237    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2587ca50_4e50_42ac_961f_630e3343c4f9.slice/crio-e32512afff2fceeb7eaca3e3cad9c70ede3bc3e63cb696d157e6c12b019b6787 WatchSource:0}: Error finding container e32512afff2fceeb7eaca3e3cad9c70ede3bc3e63cb696d157e6c12b019b6787: Status 404 returned error can't find the container with id e32512afff2fceeb7eaca3e3cad9c70ede3bc3e63cb696d157e6c12b019b6787
Sep 11 14:51:20.422049 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:20.422025    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/2.log"
Sep 11 14:51:20.426076 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:20.426056    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dh7sx_b29ec053-9e8e-439d-87f4-e40e1aa71b09/console-operator/3.log"
Sep 11 14:51:20.933295 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:20.933252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh" event={"ID":"2587ca50-4e50-42ac-961f-630e3343c4f9","Type":"ContainerStarted","Data":"f675b7b7d47964061ebb9a3495c3dbde90e1f8de20a6f8b17ae6352ee794bba5"}
Sep 11 14:51:20.933692 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:20.933343    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh" event={"ID":"2587ca50-4e50-42ac-961f-630e3343c4f9","Type":"ContainerStarted","Data":"e32512afff2fceeb7eaca3e3cad9c70ede3bc3e63cb696d157e6c12b019b6787"}
Sep 11 14:51:20.933692 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:20.933439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:20.955825 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:20.955779    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh" podStartSLOduration=1.95576471 podStartE2EDuration="1.95576471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:51:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:51:20.955080495 +0000 UTC m=+2177.585831690" watchObservedRunningTime="2026-09-11 14:51:20.95576471 +0000 UTC m=+2177.586515905"
Sep 11 14:51:21.028677 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:21.028652    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5565fcd579-66bxx_66f82e05-62e1-43f6-819a-cbf15fa30613/console/0.log"
Sep 11 14:51:21.725721 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:21.725694    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-r5wbk_faa554ea-ea88-4591-8954-eb1997352f84/volume-data-source-validator/0.log"
Sep 11 14:51:22.895826 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:22.895796    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7zb8_142fce86-4363-43cb-bd13-1e08a51edd69/dns/0.log"
Sep 11 14:51:22.917748 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:22.917725    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7zb8_142fce86-4363-43cb-bd13-1e08a51edd69/kube-rbac-proxy/0.log"
Sep 11 14:51:22.991473 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:22.991451    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pc9xn_18888f5e-6492-4e3a-91f0-1df8358261ac/dns-node-resolver/0.log"
Sep 11 14:51:23.628925 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:23.628897    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jr657_f5a0754a-01e9-4d0e-8572-6bbd7143bc6b/node-ca/0.log"
Sep 11 14:51:24.982216 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:24.982185    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4fj2p_b5d1381d-2842-485b-a936-d68e570da133/discovery/0.log"
Sep 11 14:51:25.006909 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:25.006883    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f974d944c-9ljbn_0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0/kube-auth-proxy/0.log"
Sep 11 14:51:26.169541 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:26.169510    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tx98m_92d16529-45cb-49bf-9dc9-fcb18447e4f1/serve-healthcheck-canary/0.log"
Sep 11 14:51:26.796359 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:26.796326    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-wkp6k_3068a765-444a-4f9c-9715-bec5001fd870/insights-operator/0.log"
Sep 11 14:51:26.796533 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:26.796439    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-wkp6k_3068a765-444a-4f9c-9715-bec5001fd870/insights-operator/1.log"
Sep 11 14:51:26.891343 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:26.891317    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8wff_13d27bfe-8add-49c7-9e88-a7ed36a78c23/kube-rbac-proxy/0.log"
Sep 11 14:51:26.915368 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:26.915336    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8wff_13d27bfe-8add-49c7-9e88-a7ed36a78c23/exporter/0.log"
Sep 11 14:51:26.940614 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:26.940595    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8wff_13d27bfe-8add-49c7-9e88-a7ed36a78c23/extractor/0.log"
Sep 11 14:51:26.946264 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:26.946246    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q5bsg/perf-node-gather-daemonset-n6skh"
Sep 11 14:51:30.226883 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:30.226851    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74798b5f56-6ljh5_ca7b7a78-2564-48fd-b149-15d5de96de14/manager/0.log"
Sep 11 14:51:30.261282 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:30.261247    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74798b5f56-6ljh5_ca7b7a78-2564-48fd-b149-15d5de96de14/copy-manifests/0.log"
Sep 11 14:51:30.526486 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:30.526416    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4fj2p_b5d1381d-2842-485b-a936-d68e570da133/discovery/0.log"
Sep 11 14:51:30.538712 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:30.538686    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f974d944c-9ljbn_0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0/kube-auth-proxy/0.log"
Sep 11 14:51:31.878566 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:31.878519    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4z9zl_3ce4e1bf-a58e-4687-8337-3a4635027536/openshift-lws-operator/0.log"
Sep 11 14:51:32.422387 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:32.422358    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4fj2p_b5d1381d-2842-485b-a936-d68e570da133/discovery/0.log"
Sep 11 14:51:32.440089 ip-10-0-134-221 kubenswrapper[2581]: I0911 14:51:32.440065    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f974d944c-9ljbn_0ddfce7d-f1ee-4b74-9cee-2ebc5f729cd0/kube-auth-proxy/0.log"