Sep 09 20:30:19.579624 ip-10-0-137-148 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 20:30:19.579639 ip-10-0-137-148 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 20:30:19.579648 ip-10-0-137-148 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 20:30:19.580085 ip-10-0-137-148 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 20:30:29.828499 ip-10-0-137-148 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 20:30:29.828519 ip-10-0-137-148 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6c71ccd424d74f16a63faf90b953bed2 --
Sep 09 20:32:19.642333 ip-10-0-137-148 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 20:32:20.091667 ip-10-0-137-148 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:32:20.091667 ip-10-0-137-148 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 20:32:20.091667 ip-10-0-137-148 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:32:20.091667 ip-10-0-137-148 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 20:32:20.091667 ip-10-0-137-148 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:32:20.092376 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.091747    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 20:32:20.095303 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095286    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:32:20.095303 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095302    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095307    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095310    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095313    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095316    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095319    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095323    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095325    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095328    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095331    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095333    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095336    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095339    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095342    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095344    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095347    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095349    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095352    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095355    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095357    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:32:20.095366 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095366    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095369    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095372    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095375    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095378    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095381    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095383    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095386    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095388    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095391    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095394    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095396    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095399    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095402    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095404    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095407    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095409    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095412    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095414    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:32:20.095837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095417    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095419    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095422    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095424    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095427    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095429    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095432    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095434    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095437    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095440    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095443    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095445    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095448    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095450    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095453    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095456    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095458    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095461    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095464    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095466    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:32:20.096312 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095470    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095472    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095475    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095478    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095480    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095483    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095486    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095488    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095491    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095494    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095499    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095503    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095507    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095510    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095514    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095517    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095520    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095523    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095526    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:32:20.096787 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095529    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095532    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095535    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095538    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095542    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095546    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095549    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095552    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095555    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095559    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095562    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095565    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095567    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095570    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095572    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095575    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095578    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095580    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095583    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:32:20.097258 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.095585    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096267    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096273    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096276    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096279    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096281    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096289    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096292    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096295    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096297    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096300    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096303    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096306    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096309    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096312    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096314    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096317    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096320    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096323    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096325    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:32:20.097751 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096328    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096331    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096334    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096337    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096339    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096342    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096345    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096347    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096350    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096353    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096355    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096358    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096361    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096363    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096366    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096368    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096371    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096374    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096377    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096380    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096383    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:32:20.098337 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096385    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096388    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096390    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096393    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096396    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096398    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096402    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096406    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096409    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096412    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096415    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096418    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096421    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096424    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096427    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096430    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096432    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096435    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096438    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:32:20.098852 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096440    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096443    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096445    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096448    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096450    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096453    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096455    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096458    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096461    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096463    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096466    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096469    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096472    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096474    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096477    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096479    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096482    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096485    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096487    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:32:20.099327 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096490    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096492    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096495    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096498    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096500    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096503    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096505    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096509    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096511    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096514    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096516    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096519    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096523    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096526    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096531    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096534    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096537    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096540    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096543    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:32:20.099788 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096545    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096548    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096909    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096915    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096918    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096921    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096924    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096927    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096930    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096933    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096936    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096941    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096943    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096946    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096948    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096951    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096954    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096957    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096959    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096962    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:32:20.100267 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096964    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096967    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096970    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096972    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096975    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096978    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096980    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096983    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096986    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096988    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096991    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096994    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096996    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.096999    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097001    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097004    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097006    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097009    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097013    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097017    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:32:20.100761 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097020    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097023    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097026    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097030    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097033    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097035    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097038    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097041    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097043    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097046    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097064    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097067    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097069    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097072    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097075    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097077    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097080    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097083    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097085    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097088    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:32:20.101291 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097092    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097095    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097098    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097100    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097103    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097106    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097108    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097111    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097113    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097116    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097119    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097121    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097124    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097127    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097129    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097134    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097136    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097139    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097142    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097144    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:32:20.101770 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097147    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097149    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097152    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097155    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097158    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097160    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097163    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097165    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097167    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097170    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097172    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097175    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097177    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097180    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097184    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097187    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097191    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097194    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:32:20.102263 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097197    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097200    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097203    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097274    2576 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097305    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097310    2576 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097314    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097320    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097323    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097327    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097331    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097334    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097337    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097341    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097344    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097347    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097350    2576 flags.go:64] FLAG: --cgroup-root=""
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097354    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097357    2576 flags.go:64] FLAG: --client-ca-file=""
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097360    2576 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097363    2576 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097369    2576 flags.go:64] FLAG: --cluster-domain=""
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097372    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097375    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 20:32:20.102755 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097378    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097381    2576 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097385    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097388    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097391    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097394    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097397    2576 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097400    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097402    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097405    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097408    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097412    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097415    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097418    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097421    2576 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097424    2576 flags.go:64] FLAG: --enable-server="true"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097427    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097432    2576 flags.go:64] FLAG: --event-burst="100"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097435    2576 flags.go:64] FLAG: --event-qps="50"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097439    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097441    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097459    2576 flags.go:64] FLAG: --eviction-hard=""
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097466    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097470    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097473    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 20:32:20.103327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097481    2576 flags.go:64] FLAG: --eviction-soft=""
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097484    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097487    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097490    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097493    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097495    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097498    2576 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097501    2576 flags.go:64] FLAG: --feature-gates=""
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097505    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097508    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097511    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097514    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097517    2576 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097520    2576 flags.go:64] FLAG: --help="false"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097523    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097526    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097529    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097532    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097535    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097538    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097541    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097544    2576 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097547    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 20:32:20.103923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097549    2576 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097553    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097557    2576 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097559    2576 flags.go:64] FLAG: --kube-reserved=""
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097562    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097565    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097568    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097571    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097574    2576 flags.go:64] FLAG: --lock-file=""
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097579    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097581    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097585    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097590    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097593    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097595    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097598    2576 flags.go:64] FLAG: --logging-format="text"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097601    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097604    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097607    2576 flags.go:64] FLAG: --manifest-url=""
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097610    2576 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097614    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097617    2576 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097621    2576 flags.go:64] FLAG: --max-pods="110"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097624    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097627    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 20:32:20.104708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097630    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097633    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097636    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097638    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097641    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097649    2576 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097652    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097655    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097658    2576 flags.go:64] FLAG: --pod-cidr=""
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097661    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097667    2576 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097670    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097673    2576 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097676    2576 flags.go:64] FLAG: --port="10250"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097680    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097682    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dfde68229dee5085"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097687    2576 flags.go:64] FLAG: --qos-reserved=""
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097690    2576 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097693    2576 flags.go:64] FLAG: --register-node="true"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097696    2576 flags.go:64] FLAG: --register-with-taints=""
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097699    2576 flags.go:64] FLAG: --registry-burst="10"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097702    2576 flags.go:64] FLAG: --registry-qps="5"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097705    2576 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097707    2576 flags.go:64] FLAG: --reserved-memory=""
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097711    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 20:32:20.105845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097714    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097717    2576 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097720    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097723    2576 flags.go:64] FLAG: --runonce="false"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097725    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097728    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097731    2576 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097734    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097737    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097740    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097743    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097746    2576 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097748    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097751    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097754    2576 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097757    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097763    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097766    2576 flags.go:64] FLAG: --system-cgroups=""
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097769    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097774    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097777    2576 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097780    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097784    2576 flags.go:64] FLAG: --tls-min-version=""
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097789    2576 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097791    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 20:32:20.106910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097794    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097797    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097800    2576 flags.go:64] FLAG: --v="2"
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097803    2576 flags.go:64] FLAG: --version="false"
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097807    2576 flags.go:64] FLAG: --vmodule=""
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097810    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.097814    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097924    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097929    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097932    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097935    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097938    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097940    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097944    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097948    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097951    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097953    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097956    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097959    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097962    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097965    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:32:20.107627 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097967    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097970    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097974    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097976    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097979    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097982    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097985    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097987    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097990    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097993    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097996    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.097999    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098001    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098004    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098006    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098009    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098011    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098014    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098016    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098019    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:32:20.108526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098021    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098024    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098026    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098029    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098031    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098034    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098036    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098039    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098041    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098044    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098046    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098061    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098064    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098067    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098071    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098074    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098076    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098079    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098082    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:32:20.109377 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098085    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098088    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098091    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098094    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098097    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098099    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098102    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098104    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098107    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098109    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098112    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098115    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098117    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098120    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098122    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098125    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098128    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098130    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098133    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098135    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:32:20.109866 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098138    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098141    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098143    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098147    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098150    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098153    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098157    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098160    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098163    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098166    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098168    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098172    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098174    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098177    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098181    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098183    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098187    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098190    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098193    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:32:20.110735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098197    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098199    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098202    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098205    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098208    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098210    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.098213    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.098788    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.106924    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.106945    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.107718    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.107732    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107828    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107837    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107843    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:32:20.111478 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107848    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107853    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107857    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107862    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107867    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107871    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107876    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107880    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107884    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107888    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107893    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107897    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107901    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107905    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107911    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107915    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107919    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107923    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107930    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:32:20.112047 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107936    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107940    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107944    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107949    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107953    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107957    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107962    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107975    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107979    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107984    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107988    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107993    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.107997    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108001    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108005    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108009    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108013    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108018    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108022    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108025    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:32:20.112766 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108029    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108034    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108041    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108047    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108066    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108072    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108077    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108081    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108086    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108091    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108095    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108099    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108103    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108107    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108112    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108117    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108121    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108126    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108131    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108136    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:32:20.113343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108149    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108154    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108158    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108162    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108166    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108170    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108175    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108179    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108183    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108188    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108192    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108197    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108201    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108205    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108210    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108214    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108218    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108222    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108226    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108230    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:32:20.113835 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108234    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108238    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108242    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108247    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108251    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108255    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108259    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108263    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108267    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108271    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108278    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108284    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108289    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108301    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108305    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108309    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:32:20.114328 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108313    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.108321    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108540    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108548    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108553    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108557    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108562    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108566    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108570    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108574    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108578    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108583    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108587    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108591    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108595    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:32:20.114729 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108599    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108603    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108608    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108612    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108616    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108620    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108624    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108628    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108632    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108636    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108640    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108645    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108649    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108653    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108658    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108670    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108675    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108680    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108687    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:32:20.115113 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108691    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108695    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108700    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108704    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108709    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108713    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108717    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108721    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108724    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108728    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108733    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108737    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108741    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108745    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108749    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108753    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108757    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108761    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108765    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108769    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:32:20.115579 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108773    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108777    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108782    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108786    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108790    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108794    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108798    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108803    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108807    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108818    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108823    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108827    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108831    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108835    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108839    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108843    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108847    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108851    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108855    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108859    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:32:20.116064 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108863    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108867    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108871    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108876    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108882    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108887    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108894    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108899    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108904    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108909    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108914    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108918    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108923    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108927    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108931    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108936    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108940    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108944    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108948    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:32:20.116549 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108952    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108957    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108961    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108973    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108977    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108981    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108985    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:20.108989    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.108997    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.109197    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.114820    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.115717    2576 server.go:1019] "Starting client certificate rotation"
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.115810    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 20:32:20.117011 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.116384    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 20:32:20.119405 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.119391    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 20:32:20.120627 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.120609    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 20:32:20.128296 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.128279    2576 log.go:25] "Validated CRI v1 runtime API"
Sep 09 20:32:20.133549 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.133534    2576 log.go:25] "Validated CRI v1 image API"
Sep 09 20:32:20.134478 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.134464    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 20:32:20.136700 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.136679    2576 fs.go:135] Filesystem UUIDs: map[4bc087e7-bb83-496a-b156-cf94c4a88b46:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ebdc2091-8059-4a80-8d24-160f2ede0746:/dev/nvme0n1p3]
Sep 09 20:32:20.136766 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.136700    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 20:32:20.143472 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.143356    2576 manager.go:216] Machine: {Timestamp:2026-09-09 20:32:20.141509327 +0000 UTC m=+0.386337900 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098998 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20b1a4685302c30b65e6264934acc5 SystemUUID:ec20b1a4-6853-02c3-0b65-e6264934acc5 BootID:6c71ccd4-24d7-4f16-a63f-af90b953bed2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:0e:d9:bb:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:0e:d9:bb:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:75:be:63:58:11 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 20:32:20.143472 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.143466    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 20:32:20.143585 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.143571    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 20:32:20.143694 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.143680    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 20:32:20.147833 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.147813    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 20:32:20.147984 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.147836    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-148.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 20:32:20.148484 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.148473    2576 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 20:32:20.148519 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.148487    2576 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 20:32:20.148519 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.148500    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 20:32:20.148575 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.148520    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 20:32:20.149831 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.149821    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 20:32:20.154248 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.154237    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 20:32:20.154359 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.154350    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 20:32:20.154389 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.154378    2576 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 20:32:20.154419 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.154396    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 20:32:20.154419 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.154407    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 20:32:20.154419 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.154416    2576 kubelet.go:398] "Adding apiserver pod source"
Sep 09 20:32:20.154509 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.154430    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 20:32:20.154855 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.154838    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 20:32:20.154899 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.154893    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 20:32:20.157660 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.157639    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 20:32:20.159839 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.159825    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 20:32:20.159887 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.159856    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 20:32:20.160038 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160027    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 20:32:20.160094 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160042    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 20:32:20.160094 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160061    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 20:32:20.160094 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160071    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 20:32:20.160094 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160081    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 20:32:20.160094 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160086    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 20:32:20.160910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160895    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 20:32:20.160910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160910    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 20:32:20.160975 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160917    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 20:32:20.160975 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160923    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 20:32:20.160975 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160931    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 20:32:20.160975 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160940    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 20:32:20.160975 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160960    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 20:32:20.160975 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.160966    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 20:32:20.163608 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.163591    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-148.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 20:32:20.163678 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.163602    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 20:32:20.163678 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.163651    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-148.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 20:32:20.164507 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.164496    2576 server.go:1268] "Started kubelet"
Sep 09 20:32:20.164648 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.164596    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 20:32:20.164777 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.164641    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 20:32:20.164777 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.164703    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 20:32:20.165405 ip-10-0-137-148 systemd[1]: Started Kubernetes Kubelet.
Sep 09 20:32:20.166509 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.165906    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 20:32:20.166509 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.166239    2576 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 20:32:20.169383 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.168396    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 20:32:20.171094 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.170285    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-148.ec2.internal.18d3c13befabdc82  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-148.ec2.internal,UID:ip-10-0-137-148.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-148.ec2.internal,},FirstTimestamp:2026-09-09 20:32:20.164467842 +0000 UTC m=+0.409296415,LastTimestamp:2026-09-09 20:32:20.164467842 +0000 UTC m=+0.409296415,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-148.ec2.internal,}"
Sep 09 20:32:20.171281 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.171268    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 20:32:20.171330 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.171278    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 20:32:20.171407 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.171387    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 20:32:20.171863 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.171846    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 20:32:20.171863 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.171861    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 20:32:20.172011 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.171888    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 20:32:20.172118 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.172104    2576 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 20:32:20.172118 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.172118    2576 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 20:32:20.172218 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.172144    2576 factory.go:55] Registering systemd factory
Sep 09 20:32:20.172218 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.172161    2576 factory.go:223] Registration of the systemd container factory successfully
Sep 09 20:32:20.172413 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.172389    2576 factory.go:153] Registering CRI-O factory
Sep 09 20:32:20.172413 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.172414    2576 factory.go:223] Registration of the crio container factory successfully
Sep 09 20:32:20.172516 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.172479    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 20:32:20.172516 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.172509    2576 factory.go:103] Registering Raw factory
Sep 09 20:32:20.172616 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.172524    2576 manager.go:1196] Started watching for new ooms in manager
Sep 09 20:32:20.172970 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.172956    2576 manager.go:349] Starting recovery of all containers
Sep 09 20:32:20.175241 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.175216    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hljt5"
Sep 09 20:32:20.178699 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.178671    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-148.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 20:32:20.178871 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.178848    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 20:32:20.182808 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.182792    2576 manager.go:354] Recovery completed
Sep 09 20:32:20.186504 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.185328    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hljt5"
Sep 09 20:32:20.187130 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.187118    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:32:20.188816 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.188800    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:32:20.188893 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.188828    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:32:20.188893 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.188840    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:32:20.189375 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.189349    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 20:32:20.189375 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.189366    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 20:32:20.189462 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.189382    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 20:32:20.189462 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.189403    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:32:20.190336 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.190267    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:32:20.190336 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.190291    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:32:20.190336 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.190303    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:32:20.191357 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.191284    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-148.ec2.internal.18d3c13bf11f5e12  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-148.ec2.internal,UID:ip-10-0-137-148.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-148.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-148.ec2.internal,},FirstTimestamp:2026-09-09 20:32:20.188814866 +0000 UTC m=+0.433643437,LastTimestamp:2026-09-09 20:32:20.188814866 +0000 UTC m=+0.433643437,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-148.ec2.internal,}"
Sep 09 20:32:20.192133 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.192117    2576 policy_none.go:49] "None policy: Start"
Sep 09 20:32:20.192230 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.192137    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 20:32:20.192230 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.192150    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 20:32:20.194964 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.194923    2576 policy_none.go:47] "Start"
Sep 09 20:32:20.218665 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.218648    2576 manager.go:337] "Starting Device Plugin manager"
Sep 09 20:32:20.218850 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.218694    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 20:32:20.218850 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.218708    2576 server.go:87] "Starting device plugin registration server"
Sep 09 20:32:20.219068 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.219038    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 20:32:20.219123 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.219070    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 20:32:20.219169 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.219133    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 20:32:20.219220 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.219211    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 20:32:20.219267 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.219221    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 20:32:20.219860 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.219838    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 20:32:20.219942 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.219888    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 20:32:20.275899 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.275873    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 20:32:20.277871 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.276939    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 20:32:20.277871 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.276990    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 20:32:20.277871 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.277017    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 20:32:20.277871 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.277103    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 20:32:20.279295 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.279272    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:32:20.319329 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.319311    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:32:20.320253 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.320238    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:32:20.320346 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.320266    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:32:20.320346 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.320276    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:32:20.320346 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.320300    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.329411 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.329396    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.329485 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.329415    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-148.ec2.internal\": node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 20:32:20.346802 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.346740    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 20:32:20.377845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.377823    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"]
Sep 09 20:32:20.377921 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.377881    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:32:20.379230 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.379215    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:32:20.379303 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.379244    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:32:20.379303 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.379255    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:32:20.381399 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.381388    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:32:20.381516 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.381503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.381554 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.381534    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:32:20.382103 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.382080    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:32:20.382103 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.382081    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:32:20.382228 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.382114    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:32:20.382228 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.382129    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:32:20.382228 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.382116    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:32:20.382228 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.382196    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:32:20.384277 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.384262    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.384336 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.384292    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:32:20.385017 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.385003    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:32:20.385092 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.385027    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:32:20.385092 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.385036    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:32:20.414778 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.414759    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-148.ec2.internal\" not found" node="ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.418010 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.417995    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-148.ec2.internal\" not found" node="ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.447099 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.447081    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 20:32:20.473540 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.473521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.473623 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.473546    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.473623 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.473563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07650a7db62586f9e69be13fe56d6e10-config\") pod \"kube-apiserver-proxy-ip-10-0-137-148.ec2.internal\" (UID: \"07650a7db62586f9e69be13fe56d6e10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.547574 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.547552    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 20:32:20.573902 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.573877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.573977 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.573908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.573977 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.573925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07650a7db62586f9e69be13fe56d6e10-config\") pod \"kube-apiserver-proxy-ip-10-0-137-148.ec2.internal\" (UID: \"07650a7db62586f9e69be13fe56d6e10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.573977 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.573949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07650a7db62586f9e69be13fe56d6e10-config\") pod \"kube-apiserver-proxy-ip-10-0-137-148.ec2.internal\" (UID: \"07650a7db62586f9e69be13fe56d6e10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.574105 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.573963    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.574105 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.573984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae075c190650950e327ad43f6cd7f70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal\" (UID: \"3ae075c190650950e327ad43f6cd7f70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.648196 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.648145    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 20:32:20.717691 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.717668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.720762 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:20.720745    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:20.748436 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.748414    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 20:32:20.848909 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.848885    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 20:32:20.949387 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:20.949331    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 20:32:21.054494 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.054470    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-148.ec2.internal\" not found"
Sep 09 20:32:21.090169 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.090146    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:32:21.115617 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.115590    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 20:32:21.115991 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.115715    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 20:32:21.115991 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.115748    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 20:32:21.153664 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.153642    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:32:21.154747 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.154732    2576 apiserver.go:52] "Watching apiserver"
Sep 09 20:32:21.167267 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.167248    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 20:32:21.167593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.167574    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-gdv5s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv","openshift-cluster-node-tuning-operator/tuned-cwxcd","openshift-multus/multus-n2rtn","openshift-network-diagnostics/network-check-target-2hstv","kube-system/global-pull-secret-syncer-bdq2b","kube-system/konnectivity-agent-vjhf2","openshift-dns/node-resolver-zcn9h","openshift-image-registry/node-ca-srzwr","openshift-multus/multus-additional-cni-plugins-vs4js","openshift-multus/network-metrics-daemon-b7m4c","openshift-network-operator/iptables-alerter-rshsd"]
Sep 09 20:32:21.170212 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.170196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.171936 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.171918    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:21.172026 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.171995    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 20:32:21.172332 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.172310    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 20:32:21.172438 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.172373    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 20:32:21.172438 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.172321    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ngvmm\""
Sep 09 20:32:21.172555 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.172437    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.172625 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.172608    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 20:32:21.174795 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.174757    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 20:32:21.174902 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.174801    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 20:32:21.174902 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.174831    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:21.174902 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.174832    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 20:32:21.175057 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.174897    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:21.175057 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.174964    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hkwnw\""
Sep 09 20:32:21.175057 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.175037    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 20:32:21.176669 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h27br\" (UniqueName: \"kubernetes.io/projected/6eeb07a0-6b81-46b4-be10-f17e12765f36-kube-api-access-h27br\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.176732 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176683    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-socket-dir-parent\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.176732 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-run-k8s-cni-cncf-io\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.176798 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-hostroot\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.176798 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-conf-dir\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.176874 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-etc-kubernetes\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.176874 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwtqt\" (UniqueName: \"kubernetes.io/projected/6a06601e-0088-465b-a2b7-018e6c2dec8d-kube-api-access-bwtqt\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.176957 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-device-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.176957 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a06601e-0088-465b-a2b7-018e6c2dec8d-cni-binary-copy\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.177020 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-var-lib-cni-bin\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.177020 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.177020 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.176992    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-socket-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.177020 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177007    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-etc-selinux\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.177157 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-system-cni-dir\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.177157 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-cni-dir\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.177157 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177128    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zcn9h"
Sep 09 20:32:21.177157 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-daemon-config\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.177325 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-run-multus-certs\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.177325 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-registration-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.177325 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-cnibin\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.177325 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-run-netns\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.177325 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-var-lib-cni-multus\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.177325 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-var-lib-kubelet\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.177546 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.177346    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-sys-fs\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.179245 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.179229    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 20:32:21.179321 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.179304    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gnvbg\""
Sep 09 20:32:21.179451 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.179433    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 20:32:21.179639 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.179626    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.181460 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.181442    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 20:32:21.181802 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.181787    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 20:32:21.181854 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.181824    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t6zxd\""
Sep 09 20:32:21.181906 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.181882    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 20:32:21.181959 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.181882    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 20:32:21.181959 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.181927    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 20:32:21.182062 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.181882    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 20:32:21.182205 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.182188    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.184281 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.184266    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 20:32:21.184564 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.184546    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:32:21.184669 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.184652    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6zh7f\""
Sep 09 20:32:21.184669 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.184662    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:21.184768 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.184723    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 20:32:21.184768 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.184729    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:21.184848 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.184793    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"
Sep 09 20:32:21.187091 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.187077    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:21.187312 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.187294    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 20:32:21.188326 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.188297    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 20:27:20 +0000 UTC" deadline="2028-04-05 13:23:17.80833335 +0000 UTC"
Sep 09 20:32:21.188404 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.188328    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13768h50m56.620009678s"
Sep 09 20:32:21.189430 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.189411    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 20:32:21.189503 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.189439    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pgp6n\""
Sep 09 20:32:21.189551 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.189532    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 20:32:21.189651 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.189638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-srzwr"
Sep 09 20:32:21.192218 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.192201    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.192454 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.192436    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 20:32:21.192716 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.192697    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 20:32:21.192782 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.192730    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 20:32:21.192852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.192837    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-grplz\""
Sep 09 20:32:21.194807 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.194788    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:21.194919 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.194858    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jls7v\""
Sep 09 20:32:21.194919 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.194874    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:21.195711 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.195639    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 20:32:21.196076 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.196029    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 20:32:21.196209 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.196081    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 20:32:21.199010 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.198990    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal"]
Sep 09 20:32:21.199086 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.199020    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal"]
Sep 09 20:32:21.199086 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.199077    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rshsd"
Sep 09 20:32:21.201196 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.201171    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:32:21.201323 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.201304    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 20:32:21.201404 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.201304    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2r7j6\""
Sep 09 20:32:21.201488 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.201439    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 20:32:21.220348 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.220325    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ws729"
Sep 09 20:32:21.231640 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.231621    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ws729"
Sep 09 20:32:21.272704 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.272598    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 20:32:21.277585 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.277585 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-socket-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.277585 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-cni-dir\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.277585 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-node-log\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277602    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-log-socket\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-cni-dir\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277688    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-socket-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-run-openvswitch\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-modprobe-d\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277761    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7603a07e-0f67-4839-8e2e-b2e311c996c6-hosts-file\") pod \"node-resolver-zcn9h\" (UID: \"7603a07e-0f67-4839-8e2e-b2e311c996c6\") " pod="openshift-dns/node-resolver-zcn9h"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-sys-fs\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h27br\" (UniqueName: \"kubernetes.io/projected/6eeb07a0-6b81-46b4-be10-f17e12765f36-kube-api-access-h27br\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b191398-6bb5-4187-975f-b3f80cbfa755-system-cni-dir\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.277875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277873    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-sys-fs\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-run-systemd\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/88c65610-a657-48b8-bd95-f7062625c0ae-etc-tuned\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-device-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.277992    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da9f7d49-8d2b-467a-9a40-d426dd917c99-serviceca\") pod \"node-ca-srzwr\" (UID: \"da9f7d49-8d2b-467a-9a40-d426dd917c99\") " pod="openshift-image-registry/node-ca-srzwr"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-systemd-units\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-cni-bin\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-host\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tpkv\" (UniqueName: \"kubernetes.io/projected/7694d961-a0ef-486a-b0a9-06f0d2952673-kube-api-access-2tpkv\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278067    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-device-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcdc94ca-27de-4312-abb5-68e3fca5340f-konnectivity-ca\") pod \"konnectivity-agent-vjhf2\" (UID: \"dcdc94ca-27de-4312-abb5-68e3fca5340f\") " pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b191398-6bb5-4187-975f-b3f80cbfa755-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-cnibin\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-run-netns\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dks9\" (UniqueName: \"kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9\") pod \"network-check-target-2hstv\" (UID: \"e20392cd-f44f-424c-927a-c4462e4a1206\") " pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-kubelet\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-var-lib-openvswitch\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.278593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-run-netns\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278310    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-cnibin\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278337    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-etc-openvswitch\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc9892d0-0892-44d3-ba24-52b0a05abcee-ovn-node-metrics-cert\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-run-k8s-cni-cncf-io\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-conf-dir\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-etc-kubernetes\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-run-netns\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-sysconfig\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278502    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-conf-dir\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278548    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-etc-kubernetes\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278553    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a06601e-0088-465b-a2b7-018e6c2dec8d-cni-binary-copy\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc9892d0-0892-44d3-ba24-52b0a05abcee-env-overrides\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278593    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-run-k8s-cni-cncf-io\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-etc-selinux\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-daemon-config\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.279452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j7fr\" (UniqueName: \"kubernetes.io/projected/6b191398-6bb5-4187-975f-b3f80cbfa755-kube-api-access-8j7fr\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc9892d0-0892-44d3-ba24-52b0a05abcee-ovnkube-config\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-etc-selinux\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-lib-modules\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-dbus\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcdc94ca-27de-4312-abb5-68e3fca5340f-agent-certs\") pod \"konnectivity-agent-vjhf2\" (UID: \"dcdc94ca-27de-4312-abb5-68e3fca5340f\") " pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-registration-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-cni-netd\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278936    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-sysctl-conf\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278970    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6eeb07a0-6b81-46b4-be10-f17e12765f36-registration-dir\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.278989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-var-lib-kubelet\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279010    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88c65610-a657-48b8-bd95-f7062625c0ae-tmp\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7603a07e-0f67-4839-8e2e-b2e311c996c6-tmp-dir\") pod \"node-resolver-zcn9h\" (UID: \"7603a07e-0f67-4839-8e2e-b2e311c996c6\") " pod="openshift-dns/node-resolver-zcn9h"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279040    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg58n\" (UniqueName: \"kubernetes.io/projected/7603a07e-0f67-4839-8e2e-b2e311c996c6-kube-api-access-jg58n\") pod \"node-resolver-zcn9h\" (UID: \"7603a07e-0f67-4839-8e2e-b2e311c996c6\") " pod="openshift-dns/node-resolver-zcn9h"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da9f7d49-8d2b-467a-9a40-d426dd917c99-host\") pod \"node-ca-srzwr\" (UID: \"da9f7d49-8d2b-467a-9a40-d426dd917c99\") " pod="openshift-image-registry/node-ca-srzwr"
Sep 09 20:32:21.280149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a06601e-0088-465b-a2b7-018e6c2dec8d-cni-binary-copy\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-socket-dir-parent\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-hostroot\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-socket-dir-parent\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b191398-6bb5-4187-975f-b3f80cbfa755-cnibin\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-hostroot\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3179740f-f324-49aa-87a8-8a9173352c3d-iptables-alerter-script\") pod \"iptables-alerter-rshsd\" (UID: \"3179740f-f324-49aa-87a8-8a9173352c3d\") " pod="openshift-network-operator/iptables-alerter-rshsd"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-kubelet-config\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnflj\" (UniqueName: \"kubernetes.io/projected/cc9892d0-0892-44d3-ba24-52b0a05abcee-kube-api-access-wnflj\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279260    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-system-cni-dir\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-run-multus-certs\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b191398-6bb5-4187-975f-b3f80cbfa755-cni-binary-copy\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b191398-6bb5-4187-975f-b3f80cbfa755-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-run-multus-certs\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a06601e-0088-465b-a2b7-018e6c2dec8d-multus-daemon-config\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-run-ovn\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-system-cni-dir\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.280658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-systemd\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279410    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-sys\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p2vj\" (UniqueName: \"kubernetes.io/projected/88c65610-a657-48b8-bd95-f7062625c0ae-kube-api-access-8p2vj\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-var-lib-cni-multus\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279486    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-var-lib-cni-multus\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279491    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-var-lib-kubelet\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279533    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b191398-6bb5-4187-975f-b3f80cbfa755-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45rw4\" (UniqueName: \"kubernetes.io/projected/3179740f-f324-49aa-87a8-8a9173352c3d-kube-api-access-45rw4\") pod \"iptables-alerter-rshsd\" (UID: \"3179740f-f324-49aa-87a8-8a9173352c3d\") " pod="openshift-network-operator/iptables-alerter-rshsd"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279591    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-var-lib-kubelet\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwtqt\" (UniqueName: \"kubernetes.io/projected/6a06601e-0088-465b-a2b7-018e6c2dec8d-kube-api-access-bwtqt\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-slash\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc9892d0-0892-44d3-ba24-52b0a05abcee-ovnkube-script-lib\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-sysctl-d\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-run\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3179740f-f324-49aa-87a8-8a9173352c3d-host-slash\") pod \"iptables-alerter-rshsd\" (UID: \"3179740f-f324-49aa-87a8-8a9173352c3d\") " pod="openshift-network-operator/iptables-alerter-rshsd"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-var-lib-cni-bin\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j5fz\" (UniqueName: \"kubernetes.io/projected/da9f7d49-8d2b-467a-9a40-d426dd917c99-kube-api-access-4j5fz\") pod \"node-ca-srzwr\" (UID: \"da9f7d49-8d2b-467a-9a40-d426dd917c99\") " pod="openshift-image-registry/node-ca-srzwr"
Sep 09 20:32:21.281171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a06601e-0088-465b-a2b7-018e6c2dec8d-host-var-lib-cni-bin\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.281674 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.279851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-kubernetes\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.287058 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.287036    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 20:32:21.290410 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.290390    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h27br\" (UniqueName: \"kubernetes.io/projected/6eeb07a0-6b81-46b4-be10-f17e12765f36-kube-api-access-h27br\") pod \"aws-ebs-csi-driver-node-2vqhv\" (UID: \"6eeb07a0-6b81-46b4-be10-f17e12765f36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.290500 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.290418    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwtqt\" (UniqueName: \"kubernetes.io/projected/6a06601e-0088-465b-a2b7-018e6c2dec8d-kube-api-access-bwtqt\") pod \"multus-n2rtn\" (UID: \"6a06601e-0088-465b-a2b7-018e6c2dec8d\") " pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.380612 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380576    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dks9\" (UniqueName: \"kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9\") pod \"network-check-target-2hstv\" (UID: \"e20392cd-f44f-424c-927a-c4462e4a1206\") " pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:21.380796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-kubelet\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.380796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-var-lib-openvswitch\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.380796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-etc-openvswitch\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.380796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc9892d0-0892-44d3-ba24-52b0a05abcee-ovn-node-metrics-cert\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.380796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-kubelet\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.380796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-run-netns\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.380796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-sysconfig\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.380796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-run-netns\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.380796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc9892d0-0892-44d3-ba24-52b0a05abcee-env-overrides\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-etc-openvswitch\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j7fr\" (UniqueName: \"kubernetes.io/projected/6b191398-6bb5-4187-975f-b3f80cbfa755-kube-api-access-8j7fr\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380868    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-sysconfig\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc9892d0-0892-44d3-ba24-52b0a05abcee-ovnkube-config\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-lib-modules\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380921    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-dbus\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcdc94ca-27de-4312-abb5-68e3fca5340f-agent-certs\") pod \"konnectivity-agent-vjhf2\" (UID: \"dcdc94ca-27de-4312-abb5-68e3fca5340f\") " pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.380978    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-cni-netd\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-sysctl-conf\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-var-lib-kubelet\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.381115    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs podName:7694d961-a0ef-486a-b0a9-06f0d2952673 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:21.881076321 +0000 UTC m=+2.125904907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs") pod "network-metrics-daemon-b7m4c" (UID: "7694d961-a0ef-486a-b0a9-06f0d2952673") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88c65610-a657-48b8-bd95-f7062625c0ae-tmp\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.381302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381158    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-var-lib-kubelet\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7603a07e-0f67-4839-8e2e-b2e311c996c6-tmp-dir\") pod \"node-resolver-zcn9h\" (UID: \"7603a07e-0f67-4839-8e2e-b2e311c996c6\") " pod="openshift-dns/node-resolver-zcn9h"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg58n\" (UniqueName: \"kubernetes.io/projected/7603a07e-0f67-4839-8e2e-b2e311c996c6-kube-api-access-jg58n\") pod \"node-resolver-zcn9h\" (UID: \"7603a07e-0f67-4839-8e2e-b2e311c996c6\") " pod="openshift-dns/node-resolver-zcn9h"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da9f7d49-8d2b-467a-9a40-d426dd917c99-host\") pod \"node-ca-srzwr\" (UID: \"da9f7d49-8d2b-467a-9a40-d426dd917c99\") " pod="openshift-image-registry/node-ca-srzwr"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b191398-6bb5-4187-975f-b3f80cbfa755-cnibin\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3179740f-f324-49aa-87a8-8a9173352c3d-iptables-alerter-script\") pod \"iptables-alerter-rshsd\" (UID: \"3179740f-f324-49aa-87a8-8a9173352c3d\") " pod="openshift-network-operator/iptables-alerter-rshsd"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-kubelet-config\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnflj\" (UniqueName: \"kubernetes.io/projected/cc9892d0-0892-44d3-ba24-52b0a05abcee-kube-api-access-wnflj\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b191398-6bb5-4187-975f-b3f80cbfa755-cni-binary-copy\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b191398-6bb5-4187-975f-b3f80cbfa755-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-run-ovn\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-systemd\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-sys\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p2vj\" (UniqueName: \"kubernetes.io/projected/88c65610-a657-48b8-bd95-f7062625c0ae-kube-api-access-8p2vj\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.380731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-var-lib-openvswitch\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381493    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7603a07e-0f67-4839-8e2e-b2e311c996c6-tmp-dir\") pod \"node-resolver-zcn9h\" (UID: \"7603a07e-0f67-4839-8e2e-b2e311c996c6\") " pod="openshift-dns/node-resolver-zcn9h"
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.381581    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:21.382190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381593    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-dbus\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.381646    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret podName:3bdc10f7-ca9b-4fca-8f00-646d10bd9fed nodeName:}" failed. No retries permitted until 2026-09-09 20:32:21.88162657 +0000 UTC m=+2.126455147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret") pod "global-pull-secret-syncer-bdq2b" (UID: "3bdc10f7-ca9b-4fca-8f00-646d10bd9fed") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-sysctl-conf\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381835    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-cni-netd\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381890    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-kubelet-config\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b191398-6bb5-4187-975f-b3f80cbfa755-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.381988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45rw4\" (UniqueName: \"kubernetes.io/projected/3179740f-f324-49aa-87a8-8a9173352c3d-kube-api-access-45rw4\") pod \"iptables-alerter-rshsd\" (UID: \"3179740f-f324-49aa-87a8-8a9173352c3d\") " pod="openshift-network-operator/iptables-alerter-rshsd"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-slash\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc9892d0-0892-44d3-ba24-52b0a05abcee-ovnkube-script-lib\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-sysctl-d\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-run\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3179740f-f324-49aa-87a8-8a9173352c3d-host-slash\") pod \"iptables-alerter-rshsd\" (UID: \"3179740f-f324-49aa-87a8-8a9173352c3d\") " pod="openshift-network-operator/iptables-alerter-rshsd"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b191398-6bb5-4187-975f-b3f80cbfa755-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j5fz\" (UniqueName: \"kubernetes.io/projected/da9f7d49-8d2b-467a-9a40-d426dd917c99-kube-api-access-4j5fz\") pod \"node-ca-srzwr\" (UID: \"da9f7d49-8d2b-467a-9a40-d426dd917c99\") " pod="openshift-image-registry/node-ca-srzwr"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-kubernetes\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.383096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382206    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3179740f-f324-49aa-87a8-8a9173352c3d-iptables-alerter-script\") pod \"iptables-alerter-rshsd\" (UID: \"3179740f-f324-49aa-87a8-8a9173352c3d\") " pod="openshift-network-operator/iptables-alerter-rshsd"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-node-log\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-log-socket\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382274    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-lib-modules\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382272    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b191398-6bb5-4187-975f-b3f80cbfa755-cnibin\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382331    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-run-openvswitch\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382341    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-run-ovn\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382345    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-slash\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-modprobe-d\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-run\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7603a07e-0f67-4839-8e2e-b2e311c996c6-hosts-file\") pod \"node-resolver-zcn9h\" (UID: \"7603a07e-0f67-4839-8e2e-b2e311c996c6\") " pod="openshift-dns/node-resolver-zcn9h"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b191398-6bb5-4187-975f-b3f80cbfa755-system-cni-dir\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382427    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-run-systemd\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382475    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b191398-6bb5-4187-975f-b3f80cbfa755-system-cni-dir\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/88c65610-a657-48b8-bd95-f7062625c0ae-etc-tuned\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382545    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-systemd\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.383941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da9f7d49-8d2b-467a-9a40-d426dd917c99-host\") pod \"node-ca-srzwr\" (UID: \"da9f7d49-8d2b-467a-9a40-d426dd917c99\") " pod="openshift-image-registry/node-ca-srzwr"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-sys\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b191398-6bb5-4187-975f-b3f80cbfa755-cni-binary-copy\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382760    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-sysctl-d\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc9892d0-0892-44d3-ba24-52b0a05abcee-env-overrides\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-run-openvswitch\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3179740f-f324-49aa-87a8-8a9173352c3d-host-slash\") pod \"iptables-alerter-rshsd\" (UID: \"3179740f-f324-49aa-87a8-8a9173352c3d\") " pod="openshift-network-operator/iptables-alerter-rshsd"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383104    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc9892d0-0892-44d3-ba24-52b0a05abcee-ovnkube-script-lib\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383194    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-kubernetes\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-log-socket\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383281    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-node-log\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.382203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b191398-6bb5-4187-975f-b3f80cbfa755-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383297    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc9892d0-0892-44d3-ba24-52b0a05abcee-ovnkube-config\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-run-systemd\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da9f7d49-8d2b-467a-9a40-d426dd917c99-serviceca\") pod \"node-ca-srzwr\" (UID: \"da9f7d49-8d2b-467a-9a40-d426dd917c99\") " pod="openshift-image-registry/node-ca-srzwr"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-systemd-units\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7603a07e-0f67-4839-8e2e-b2e311c996c6-hosts-file\") pod \"node-resolver-zcn9h\" (UID: \"7603a07e-0f67-4839-8e2e-b2e311c996c6\") " pod="openshift-dns/node-resolver-zcn9h"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-etc-modprobe-d\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.384852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383402    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-cni-bin\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-systemd-units\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc9892d0-0892-44d3-ba24-52b0a05abcee-host-cni-bin\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-host\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tpkv\" (UniqueName: \"kubernetes.io/projected/7694d961-a0ef-486a-b0a9-06f0d2952673-kube-api-access-2tpkv\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383524    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88c65610-a657-48b8-bd95-f7062625c0ae-host\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcdc94ca-27de-4312-abb5-68e3fca5340f-konnectivity-ca\") pod \"konnectivity-agent-vjhf2\" (UID: \"dcdc94ca-27de-4312-abb5-68e3fca5340f\") " pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b191398-6bb5-4187-975f-b3f80cbfa755-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.383794    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da9f7d49-8d2b-467a-9a40-d426dd917c99-serviceca\") pod \"node-ca-srzwr\" (UID: \"da9f7d49-8d2b-467a-9a40-d426dd917c99\") " pod="openshift-image-registry/node-ca-srzwr"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.384094    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b191398-6bb5-4187-975f-b3f80cbfa755-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.384342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88c65610-a657-48b8-bd95-f7062625c0ae-tmp\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.384725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcdc94ca-27de-4312-abb5-68e3fca5340f-konnectivity-ca\") pod \"konnectivity-agent-vjhf2\" (UID: \"dcdc94ca-27de-4312-abb5-68e3fca5340f\") " pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.384803    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcdc94ca-27de-4312-abb5-68e3fca5340f-agent-certs\") pod \"konnectivity-agent-vjhf2\" (UID: \"dcdc94ca-27de-4312-abb5-68e3fca5340f\") " pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.384920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/88c65610-a657-48b8-bd95-f7062625c0ae-etc-tuned\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.385476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.384943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc9892d0-0892-44d3-ba24-52b0a05abcee-ovn-node-metrics-cert\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.391444 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.391423    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:32:21.391529 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.391450    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:32:21.391529 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.391467    2576 projected.go:196] Error preparing data for projected volume kube-api-access-6dks9 for pod openshift-network-diagnostics/network-check-target-2hstv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:21.391653 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.391567    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9 podName:e20392cd-f44f-424c-927a-c4462e4a1206 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:21.891539629 +0000 UTC m=+2.136368190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6dks9" (UniqueName: "kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9") pod "network-check-target-2hstv" (UID: "e20392cd-f44f-424c-927a-c4462e4a1206") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:21.393333 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.393303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg58n\" (UniqueName: \"kubernetes.io/projected/7603a07e-0f67-4839-8e2e-b2e311c996c6-kube-api-access-jg58n\") pod \"node-resolver-zcn9h\" (UID: \"7603a07e-0f67-4839-8e2e-b2e311c996c6\") " pod="openshift-dns/node-resolver-zcn9h"
Sep 09 20:32:21.393829 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.393810    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j7fr\" (UniqueName: \"kubernetes.io/projected/6b191398-6bb5-4187-975f-b3f80cbfa755-kube-api-access-8j7fr\") pod \"multus-additional-cni-plugins-vs4js\" (UID: \"6b191398-6bb5-4187-975f-b3f80cbfa755\") " pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.394504 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.394476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tpkv\" (UniqueName: \"kubernetes.io/projected/7694d961-a0ef-486a-b0a9-06f0d2952673-kube-api-access-2tpkv\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:21.394638 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.394619    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45rw4\" (UniqueName: \"kubernetes.io/projected/3179740f-f324-49aa-87a8-8a9173352c3d-kube-api-access-45rw4\") pod \"iptables-alerter-rshsd\" (UID: \"3179740f-f324-49aa-87a8-8a9173352c3d\") " pod="openshift-network-operator/iptables-alerter-rshsd"
Sep 09 20:32:21.394766 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.394748    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p2vj\" (UniqueName: \"kubernetes.io/projected/88c65610-a657-48b8-bd95-f7062625c0ae-kube-api-access-8p2vj\") pod \"tuned-cwxcd\" (UID: \"88c65610-a657-48b8-bd95-f7062625c0ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.402716 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.402693    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j5fz\" (UniqueName: \"kubernetes.io/projected/da9f7d49-8d2b-467a-9a40-d426dd917c99-kube-api-access-4j5fz\") pod \"node-ca-srzwr\" (UID: \"da9f7d49-8d2b-467a-9a40-d426dd917c99\") " pod="openshift-image-registry/node-ca-srzwr"
Sep 09 20:32:21.403129 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:21.403108    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae075c190650950e327ad43f6cd7f70.slice/crio-3ee238e3cc3aeb7e683caa18144a67bcdee84ff52a5a4e5c7f686771b2f228d9 WatchSource:0}: Error finding container 3ee238e3cc3aeb7e683caa18144a67bcdee84ff52a5a4e5c7f686771b2f228d9: Status 404 returned error can't find the container with id 3ee238e3cc3aeb7e683caa18144a67bcdee84ff52a5a4e5c7f686771b2f228d9
Sep 09 20:32:21.403284 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.403264    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnflj\" (UniqueName: \"kubernetes.io/projected/cc9892d0-0892-44d3-ba24-52b0a05abcee-kube-api-access-wnflj\") pod \"ovnkube-node-gdv5s\" (UID: \"cc9892d0-0892-44d3-ba24-52b0a05abcee\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.408447 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:21.408399    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07650a7db62586f9e69be13fe56d6e10.slice/crio-a7efaa452faa8ce44291fbf1a2484e31fcc127c6b103c9522af833f4f1db550d WatchSource:0}: Error finding container a7efaa452faa8ce44291fbf1a2484e31fcc127c6b103c9522af833f4f1db550d: Status 404 returned error can't find the container with id a7efaa452faa8ce44291fbf1a2484e31fcc127c6b103c9522af833f4f1db550d
Sep 09 20:32:21.410070 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.410049    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:32:21.491972 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.491915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv"
Sep 09 20:32:21.501801 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:21.501767    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eeb07a0_6b81_46b4_be10_f17e12765f36.slice/crio-1b6a0c4c4e4ee87d1e753778b6a565a5e13e03c63c8d0629ee1635d1c5e108ca WatchSource:0}: Error finding container 1b6a0c4c4e4ee87d1e753778b6a565a5e13e03c63c8d0629ee1635d1c5e108ca: Status 404 returned error can't find the container with id 1b6a0c4c4e4ee87d1e753778b6a565a5e13e03c63c8d0629ee1635d1c5e108ca
Sep 09 20:32:21.517750 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.517700    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n2rtn"
Sep 09 20:32:21.525456 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:21.525436    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a06601e_0088_465b_a2b7_018e6c2dec8d.slice/crio-1b155d6bca2e8118cc348d802f1cafa98e9ab742d4f833878ccee6c7328ec431 WatchSource:0}: Error finding container 1b155d6bca2e8118cc348d802f1cafa98e9ab742d4f833878ccee6c7328ec431: Status 404 returned error can't find the container with id 1b155d6bca2e8118cc348d802f1cafa98e9ab742d4f833878ccee6c7328ec431
Sep 09 20:32:21.531878 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.531861    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:32:21.540983 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.540966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zcn9h"
Sep 09 20:32:21.549032 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:21.548868    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7603a07e_0f67_4839_8e2e_b2e311c996c6.slice/crio-89936a30053774249b648afc6c208ab4c0dde2a04d17a80631bb3f6d88cb3ff0 WatchSource:0}: Error finding container 89936a30053774249b648afc6c208ab4c0dde2a04d17a80631bb3f6d88cb3ff0: Status 404 returned error can't find the container with id 89936a30053774249b648afc6c208ab4c0dde2a04d17a80631bb3f6d88cb3ff0
Sep 09 20:32:21.554025 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.554006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:21.562158 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:21.562132    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9892d0_0892_44d3_ba24_52b0a05abcee.slice/crio-cc9e4a48df9bcbebf7ee37dbf401cebc7be70bb770cd2913c2bdded22e226d08 WatchSource:0}: Error finding container cc9e4a48df9bcbebf7ee37dbf401cebc7be70bb770cd2913c2bdded22e226d08: Status 404 returned error can't find the container with id cc9e4a48df9bcbebf7ee37dbf401cebc7be70bb770cd2913c2bdded22e226d08
Sep 09 20:32:21.569337 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.569317    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cwxcd"
Sep 09 20:32:21.575533 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.575513    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:21.577011 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:21.576987    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c65610_a657_48b8_bd95_f7062625c0ae.slice/crio-923c3c17545ea9a5b3d5aa181d42a15f699603af7f0ceed718be0375044c27e4 WatchSource:0}: Error finding container 923c3c17545ea9a5b3d5aa181d42a15f699603af7f0ceed718be0375044c27e4: Status 404 returned error can't find the container with id 923c3c17545ea9a5b3d5aa181d42a15f699603af7f0ceed718be0375044c27e4
Sep 09 20:32:21.584610 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:21.584585    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcdc94ca_27de_4312_abb5_68e3fca5340f.slice/crio-35c01e493ce43f9093ac6df33ae8c3f0ca2b582926cd2c41d0decfc38d5c44b9 WatchSource:0}: Error finding container 35c01e493ce43f9093ac6df33ae8c3f0ca2b582926cd2c41d0decfc38d5c44b9: Status 404 returned error can't find the container with id 35c01e493ce43f9093ac6df33ae8c3f0ca2b582926cd2c41d0decfc38d5c44b9
Sep 09 20:32:21.592234 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.592215    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-srzwr"
Sep 09 20:32:21.601635 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.601616    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vs4js"
Sep 09 20:32:21.601859 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:21.601844    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda9f7d49_8d2b_467a_9a40_d426dd917c99.slice/crio-f77614e0d8220dcdaa9744c06a3a4416240c483622dd8d482cb5a696f4514033 WatchSource:0}: Error finding container f77614e0d8220dcdaa9744c06a3a4416240c483622dd8d482cb5a696f4514033: Status 404 returned error can't find the container with id f77614e0d8220dcdaa9744c06a3a4416240c483622dd8d482cb5a696f4514033
Sep 09 20:32:21.607538 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.607521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rshsd"
Sep 09 20:32:21.610735 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:21.610711    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b191398_6bb5_4187_975f_b3f80cbfa755.slice/crio-8e70db2609a1c2c6046409571067dbe618a38dd0925c60a6209950af49021e82 WatchSource:0}: Error finding container 8e70db2609a1c2c6046409571067dbe618a38dd0925c60a6209950af49021e82: Status 404 returned error can't find the container with id 8e70db2609a1c2c6046409571067dbe618a38dd0925c60a6209950af49021e82
Sep 09 20:32:21.618061 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:21.618043    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3179740f_f324_49aa_87a8_8a9173352c3d.slice/crio-c7d04f99813ef97a3947a1119d5dc73888174abce8bc9ae15d860980166a5317 WatchSource:0}: Error finding container c7d04f99813ef97a3947a1119d5dc73888174abce8bc9ae15d860980166a5317: Status 404 returned error can't find the container with id c7d04f99813ef97a3947a1119d5dc73888174abce8bc9ae15d860980166a5317
Sep 09 20:32:21.886869 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.886790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:21.886869 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.886827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:21.887091 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.886947    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:21.887091 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.886970    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:21.887091 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.887001    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret podName:3bdc10f7-ca9b-4fca-8f00-646d10bd9fed nodeName:}" failed. No retries permitted until 2026-09-09 20:32:22.886982014 +0000 UTC m=+3.131810589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret") pod "global-pull-secret-syncer-bdq2b" (UID: "3bdc10f7-ca9b-4fca-8f00-646d10bd9fed") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:21.887091 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.887040    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs podName:7694d961-a0ef-486a-b0a9-06f0d2952673 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:22.887019759 +0000 UTC m=+3.131848325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs") pod "network-metrics-daemon-b7m4c" (UID: "7694d961-a0ef-486a-b0a9-06f0d2952673") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:21.987796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:21.987756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dks9\" (UniqueName: \"kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9\") pod \"network-check-target-2hstv\" (UID: \"e20392cd-f44f-424c-927a-c4462e4a1206\") " pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:21.987979 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.987924    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:32:21.987979 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.987945    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:32:21.987979 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.987959    2576 projected.go:196] Error preparing data for projected volume kube-api-access-6dks9 for pod openshift-network-diagnostics/network-check-target-2hstv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:21.988177 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:21.988020    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9 podName:e20392cd-f44f-424c-927a-c4462e4a1206 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:22.988000819 +0000 UTC m=+3.232829388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dks9" (UniqueName: "kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9") pod "network-check-target-2hstv" (UID: "e20392cd-f44f-424c-927a-c4462e4a1206") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:22.061021 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.060949    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:32:22.235076 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.234934    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:27:21 +0000 UTC" deadline="2028-06-09 00:13:15.46641365 +0000 UTC"
Sep 09 20:32:22.235076 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.234997    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15315h40m53.23142111s"
Sep 09 20:32:22.292469 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.292352    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rshsd" event={"ID":"3179740f-f324-49aa-87a8-8a9173352c3d","Type":"ContainerStarted","Data":"c7d04f99813ef97a3947a1119d5dc73888174abce8bc9ae15d860980166a5317"}
Sep 09 20:32:22.298195 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.298148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vs4js" event={"ID":"6b191398-6bb5-4187-975f-b3f80cbfa755","Type":"ContainerStarted","Data":"8e70db2609a1c2c6046409571067dbe618a38dd0925c60a6209950af49021e82"}
Sep 09 20:32:22.309990 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.309957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vjhf2" event={"ID":"dcdc94ca-27de-4312-abb5-68e3fca5340f","Type":"ContainerStarted","Data":"35c01e493ce43f9093ac6df33ae8c3f0ca2b582926cd2c41d0decfc38d5c44b9"}
Sep 09 20:32:22.324580 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.324550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cwxcd" event={"ID":"88c65610-a657-48b8-bd95-f7062625c0ae","Type":"ContainerStarted","Data":"923c3c17545ea9a5b3d5aa181d42a15f699603af7f0ceed718be0375044c27e4"}
Sep 09 20:32:22.347214 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.347142    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zcn9h" event={"ID":"7603a07e-0f67-4839-8e2e-b2e311c996c6","Type":"ContainerStarted","Data":"89936a30053774249b648afc6c208ab4c0dde2a04d17a80631bb3f6d88cb3ff0"}
Sep 09 20:32:22.371148 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.371070    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n2rtn" event={"ID":"6a06601e-0088-465b-a2b7-018e6c2dec8d","Type":"ContainerStarted","Data":"1b155d6bca2e8118cc348d802f1cafa98e9ab742d4f833878ccee6c7328ec431"}
Sep 09 20:32:22.384493 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.384432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal" event={"ID":"07650a7db62586f9e69be13fe56d6e10","Type":"ContainerStarted","Data":"a7efaa452faa8ce44291fbf1a2484e31fcc127c6b103c9522af833f4f1db550d"}
Sep 09 20:32:22.402156 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.402123    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-srzwr" event={"ID":"da9f7d49-8d2b-467a-9a40-d426dd917c99","Type":"ContainerStarted","Data":"f77614e0d8220dcdaa9744c06a3a4416240c483622dd8d482cb5a696f4514033"}
Sep 09 20:32:22.409758 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.409726    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" event={"ID":"cc9892d0-0892-44d3-ba24-52b0a05abcee","Type":"ContainerStarted","Data":"cc9e4a48df9bcbebf7ee37dbf401cebc7be70bb770cd2913c2bdded22e226d08"}
Sep 09 20:32:22.415121 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.415086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv" event={"ID":"6eeb07a0-6b81-46b4-be10-f17e12765f36","Type":"ContainerStarted","Data":"1b6a0c4c4e4ee87d1e753778b6a565a5e13e03c63c8d0629ee1635d1c5e108ca"}
Sep 09 20:32:22.428772 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.428735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal" event={"ID":"3ae075c190650950e327ad43f6cd7f70","Type":"ContainerStarted","Data":"3ee238e3cc3aeb7e683caa18144a67bcdee84ff52a5a4e5c7f686771b2f228d9"}
Sep 09 20:32:22.896968 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.896907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:22.896968 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.896961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:22.897236 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:22.897124    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:22.897236 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:22.897191    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret podName:3bdc10f7-ca9b-4fca-8f00-646d10bd9fed nodeName:}" failed. No retries permitted until 2026-09-09 20:32:24.897169765 +0000 UTC m=+5.141998346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret") pod "global-pull-secret-syncer-bdq2b" (UID: "3bdc10f7-ca9b-4fca-8f00-646d10bd9fed") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:22.897635 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:22.897611    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:22.897738 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:22.897675    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs podName:7694d961-a0ef-486a-b0a9-06f0d2952673 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:24.89765852 +0000 UTC m=+5.142487095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs") pod "network-metrics-daemon-b7m4c" (UID: "7694d961-a0ef-486a-b0a9-06f0d2952673") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:22.997355 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:22.997314    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dks9\" (UniqueName: \"kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9\") pod \"network-check-target-2hstv\" (UID: \"e20392cd-f44f-424c-927a-c4462e4a1206\") " pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:22.997536 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:22.997513    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:32:22.997536 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:22.997534    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:32:22.997645 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:22.997546    2576 projected.go:196] Error preparing data for projected volume kube-api-access-6dks9 for pod openshift-network-diagnostics/network-check-target-2hstv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:22.997645 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:22.997608    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9 podName:e20392cd-f44f-424c-927a-c4462e4a1206 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:24.997588185 +0000 UTC m=+5.242416751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dks9" (UniqueName: "kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9") pod "network-check-target-2hstv" (UID: "e20392cd-f44f-424c-927a-c4462e4a1206") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:23.178134 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:23.177860    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:32:23.236084 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:23.235994    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:27:21 +0000 UTC" deadline="2028-04-10 09:56:02.947369726 +0000 UTC"
Sep 09 20:32:23.236084 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:23.236038    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13885h23m39.711338685s"
Sep 09 20:32:23.278085 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:23.278043    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:23.278271 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:23.278225    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:23.278271 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:23.278040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:23.278392 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:23.278349    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:23.278392 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:23.278043    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:23.278500 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:23.278430    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:24.914534 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:24.914441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:24.914534 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:24.914502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:24.915064 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:24.914653    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:24.915064 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:24.914725    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret podName:3bdc10f7-ca9b-4fca-8f00-646d10bd9fed nodeName:}" failed. No retries permitted until 2026-09-09 20:32:28.914705603 +0000 UTC m=+9.159534163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret") pod "global-pull-secret-syncer-bdq2b" (UID: "3bdc10f7-ca9b-4fca-8f00-646d10bd9fed") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:24.915064 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:24.914796    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:24.915064 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:24.914906    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs podName:7694d961-a0ef-486a-b0a9-06f0d2952673 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:28.914821943 +0000 UTC m=+9.159650519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs") pod "network-metrics-daemon-b7m4c" (UID: "7694d961-a0ef-486a-b0a9-06f0d2952673") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:25.015703 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:25.015663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dks9\" (UniqueName: \"kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9\") pod \"network-check-target-2hstv\" (UID: \"e20392cd-f44f-424c-927a-c4462e4a1206\") " pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:25.015914 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:25.015894    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:32:25.016009 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:25.015924    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:32:25.016009 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:25.015939    2576 projected.go:196] Error preparing data for projected volume kube-api-access-6dks9 for pod openshift-network-diagnostics/network-check-target-2hstv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:25.016009 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:25.016009    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9 podName:e20392cd-f44f-424c-927a-c4462e4a1206 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:29.015986952 +0000 UTC m=+9.260815517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dks9" (UniqueName: "kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9") pod "network-check-target-2hstv" (UID: "e20392cd-f44f-424c-927a-c4462e4a1206") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:25.279109 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:25.278249    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:25.279109 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:25.278406    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:25.279109 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:25.278816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:25.279109 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:25.278922    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:25.279109 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:25.278972    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:25.279109 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:25.279053    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:27.277560 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:27.277511    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:27.278028 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:27.277514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:27.278028 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:27.277651    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:27.278028 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:27.277670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:27.278028 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:27.277776    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:27.278028 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:27.277878    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:28.952812 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:28.952772    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:28.953356 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:28.952830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:28.953356 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:28.952949    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:28.953356 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:28.952954    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:28.953356 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:28.953098    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs podName:7694d961-a0ef-486a-b0a9-06f0d2952673 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:36.953051173 +0000 UTC m=+17.197879739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs") pod "network-metrics-daemon-b7m4c" (UID: "7694d961-a0ef-486a-b0a9-06f0d2952673") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:28.953356 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:28.953158    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret podName:3bdc10f7-ca9b-4fca-8f00-646d10bd9fed nodeName:}" failed. No retries permitted until 2026-09-09 20:32:36.953135485 +0000 UTC m=+17.197964050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret") pod "global-pull-secret-syncer-bdq2b" (UID: "3bdc10f7-ca9b-4fca-8f00-646d10bd9fed") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:29.053451 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:29.053322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dks9\" (UniqueName: \"kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9\") pod \"network-check-target-2hstv\" (UID: \"e20392cd-f44f-424c-927a-c4462e4a1206\") " pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:29.053625 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:29.053572    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:32:29.053625 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:29.053599    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:32:29.053625 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:29.053614    2576 projected.go:196] Error preparing data for projected volume kube-api-access-6dks9 for pod openshift-network-diagnostics/network-check-target-2hstv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:29.053811 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:29.053675    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9 podName:e20392cd-f44f-424c-927a-c4462e4a1206 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:37.053655278 +0000 UTC m=+17.298483841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dks9" (UniqueName: "kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9") pod "network-check-target-2hstv" (UID: "e20392cd-f44f-424c-927a-c4462e4a1206") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:29.278643 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:29.278203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:29.278643 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:29.278230    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:29.278643 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:29.278230    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:29.278643 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:29.278350    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:29.278643 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:29.278491    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:29.278643 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:29.278573    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:31.277570 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:31.277538    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:31.278150 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:31.277660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:31.278150 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:31.277671    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:31.278150 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:31.277801    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:31.278150 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:31.277862    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:31.278150 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:31.277929    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:33.277351 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:33.277318    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:33.277351 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:33.277353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:33.277861 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:33.277319    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:33.277861 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:33.277439    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:33.277861 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:33.277490    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:33.277861 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:33.277563    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:35.277669 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:35.277630    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:35.278293 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:35.277639    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:35.278293 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:35.277758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:35.278293 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:35.277764    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:35.278293 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:35.277841    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:35.278293 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:35.277916    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:37.012502 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:37.012415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:37.012920 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:37.012546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:37.012920 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:37.012550    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:37.012920 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:37.012629    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs podName:7694d961-a0ef-486a-b0a9-06f0d2952673 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:53.012605364 +0000 UTC m=+33.257433923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs") pod "network-metrics-daemon-b7m4c" (UID: "7694d961-a0ef-486a-b0a9-06f0d2952673") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:37.012920 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:37.012675    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:37.012920 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:37.012742    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret podName:3bdc10f7-ca9b-4fca-8f00-646d10bd9fed nodeName:}" failed. No retries permitted until 2026-09-09 20:32:53.012723867 +0000 UTC m=+33.257552436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret") pod "global-pull-secret-syncer-bdq2b" (UID: "3bdc10f7-ca9b-4fca-8f00-646d10bd9fed") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:37.113111 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:37.113075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dks9\" (UniqueName: \"kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9\") pod \"network-check-target-2hstv\" (UID: \"e20392cd-f44f-424c-927a-c4462e4a1206\") " pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:37.113287 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:37.113227    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:32:37.113287 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:37.113246    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:32:37.113287 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:37.113257    2576 projected.go:196] Error preparing data for projected volume kube-api-access-6dks9 for pod openshift-network-diagnostics/network-check-target-2hstv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:37.113506 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:37.113315    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9 podName:e20392cd-f44f-424c-927a-c4462e4a1206 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:53.113299302 +0000 UTC m=+33.358127864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dks9" (UniqueName: "kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9") pod "network-check-target-2hstv" (UID: "e20392cd-f44f-424c-927a-c4462e4a1206") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:37.277772 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:37.277683    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:37.277772 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:37.277725    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:37.277772 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:37.277687    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:37.278046 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:37.277812    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:37.278046 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:37.277907    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:37.278046 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:37.277983    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:39.277311 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:39.277281    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:39.277311 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:39.277309    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:39.277803 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:39.277281    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:39.277803 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:39.277412    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:39.277803 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:39.277477    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:39.277803 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:39.277569    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:41.277574 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.277397    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:41.278000 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.277399    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:41.278000 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:41.277653    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:41.278000 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:41.277758    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:41.278000 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.277434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:41.278000 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:41.277872    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:41.470369 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.470332    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cwxcd" event={"ID":"88c65610-a657-48b8-bd95-f7062625c0ae","Type":"ContainerStarted","Data":"034d251927e96b440af96868e1462ab2ae7f08835ef11b24cb0d18663745f215"}
Sep 09 20:32:41.472779 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.472722    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal" event={"ID":"07650a7db62586f9e69be13fe56d6e10","Type":"ContainerStarted","Data":"38ed9b96885789e5d6b76ffdb1ccda992adaad485f6e57519cf2a6d45f406516"}
Sep 09 20:32:41.480072 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.480033    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:32:41.480499 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.480473    2576 generic.go:356] "Generic (PLEG): container finished" podID="cc9892d0-0892-44d3-ba24-52b0a05abcee" containerID="31c1a829bb69749827c44c8adb30e13418a76db19ff737657e9da957c91d7cc6" exitCode=1
Sep 09 20:32:41.480585 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.480519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" event={"ID":"cc9892d0-0892-44d3-ba24-52b0a05abcee","Type":"ContainerStarted","Data":"dbdd1911e5e2bb7e8522cd40b4d926301628c3d8112da9235e9105c46a0616e0"}
Sep 09 20:32:41.480630 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.480611    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" event={"ID":"cc9892d0-0892-44d3-ba24-52b0a05abcee","Type":"ContainerStarted","Data":"a751728a4eb5b8156d9e06757c5fd9748434934e666652642d02ccaba087b231"}
Sep 09 20:32:41.480669 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.480660    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" event={"ID":"cc9892d0-0892-44d3-ba24-52b0a05abcee","Type":"ContainerStarted","Data":"0a6e0442576867703776df9e98f9faa991f85b2e459b8c11b8e5705e9034598d"}
Sep 09 20:32:41.480719 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.480706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" event={"ID":"cc9892d0-0892-44d3-ba24-52b0a05abcee","Type":"ContainerStarted","Data":"5f4eac7b22244e6ef298bc859cd8cb5ed4b1a0198f2cb9c192b9613bf21aeee8"}
Sep 09 20:32:41.480777 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.480760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" event={"ID":"cc9892d0-0892-44d3-ba24-52b0a05abcee","Type":"ContainerDied","Data":"31c1a829bb69749827c44c8adb30e13418a76db19ff737657e9da957c91d7cc6"}
Sep 09 20:32:41.480864 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.480817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" event={"ID":"cc9892d0-0892-44d3-ba24-52b0a05abcee","Type":"ContainerStarted","Data":"f70be6dba0041631fccd8cc43ed04353e9fe321db45bc3b5976838585adb7c1c"}
Sep 09 20:32:41.489514 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.489462    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cwxcd" podStartSLOduration=1.5091428279999999 podStartE2EDuration="20.489446002s" totalImagesPullingTime="18.980303174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:41.489168445 +0000 UTC m=+21.733997024" watchObservedRunningTime="2026-09-09 20:32:41.489446002 +0000 UTC m=+21.734274583"
Sep 09 20:32:41.502274 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:41.502237    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-148.ec2.internal" podStartSLOduration=20.502224818 podStartE2EDuration="20.502224818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:41.501602305 +0000 UTC m=+21.746430898" watchObservedRunningTime="2026-09-09 20:32:41.502224818 +0000 UTC m=+21.747053397"
Sep 09 20:32:42.485317 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.485280    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rshsd" event={"ID":"3179740f-f324-49aa-87a8-8a9173352c3d","Type":"ContainerStarted","Data":"63e36a6be4477a0146a1b098ec2b6433c3f92e67c1962450121ee373a7a55868"}
Sep 09 20:32:42.486901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.486863    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b191398-6bb5-4187-975f-b3f80cbfa755" containerID="abff16b99971c0d26330bc6d4fb82dccc024ab8192c8c94735ff56976de62082" exitCode=0
Sep 09 20:32:42.487012 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.486934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vs4js" event={"ID":"6b191398-6bb5-4187-975f-b3f80cbfa755","Type":"ContainerDied","Data":"abff16b99971c0d26330bc6d4fb82dccc024ab8192c8c94735ff56976de62082"}
Sep 09 20:32:42.488561 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.488524    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vjhf2" event={"ID":"dcdc94ca-27de-4312-abb5-68e3fca5340f","Type":"ContainerStarted","Data":"44521598b9a4c49f96d4c0f305df0fc4ad7b933ac14723958e8844d93b6b9c30"}
Sep 09 20:32:42.489999 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.489974    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zcn9h" event={"ID":"7603a07e-0f67-4839-8e2e-b2e311c996c6","Type":"ContainerStarted","Data":"2631884adfac03d91e87c42f35c444b238879728448fc9a937d1ec28886c7688"}
Sep 09 20:32:42.491479 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.491458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n2rtn" event={"ID":"6a06601e-0088-465b-a2b7-018e6c2dec8d","Type":"ContainerStarted","Data":"b93b093f63b59d18518c03eb023651e4153110d3c35427213f5ee68d9e11673a"}
Sep 09 20:32:42.492884 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.492862    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-srzwr" event={"ID":"da9f7d49-8d2b-467a-9a40-d426dd917c99","Type":"ContainerStarted","Data":"b714977db7ff73099ebe3e86ee232e00d26592be1f47a8daa9784e2556a2c451"}
Sep 09 20:32:42.494396 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.494370    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv" event={"ID":"6eeb07a0-6b81-46b4-be10-f17e12765f36","Type":"ContainerStarted","Data":"02c9be31da03a6df37235fed8d0f321043df499c88acf4d122e0873b889edce1"}
Sep 09 20:32:42.496045 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.496024    2576 generic.go:356] "Generic (PLEG): container finished" podID="3ae075c190650950e327ad43f6cd7f70" containerID="fb05d311474a8846d256f8331eb89385c63e4a2d016beacecc1d6469232b0391" exitCode=0
Sep 09 20:32:42.496129 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.496081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal" event={"ID":"3ae075c190650950e327ad43f6cd7f70","Type":"ContainerDied","Data":"fb05d311474a8846d256f8331eb89385c63e4a2d016beacecc1d6469232b0391"}
Sep 09 20:32:42.498697 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.498662    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rshsd" podStartSLOduration=2.560799134 podStartE2EDuration="21.498650488s" totalImagesPullingTime="18.937851354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:42.498414879 +0000 UTC m=+22.743243460" watchObservedRunningTime="2026-09-09 20:32:42.498650488 +0000 UTC m=+22.743479069"
Sep 09 20:32:42.512842 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.512807    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zcn9h" podStartSLOduration=3.5007056739999998 podStartE2EDuration="22.512801031s" totalImagesPullingTime="19.012095357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:42.512800972 +0000 UTC m=+22.757629551" watchObservedRunningTime="2026-09-09 20:32:42.512801031 +0000 UTC m=+22.757629610"
Sep 09 20:32:42.528728 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.528697    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vjhf2" podStartSLOduration=2.601694724 podStartE2EDuration="21.528685291s" totalImagesPullingTime="18.926990567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:42.528276209 +0000 UTC m=+22.773104799" watchObservedRunningTime="2026-09-09 20:32:42.528685291 +0000 UTC m=+22.773514149"
Sep 09 20:32:42.541451 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.541415    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-srzwr" podStartSLOduration=2.631909476 podStartE2EDuration="21.541404227s" totalImagesPullingTime="18.909494751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:42.541029024 +0000 UTC m=+22.785857606" watchObservedRunningTime="2026-09-09 20:32:42.541404227 +0000 UTC m=+22.786232806"
Sep 09 20:32:42.603094 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.603035    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n2rtn" podStartSLOduration=2.658759397 podStartE2EDuration="22.603017473s" totalImagesPullingTime="19.944258076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:42.602827026 +0000 UTC m=+22.847655613" watchObservedRunningTime="2026-09-09 20:32:42.603017473 +0000 UTC m=+22.847846031"
Sep 09 20:32:42.947250 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:42.947227    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 20:32:43.231809 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:43.231658    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T20:32:42.947247564Z","UUID":"e814e8b7-9b3e-4a0e-a608-7e7f478d33b9","Handler":null,"Name":"","Endpoint":""}
Sep 09 20:32:43.233434 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:43.233273    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 20:32:43.233550 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:43.233447    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 20:32:43.277782 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:43.277758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:43.277923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:43.277788    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:43.277923 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:43.277867    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:43.277923 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:43.277899    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:43.278123 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:43.277947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:43.278123 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:43.278022    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:43.515720 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:43.515629    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv" event={"ID":"6eeb07a0-6b81-46b4-be10-f17e12765f36","Type":"ContainerStarted","Data":"b1f105ad9c767a5f5cd90b2e2b818f070aa5c46cd862d24235ef8cc99cfd0ed2"}
Sep 09 20:32:43.519526 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:43.518608    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal" event={"ID":"3ae075c190650950e327ad43f6cd7f70","Type":"ContainerStarted","Data":"98990e5bcb200a41c6bcfde33a727c00d6735d099cdbbdd352d3e68baa872f36"}
Sep 09 20:32:43.550127 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:43.550080    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-148.ec2.internal" podStartSLOduration=22.550047026 podStartE2EDuration="22.550047026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:43.549221729 +0000 UTC m=+23.794050311" watchObservedRunningTime="2026-09-09 20:32:43.550047026 +0000 UTC m=+23.794875606"
Sep 09 20:32:44.524312 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:44.524236    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:32:44.524782 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:44.524670    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" event={"ID":"cc9892d0-0892-44d3-ba24-52b0a05abcee","Type":"ContainerStarted","Data":"4cd66003855073df174ce987cd7aefb6ee6b0474968b5695b8c2157c3f5192a8"}
Sep 09 20:32:44.527120 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:44.527087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv" event={"ID":"6eeb07a0-6b81-46b4-be10-f17e12765f36","Type":"ContainerStarted","Data":"6003decbece3c7ebf54b2fbb584771d15ca955d82651b8ae26c83ae1b2c190c6"}
Sep 09 20:32:44.544844 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:44.544804    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vqhv" podStartSLOduration=3.125256432 podStartE2EDuration="24.544791211s" totalImagesPullingTime="21.419534779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:32:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:44.543373696 +0000 UTC m=+24.788202267" watchObservedRunningTime="2026-09-09 20:32:44.544791211 +0000 UTC m=+24.789619790"
Sep 09 20:32:45.278019 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:45.277988    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:45.278206 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:45.278115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:45.278206 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:45.278117    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:45.278206 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:45.278172    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:45.278389 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:45.278255    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:45.278389 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:45.278325    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:45.530562 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:45.530485    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:45.531006 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:45.530973    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:46.535439 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:46.535254    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:32:46.535933 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:46.535908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" event={"ID":"cc9892d0-0892-44d3-ba24-52b0a05abcee","Type":"ContainerStarted","Data":"0a5c6fc85441e6917654da4392af9589ea394ba33c3de5fecedde16baf051921"}
Sep 09 20:32:46.536017 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:46.536001    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:46.536418 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:46.536361    2576 scope.go:117] "RemoveContainer" containerID="31c1a829bb69749827c44c8adb30e13418a76db19ff737657e9da957c91d7cc6"
Sep 09 20:32:46.536561 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:46.536545    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vjhf2"
Sep 09 20:32:47.277836 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:47.277806    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:47.277980 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:47.277806    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:47.277980 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:47.277939    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:47.277980 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:47.277937    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:47.278126 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:47.278036    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:47.278169 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:47.278142    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:47.939742 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:47.939712    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bdq2b"]
Sep 09 20:32:47.940648 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:47.939874    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:47.940648 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:47.939982    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:47.940648 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:47.940489    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2hstv"]
Sep 09 20:32:47.940648 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:47.940583    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:47.940785 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:47.940671    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:47.941076 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:47.941040    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b7m4c"]
Sep 09 20:32:47.941151 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:47.941139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:47.941236 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:47.941217    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:48.542170 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:48.542135    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b191398-6bb5-4187-975f-b3f80cbfa755" containerID="4276e38b1d4a8c21c1be1e85d499d25f113215a7fd1f0ffad300b41b7d9ae3bf" exitCode=0
Sep 09 20:32:48.542352 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:48.542221    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vs4js" event={"ID":"6b191398-6bb5-4187-975f-b3f80cbfa755","Type":"ContainerDied","Data":"4276e38b1d4a8c21c1be1e85d499d25f113215a7fd1f0ffad300b41b7d9ae3bf"}
Sep 09 20:32:48.546477 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:48.546455    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:32:48.546928 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:48.546901    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" event={"ID":"cc9892d0-0892-44d3-ba24-52b0a05abcee","Type":"ContainerStarted","Data":"33a5cba16aefec82f4c4f0206b437f6700a89456cfb46a82076e49784a5792ff"}
Sep 09 20:32:48.547065 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:48.547037    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 20:32:48.547264 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:48.547242    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:48.547374 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:48.547318    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:48.562787 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:48.562767    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:48.562863 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:48.562855    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:48.593420 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:48.593376    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" podStartSLOduration=8.28744076 podStartE2EDuration="27.593363439s" totalImagesPullingTime="19.305922679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:48.592659059 +0000 UTC m=+28.837487663" watchObservedRunningTime="2026-09-09 20:32:48.593363439 +0000 UTC m=+28.838192019"
Sep 09 20:32:49.277853 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:49.277678    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:49.278196 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:49.277734    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:49.278196 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:49.277937    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:49.278196 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:49.278024    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:49.548863 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:49.548839    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 20:32:50.278938 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:50.278871    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:50.279365 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:50.278969    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:50.292839 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:50.292811    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:32:50.307496 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:50.307466    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" podUID="cc9892d0-0892-44d3-ba24-52b0a05abcee" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 09 20:32:50.315568 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:50.315543    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" podUID="cc9892d0-0892-44d3-ba24-52b0a05abcee" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 09 20:32:50.553674 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:50.553642    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b191398-6bb5-4187-975f-b3f80cbfa755" containerID="5738899a168a25d085f3482466b1e5f58672c713eae37a4da3f2103744db573f" exitCode=0
Sep 09 20:32:50.554022 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:50.553719    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vs4js" event={"ID":"6b191398-6bb5-4187-975f-b3f80cbfa755","Type":"ContainerDied","Data":"5738899a168a25d085f3482466b1e5f58672c713eae37a4da3f2103744db573f"}
Sep 09 20:32:50.564937 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:50.564855    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" podUID="cc9892d0-0892-44d3-ba24-52b0a05abcee" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 09 20:32:51.277219 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:51.277192    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:51.277219 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:51.277222    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:51.277393 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:51.277302    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:51.277393 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:51.277372    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:51.565668 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:51.565628    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s" podUID="cc9892d0-0892-44d3-ba24-52b0a05abcee" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 09 20:32:52.277523 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:52.277449    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:52.277660 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:52.277539    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bdq2b" podUID="3bdc10f7-ca9b-4fca-8f00-646d10bd9fed"
Sep 09 20:32:52.560798 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:52.560769    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b191398-6bb5-4187-975f-b3f80cbfa755" containerID="19e4be460aca193710ec2389572ec09c3cf914dddfa04156ffa98b99a269edf4" exitCode=0
Sep 09 20:32:52.560925 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:52.560813    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vs4js" event={"ID":"6b191398-6bb5-4187-975f-b3f80cbfa755","Type":"ContainerDied","Data":"19e4be460aca193710ec2389572ec09c3cf914dddfa04156ffa98b99a269edf4"}
Sep 09 20:32:53.037276 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:53.037246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:53.037656 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:53.037287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:53.037656 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:53.037386    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:53.037656 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:53.037405    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:53.037656 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:53.037445    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs podName:7694d961-a0ef-486a-b0a9-06f0d2952673 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:25.037430478 +0000 UTC m=+65.282259048 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs") pod "network-metrics-daemon-b7m4c" (UID: "7694d961-a0ef-486a-b0a9-06f0d2952673") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:32:53.037656 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:53.037460    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret podName:3bdc10f7-ca9b-4fca-8f00-646d10bd9fed nodeName:}" failed. No retries permitted until 2026-09-09 20:33:25.037454155 +0000 UTC m=+65.282282713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret") pod "global-pull-secret-syncer-bdq2b" (UID: "3bdc10f7-ca9b-4fca-8f00-646d10bd9fed") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:32:53.137716 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:53.137684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dks9\" (UniqueName: \"kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9\") pod \"network-check-target-2hstv\" (UID: \"e20392cd-f44f-424c-927a-c4462e4a1206\") " pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:53.137858 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:53.137832    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:32:53.137858 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:53.137850    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:32:53.137924 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:53.137860    2576 projected.go:196] Error preparing data for projected volume kube-api-access-6dks9 for pod openshift-network-diagnostics/network-check-target-2hstv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:53.137924 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:53.137902    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9 podName:e20392cd-f44f-424c-927a-c4462e4a1206 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:25.13789023 +0000 UTC m=+65.382718793 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dks9" (UniqueName: "kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9") pod "network-check-target-2hstv" (UID: "e20392cd-f44f-424c-927a-c4462e4a1206") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:32:53.278232 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:53.278205    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:53.278382 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:53.278243    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:53.278382 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:53.278312    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hstv" podUID="e20392cd-f44f-424c-927a-c4462e4a1206"
Sep 09 20:32:53.278482 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:53.278443    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7m4c" podUID="7694d961-a0ef-486a-b0a9-06f0d2952673"
Sep 09 20:32:54.100022 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.099990    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-148.ec2.internal" event="NodeReady"
Sep 09 20:32:54.100491 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.100151    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 20:32:54.142553 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.142523    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wrk8d"]
Sep 09 20:32:54.154819 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.154782    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qx7w6"]
Sep 09 20:32:54.154978 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.154888    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wrk8d"
Sep 09 20:32:54.157238 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.157182    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 20:32:54.157238 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.157234    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 20:32:54.157424 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.157280    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 20:32:54.157484 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.157470    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k7p7g\""
Sep 09 20:32:54.167386 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.167365    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wrk8d"]
Sep 09 20:32:54.167487 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.167404    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qx7w6"]
Sep 09 20:32:54.167536 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.167503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.169915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.169894    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 20:32:54.170028 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.169894    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2sgfl\""
Sep 09 20:32:54.170360 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.170342    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 20:32:54.244709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.244679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wndg\" (UniqueName: \"kubernetes.io/projected/c71a4735-d550-4196-9076-3649aab7c6c8-kube-api-access-2wndg\") pod \"ingress-canary-wrk8d\" (UID: \"c71a4735-d550-4196-9076-3649aab7c6c8\") " pod="openshift-ingress-canary/ingress-canary-wrk8d"
Sep 09 20:32:54.244876 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.244722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.244876 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.244764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k222\" (UniqueName: \"kubernetes.io/projected/09017953-d969-484e-a7f5-2b283dcc9057-kube-api-access-4k222\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.244876 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.244796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09017953-d969-484e-a7f5-2b283dcc9057-tmp-dir\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.244876 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.244826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c71a4735-d550-4196-9076-3649aab7c6c8-cert\") pod \"ingress-canary-wrk8d\" (UID: \"c71a4735-d550-4196-9076-3649aab7c6c8\") " pod="openshift-ingress-canary/ingress-canary-wrk8d"
Sep 09 20:32:54.244876 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.244850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/09017953-d969-484e-a7f5-2b283dcc9057-config-volume\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.277991 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.277965    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:32:54.280255 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.280236    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 20:32:54.346114 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.346084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k222\" (UniqueName: \"kubernetes.io/projected/09017953-d969-484e-a7f5-2b283dcc9057-kube-api-access-4k222\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.346272 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.346131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09017953-d969-484e-a7f5-2b283dcc9057-tmp-dir\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.346272 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.346161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c71a4735-d550-4196-9076-3649aab7c6c8-cert\") pod \"ingress-canary-wrk8d\" (UID: \"c71a4735-d550-4196-9076-3649aab7c6c8\") " pod="openshift-ingress-canary/ingress-canary-wrk8d"
Sep 09 20:32:54.346272 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.346185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/09017953-d969-484e-a7f5-2b283dcc9057-config-volume\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.346272 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.346254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wndg\" (UniqueName: \"kubernetes.io/projected/c71a4735-d550-4196-9076-3649aab7c6c8-kube-api-access-2wndg\") pod \"ingress-canary-wrk8d\" (UID: \"c71a4735-d550-4196-9076-3649aab7c6c8\") " pod="openshift-ingress-canary/ingress-canary-wrk8d"
Sep 09 20:32:54.346272 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.346269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.346522 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:54.346356    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:32:54.346522 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:54.346404    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls podName:09017953-d969-484e-a7f5-2b283dcc9057 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:54.846391278 +0000 UTC m=+35.091219835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls") pod "dns-default-qx7w6" (UID: "09017953-d969-484e-a7f5-2b283dcc9057") : secret "dns-default-metrics-tls" not found
Sep 09 20:32:54.346875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.346847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09017953-d969-484e-a7f5-2b283dcc9057-tmp-dir\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.347099 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.347079    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/09017953-d969-484e-a7f5-2b283dcc9057-config-volume\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.351005 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.350859    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c71a4735-d550-4196-9076-3649aab7c6c8-cert\") pod \"ingress-canary-wrk8d\" (UID: \"c71a4735-d550-4196-9076-3649aab7c6c8\") " pod="openshift-ingress-canary/ingress-canary-wrk8d"
Sep 09 20:32:54.354343 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.354313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k222\" (UniqueName: \"kubernetes.io/projected/09017953-d969-484e-a7f5-2b283dcc9057-kube-api-access-4k222\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.354706 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.354686    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wndg\" (UniqueName: \"kubernetes.io/projected/c71a4735-d550-4196-9076-3649aab7c6c8-kube-api-access-2wndg\") pod \"ingress-canary-wrk8d\" (UID: \"c71a4735-d550-4196-9076-3649aab7c6c8\") " pod="openshift-ingress-canary/ingress-canary-wrk8d"
Sep 09 20:32:54.466706 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.466675    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wrk8d"
Sep 09 20:32:54.775398 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.775270    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wrk8d"]
Sep 09 20:32:54.779431 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:54.779400    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71a4735_d550_4196_9076_3649aab7c6c8.slice/crio-7b4ca54b1397846f71e094414b0ffd06f7dddae8fcd80f00fbc55f61c72690e1 WatchSource:0}: Error finding container 7b4ca54b1397846f71e094414b0ffd06f7dddae8fcd80f00fbc55f61c72690e1: Status 404 returned error can't find the container with id 7b4ca54b1397846f71e094414b0ffd06f7dddae8fcd80f00fbc55f61c72690e1
Sep 09 20:32:54.849933 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:54.849906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:54.850103 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:54.850041    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:32:54.850171 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:54.850115    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls podName:09017953-d969-484e-a7f5-2b283dcc9057 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:55.850100118 +0000 UTC m=+36.094928676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls") pod "dns-default-qx7w6" (UID: "09017953-d969-484e-a7f5-2b283dcc9057") : secret "dns-default-metrics-tls" not found
Sep 09 20:32:55.277596 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:55.277563    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:32:55.278446 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:55.277568    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:32:55.280793 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:55.280772    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 20:32:55.281293 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:55.281068    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9w8hr\""
Sep 09 20:32:55.281293 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:55.281076    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 20:32:55.281293 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:55.281115    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 20:32:55.281293 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:55.281082    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7r4f4\""
Sep 09 20:32:55.569957 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:55.569912    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wrk8d" event={"ID":"c71a4735-d550-4196-9076-3649aab7c6c8","Type":"ContainerStarted","Data":"7b4ca54b1397846f71e094414b0ffd06f7dddae8fcd80f00fbc55f61c72690e1"}
Sep 09 20:32:55.857598 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:55.857461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:55.857598 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:55.857581    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:32:55.857809 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:55.857651    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls podName:09017953-d969-484e-a7f5-2b283dcc9057 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:57.857632781 +0000 UTC m=+38.102461354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls") pod "dns-default-qx7w6" (UID: "09017953-d969-484e-a7f5-2b283dcc9057") : secret "dns-default-metrics-tls" not found
Sep 09 20:32:57.870820 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.870788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:32:57.871232 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:57.870905    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:32:57.871232 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:57.870957    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls podName:09017953-d969-484e-a7f5-2b283dcc9057 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:01.870943413 +0000 UTC m=+42.115771971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls") pod "dns-default-qx7w6" (UID: "09017953-d969-484e-a7f5-2b283dcc9057") : secret "dns-default-metrics-tls" not found
Sep 09 20:32:57.951975 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.951948    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsrhq"]
Sep 09 20:32:57.973937 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.973899    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsrhq"]
Sep 09 20:32:57.974102 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.973951    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"]
Sep 09 20:32:57.974385 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.974361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsrhq"
Sep 09 20:32:57.976729 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.976701    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:32:57.976821 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.976704    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 20:32:57.977073 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.977032    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-l5rcn\""
Sep 09 20:32:57.987761 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.987737    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-m6s8n"]
Sep 09 20:32:57.987874 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.987854    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:32:57.990418 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.990366    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 09 20:32:57.991647 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.990841    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 20:32:57.991647 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.990924    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kptf5\""
Sep 09 20:32:57.997793 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.994705    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 20:32:57.997793 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:57.995595    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 09 20:32:58.003979 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.003958    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-gh899"]
Sep 09 20:32:58.004264 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.004242    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.006044 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.006023    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 09 20:32:58.006321 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.006297    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vmv7k\""
Sep 09 20:32:58.006644 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.006618    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 20:32:58.006704 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.006618    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 09 20:32:58.006763 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.006735    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 20:32:58.019013 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.018992    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 09 20:32:58.023799 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.023777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"]
Sep 09 20:32:58.023886 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.023820    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-gh899"]
Sep 09 20:32:58.023886 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.023841    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-m6s8n"]
Sep 09 20:32:58.023886 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.023880    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-gh899"
Sep 09 20:32:58.025636 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.025615    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zxzvm\""
Sep 09 20:32:58.058248 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.058221    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"]
Sep 09 20:32:58.066122 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.066098    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"]
Sep 09 20:32:58.066256 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.066236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"
Sep 09 20:32:58.068579 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.068559    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 09 20:32:58.068824 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.068805    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:32:58.068920 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.068874    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 09 20:32:58.069178 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.069160    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6jb9g\""
Sep 09 20:32:58.069253 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.069233    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 09 20:32:58.072033 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.071968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7rfs\" (UniqueName: \"kubernetes.io/projected/b5e47679-aac4-4d6c-86dc-f0aa8470a620-kube-api-access-t7rfs\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:32:58.072033 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.072007    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b5e47679-aac4-4d6c-86dc-f0aa8470a620-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:32:58.072204 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.072079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:32:58.072204 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.072167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n49cs\" (UniqueName: \"kubernetes.io/projected/a905cef8-9ede-4ef9-b010-ba78a21cf9e5-kube-api-access-n49cs\") pod \"volume-data-source-validator-695c895bd6-qsrhq\" (UID: \"a905cef8-9ede-4ef9-b010-ba78a21cf9e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsrhq"
Sep 09 20:32:58.072601 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.072496    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-89qb9"]
Sep 09 20:32:58.073179 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.073162    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"
Sep 09 20:32:58.076446 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.075969    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 20:32:58.076446 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.075997    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 20:32:58.076446 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.076108    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:32:58.076446 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.076269    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mlrdt\""
Sep 09 20:32:58.076446 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.076337    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 20:32:58.080456 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.080439    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6ff78776b6-sf6fh"]
Sep 09 20:32:58.081340 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.080631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.086827 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.086328    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:32:58.086827 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.086341    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 09 20:32:58.086827 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.086354    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-d47b8\""
Sep 09 20:32:58.086827 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.086475    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 09 20:32:58.087091 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.086850    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 09 20:32:58.091240 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.091217    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b497ff687-sxxqj"]
Sep 09 20:32:58.092027 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.092005    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.094515 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.094423    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 20:32:58.095859 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.095079    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 09 20:32:58.095859 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.095461    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7kghx\""
Sep 09 20:32:58.095859 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.095650    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 09 20:32:58.096103 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.095900    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 09 20:32:58.097295 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.096178    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 09 20:32:58.097295 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.097260    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 09 20:32:58.100380 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.100271    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 20:32:58.102734 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.102712    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"]
Sep 09 20:32:58.102860 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.102745    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"]
Sep 09 20:32:58.102860 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.102767    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-89qb9"]
Sep 09 20:32:58.102860 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.102786    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b497ff687-sxxqj"]
Sep 09 20:32:58.102860 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.102809    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6ff78776b6-sf6fh"]
Sep 09 20:32:58.103100 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.102893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.104803 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.104786    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 20:32:58.104897 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.104801    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 20:32:58.105068 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.105041    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b4pxw\""
Sep 09 20:32:58.105576 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.105561    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 20:32:58.110353 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.110333    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 20:32:58.160843 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.160815    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-m8xnm"]
Sep 09 20:32:58.172845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.172820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/083804f0-418b-45c5-bb6b-e04e132459f0-serving-cert\") pod \"service-ca-operator-859f94c4b-s8d87\" (UID: \"083804f0-418b-45c5-bb6b-e04e132459f0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"
Sep 09 20:32:58.172945 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.172872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12779b83-c860-4919-8ec3-b4182eae8455-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.172945 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.172909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b5e47679-aac4-4d6c-86dc-f0aa8470a620-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:32:58.173070 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.172941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:32:58.173070 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49lnn\" (UniqueName: \"kubernetes.io/projected/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-kube-api-access-49lnn\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.173070 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.173043    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:32:58.173070 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e372e750-ab89-4af3-abce-7451c51194d3-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-s79ft\" (UID: \"e372e750-ab89-4af3-abce-7451c51194d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"
Sep 09 20:32:58.173377 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173093    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-serving-cert\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.173377 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.173128    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls podName:b5e47679-aac4-4d6c-86dc-f0aa8470a620 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:58.673109645 +0000 UTC m=+38.917938205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-5lwhz" (UID: "b5e47679-aac4-4d6c-86dc-f0aa8470a620") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:32:58.173377 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl69l\" (UniqueName: \"kubernetes.io/projected/12779b83-c860-4919-8ec3-b4182eae8455-kube-api-access-zl69l\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.173377 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12779b83-c860-4919-8ec3-b4182eae8455-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.173377 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpc7n\" (UniqueName: \"kubernetes.io/projected/fc713a86-f70e-46dd-b67f-680ce7b4d087-kube-api-access-zpc7n\") pod \"network-check-source-685456655f-gh899\" (UID: \"fc713a86-f70e-46dd-b67f-680ce7b4d087\") " pod="openshift-network-diagnostics/network-check-source-685456655f-gh899"
Sep 09 20:32:58.173377 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n49cs\" (UniqueName: \"kubernetes.io/projected/a905cef8-9ede-4ef9-b010-ba78a21cf9e5-kube-api-access-n49cs\") pod \"volume-data-source-validator-695c895bd6-qsrhq\" (UID: \"a905cef8-9ede-4ef9-b010-ba78a21cf9e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsrhq"
Sep 09 20:32:58.173377 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xtpc\" (UniqueName: \"kubernetes.io/projected/083804f0-418b-45c5-bb6b-e04e132459f0-kube-api-access-8xtpc\") pod \"service-ca-operator-859f94c4b-s8d87\" (UID: \"083804f0-418b-45c5-bb6b-e04e132459f0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"
Sep 09 20:32:58.173377 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-stats-auth\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.173377 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7rfs\" (UniqueName: \"kubernetes.io/projected/b5e47679-aac4-4d6c-86dc-f0aa8470a620-kube-api-access-t7rfs\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-trusted-ca\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcrwh\" (UniqueName: \"kubernetes.io/projected/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-kube-api-access-rcrwh\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e372e750-ab89-4af3-abce-7451c51194d3-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-s79ft\" (UID: \"e372e750-ab89-4af3-abce-7451c51194d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-default-certificate\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-config\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12779b83-c860-4919-8ec3-b4182eae8455-serving-cert\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173623    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12779b83-c860-4919-8ec3-b4182eae8455-tmp\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173665    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/083804f0-418b-45c5-bb6b-e04e132459f0-config\") pod \"service-ca-operator-859f94c4b-s8d87\" (UID: \"083804f0-418b-45c5-bb6b-e04e132459f0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/12779b83-c860-4919-8ec3-b4182eae8455-snapshots\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b5e47679-aac4-4d6c-86dc-f0aa8470a620-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:32:58.173915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.173738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tnxc\" (UniqueName: \"kubernetes.io/projected/e372e750-ab89-4af3-abce-7451c51194d3-kube-api-access-8tnxc\") pod \"kube-storage-version-migrator-operator-8d7dd4675-s79ft\" (UID: \"e372e750-ab89-4af3-abce-7451c51194d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"
Sep 09 20:32:58.175608 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.175457    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"]
Sep 09 20:32:58.175995 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.175973    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:32:58.177800 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.177770    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bwxhb\""
Sep 09 20:32:58.177800 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.177781    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 09 20:32:58.177800 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.177788    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 09 20:32:58.188811 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.188783    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n49cs\" (UniqueName: \"kubernetes.io/projected/a905cef8-9ede-4ef9-b010-ba78a21cf9e5-kube-api-access-n49cs\") pod \"volume-data-source-validator-695c895bd6-qsrhq\" (UID: \"a905cef8-9ede-4ef9-b010-ba78a21cf9e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsrhq"
Sep 09 20:32:58.189047 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.188783    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7rfs\" (UniqueName: \"kubernetes.io/projected/b5e47679-aac4-4d6c-86dc-f0aa8470a620-kube-api-access-t7rfs\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:32:58.193375 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.193356    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-m8xnm"]
Sep 09 20:32:58.193454 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.193386    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"]
Sep 09 20:32:58.193495 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.193467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:32:58.195401 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.195382    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-64hlt\""
Sep 09 20:32:58.195566 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.195415    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 09 20:32:58.195566 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.195421    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 09 20:32:58.195813 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.195800    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:32:58.274181 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xtpc\" (UniqueName: \"kubernetes.io/projected/083804f0-418b-45c5-bb6b-e04e132459f0-kube-api-access-8xtpc\") pod \"service-ca-operator-859f94c4b-s8d87\" (UID: \"083804f0-418b-45c5-bb6b-e04e132459f0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"
Sep 09 20:32:58.274181 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-stats-auth\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.274349 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-installation-pull-secrets\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.274349 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-trusted-ca\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.274349 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg5fl\" (UniqueName: \"kubernetes.io/projected/79f0c4c7-b059-414c-83ea-6ce364f4efef-kube-api-access-tg5fl\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:32:58.274349 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcrwh\" (UniqueName: \"kubernetes.io/projected/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-kube-api-access-rcrwh\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.274554 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e372e750-ab89-4af3-abce-7451c51194d3-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-s79ft\" (UID: \"e372e750-ab89-4af3-abce-7451c51194d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"
Sep 09 20:32:58.274554 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-default-certificate\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.274554 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-config\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.274554 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-image-registry-private-configuration\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.274554 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12779b83-c860-4919-8ec3-b4182eae8455-serving-cert\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.274554 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.274554 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-bound-sa-token\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.274901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53b83a06-1bed-4dc8-a5da-3efdeae42457-ca-trust-extracted\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.274901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.274901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12779b83-c860-4919-8ec3-b4182eae8455-tmp\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.274901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/083804f0-418b-45c5-bb6b-e04e132459f0-config\") pod \"service-ca-operator-859f94c4b-s8d87\" (UID: \"083804f0-418b-45c5-bb6b-e04e132459f0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"
Sep 09 20:32:58.274901 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.274672    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:58.774649416 +0000 UTC m=+39.019477976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : configmap references non-existent config key: service-ca.crt
Sep 09 20:32:58.274901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274722    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/12779b83-c860-4919-8ec3-b4182eae8455-snapshots\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.274901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tnxc\" (UniqueName: \"kubernetes.io/projected/e372e750-ab89-4af3-abce-7451c51194d3-kube-api-access-8tnxc\") pod \"kube-storage-version-migrator-operator-8d7dd4675-s79ft\" (UID: \"e372e750-ab89-4af3-abce-7451c51194d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"
Sep 09 20:32:58.274901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:32:58.274901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/083804f0-418b-45c5-bb6b-e04e132459f0-serving-cert\") pod \"service-ca-operator-859f94c4b-s8d87\" (UID: \"083804f0-418b-45c5-bb6b-e04e132459f0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"
Sep 09 20:32:58.274901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12779b83-c860-4919-8ec3-b4182eae8455-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6bhk\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-kube-api-access-j6bhk\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.274983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b916b4e7-efa8-4bdf-80f8-b55053d694f1-nginx-conf\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.275008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.275024    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.275047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49lnn\" (UniqueName: \"kubernetes.io/projected/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-kube-api-access-49lnn\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.275095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-trusted-ca\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.275116    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:58.775097993 +0000 UTC m=+39.019926568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : secret "router-metrics-certs-default" not found
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.275194    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/083804f0-418b-45c5-bb6b-e04e132459f0-config\") pod \"service-ca-operator-859f94c4b-s8d87\" (UID: \"083804f0-418b-45c5-bb6b-e04e132459f0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.275238    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-trusted-ca\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.275242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-config\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.275315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e372e750-ab89-4af3-abce-7451c51194d3-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-s79ft\" (UID: \"e372e750-ab89-4af3-abce-7451c51194d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"
Sep 09 20:32:58.275448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.275433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-serving-cert\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.276117 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.275465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl69l\" (UniqueName: \"kubernetes.io/projected/12779b83-c860-4919-8ec3-b4182eae8455-kube-api-access-zl69l\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.276117 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.275927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/12779b83-c860-4919-8ec3-b4182eae8455-snapshots\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.276242 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.276194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.276294 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.276273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12779b83-c860-4919-8ec3-b4182eae8455-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.276727 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.276415    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12779b83-c860-4919-8ec3-b4182eae8455-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.276727 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.276483    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e372e750-ab89-4af3-abce-7451c51194d3-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-s79ft\" (UID: \"e372e750-ab89-4af3-abce-7451c51194d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"
Sep 09 20:32:58.276727 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.276486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpc7n\" (UniqueName: \"kubernetes.io/projected/fc713a86-f70e-46dd-b67f-680ce7b4d087-kube-api-access-zpc7n\") pod \"network-check-source-685456655f-gh899\" (UID: \"fc713a86-f70e-46dd-b67f-680ce7b4d087\") " pod="openshift-network-diagnostics/network-check-source-685456655f-gh899"
Sep 09 20:32:58.276727 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.276538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-certificates\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.276987 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.276779    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12779b83-c860-4919-8ec3-b4182eae8455-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.276987 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.276809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12779b83-c860-4919-8ec3-b4182eae8455-tmp\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.277182 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.277160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-stats-auth\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.277668 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.277649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12779b83-c860-4919-8ec3-b4182eae8455-serving-cert\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.277778 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.277762    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-default-certificate\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.277833 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.277789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/083804f0-418b-45c5-bb6b-e04e132459f0-serving-cert\") pod \"service-ca-operator-859f94c4b-s8d87\" (UID: \"083804f0-418b-45c5-bb6b-e04e132459f0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"
Sep 09 20:32:58.278392 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.278372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e372e750-ab89-4af3-abce-7451c51194d3-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-s79ft\" (UID: \"e372e750-ab89-4af3-abce-7451c51194d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"
Sep 09 20:32:58.278806 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.278785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-serving-cert\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.281536 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.281508    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xtpc\" (UniqueName: \"kubernetes.io/projected/083804f0-418b-45c5-bb6b-e04e132459f0-kube-api-access-8xtpc\") pod \"service-ca-operator-859f94c4b-s8d87\" (UID: \"083804f0-418b-45c5-bb6b-e04e132459f0\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"
Sep 09 20:32:58.281625 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.281563    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcrwh\" (UniqueName: \"kubernetes.io/projected/14dfc402-d1ec-4e2a-8b92-97cbea8ff336-kube-api-access-rcrwh\") pod \"console-operator-85b454874b-89qb9\" (UID: \"14dfc402-d1ec-4e2a-8b92-97cbea8ff336\") " pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.285542 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.285414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tnxc\" (UniqueName: \"kubernetes.io/projected/e372e750-ab89-4af3-abce-7451c51194d3-kube-api-access-8tnxc\") pod \"kube-storage-version-migrator-operator-8d7dd4675-s79ft\" (UID: \"e372e750-ab89-4af3-abce-7451c51194d3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"
Sep 09 20:32:58.289230 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.286197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpc7n\" (UniqueName: \"kubernetes.io/projected/fc713a86-f70e-46dd-b67f-680ce7b4d087-kube-api-access-zpc7n\") pod \"network-check-source-685456655f-gh899\" (UID: \"fc713a86-f70e-46dd-b67f-680ce7b4d087\") " pod="openshift-network-diagnostics/network-check-source-685456655f-gh899"
Sep 09 20:32:58.289230 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.286814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl69l\" (UniqueName: \"kubernetes.io/projected/12779b83-c860-4919-8ec3-b4182eae8455-kube-api-access-zl69l\") pod \"insights-operator-76bcd6ccf5-m6s8n\" (UID: \"12779b83-c860-4919-8ec3-b4182eae8455\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.290290 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.290076    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49lnn\" (UniqueName: \"kubernetes.io/projected/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-kube-api-access-49lnn\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.301718 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.301701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsrhq"
Sep 09 20:32:58.321970 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.321949    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n"
Sep 09 20:32:58.332089 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.332070    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-gh899"
Sep 09 20:32:58.378157 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-certificates\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.378271 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-installation-pull-secrets\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg5fl\" (UniqueName: \"kubernetes.io/projected/79f0c4c7-b059-414c-83ea-6ce364f4efef-kube-api-access-tg5fl\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-image-registry-private-configuration\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-bound-sa-token\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53b83a06-1bed-4dc8-a5da-3efdeae42457-ca-trust-extracted\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6bhk\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-kube-api-access-j6bhk\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b916b4e7-efa8-4bdf-80f8-b55053d694f1-nginx-conf\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-trusted-ca\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.378922    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.378936    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b497ff687-sxxqj: secret "image-registry-tls" not found
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.378978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-certificates\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.378990    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls podName:53b83a06-1bed-4dc8-a5da-3efdeae42457 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:58.878973006 +0000 UTC m=+39.123801581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls") pod "image-registry-5b497ff687-sxxqj" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457") : secret "image-registry-tls" not found
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.380339    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53b83a06-1bed-4dc8-a5da-3efdeae42457-ca-trust-extracted\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.381539 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.380440    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:32:58.383026 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.380504    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert podName:b916b4e7-efa8-4bdf-80f8-b55053d694f1 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:58.880486549 +0000 UTC m=+39.125315112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-m8xnm" (UID: "b916b4e7-efa8-4bdf-80f8-b55053d694f1") : secret "networking-console-plugin-cert" not found
Sep 09 20:32:58.383026 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.380666    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 20:32:58.383026 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.380740    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls podName:79f0c4c7-b059-414c-83ea-6ce364f4efef nodeName:}" failed. No retries permitted until 2026-09-09 20:32:58.880723564 +0000 UTC m=+39.125552128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-v47sx" (UID: "79f0c4c7-b059-414c-83ea-6ce364f4efef") : secret "samples-operator-tls" not found
Sep 09 20:32:58.383026 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.381176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b916b4e7-efa8-4bdf-80f8-b55053d694f1-nginx-conf\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:32:58.383026 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.381346    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"
Sep 09 20:32:58.383026 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.381874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-trusted-ca\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.383610 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.383586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-image-registry-private-configuration\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.383879 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.383854    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-installation-pull-secrets\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.388554 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.388523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-bound-sa-token\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.388847 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.388818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6bhk\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-kube-api-access-j6bhk\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.389446 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.389426    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg5fl\" (UniqueName: \"kubernetes.io/projected/79f0c4c7-b059-414c-83ea-6ce364f4efef-kube-api-access-tg5fl\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:32:58.394409 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.394363    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"
Sep 09 20:32:58.404081 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.403978    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:32:58.580209 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.580177    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b191398-6bb5-4187-975f-b3f80cbfa755" containerID="69323d58f4575d29de78b1420a9381a696885070151d0b7f45acb85c2d2634ad" exitCode=0
Sep 09 20:32:58.580385 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.580228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vs4js" event={"ID":"6b191398-6bb5-4187-975f-b3f80cbfa755","Type":"ContainerDied","Data":"69323d58f4575d29de78b1420a9381a696885070151d0b7f45acb85c2d2634ad"}
Sep 09 20:32:58.582002 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.581968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wrk8d" event={"ID":"c71a4735-d550-4196-9076-3649aab7c6c8","Type":"ContainerStarted","Data":"7256f25d2d4e35113c1e9830708f93fc49c69c060d0a0e1c8b7f1b173b62bb55"}
Sep 09 20:32:58.597715 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.597693    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsrhq"]
Sep 09 20:32:58.601364 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:58.601342    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda905cef8_9ede_4ef9_b010_ba78a21cf9e5.slice/crio-3ac17480ed83cb75e6c8e873cda989511b8e0286b34e60dcb0f34081d1d180e7 WatchSource:0}: Error finding container 3ac17480ed83cb75e6c8e873cda989511b8e0286b34e60dcb0f34081d1d180e7: Status 404 returned error can't find the container with id 3ac17480ed83cb75e6c8e873cda989511b8e0286b34e60dcb0f34081d1d180e7
Sep 09 20:32:58.613337 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.613301    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wrk8d" podStartSLOduration=1.4945073070000001 podStartE2EDuration="4.613286137s" totalImagesPullingTime="3.11877883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:58.612744269 +0000 UTC m=+38.857572850" watchObservedRunningTime="2026-09-09 20:32:58.613286137 +0000 UTC m=+38.858114718"
Sep 09 20:32:58.634709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.634683    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-m6s8n"]
Sep 09 20:32:58.638763 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:58.638732    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12779b83_c860_4919_8ec3_b4182eae8455.slice/crio-10eb1df069a801277a5a5042dd99d587c822ec7a54382e709dfcf6683e6b32a8 WatchSource:0}: Error finding container 10eb1df069a801277a5a5042dd99d587c822ec7a54382e709dfcf6683e6b32a8: Status 404 returned error can't find the container with id 10eb1df069a801277a5a5042dd99d587c822ec7a54382e709dfcf6683e6b32a8
Sep 09 20:32:58.661350 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.661328    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-gh899"]
Sep 09 20:32:58.664758 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:58.664734    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc713a86_f70e_46dd_b67f_680ce7b4d087.slice/crio-2c64361a6158109e9897c0eb5b94aeab08ba6fa4093e974e8d92a15ca1a4e2ed WatchSource:0}: Error finding container 2c64361a6158109e9897c0eb5b94aeab08ba6fa4093e974e8d92a15ca1a4e2ed: Status 404 returned error can't find the container with id 2c64361a6158109e9897c0eb5b94aeab08ba6fa4093e974e8d92a15ca1a4e2ed
Sep 09 20:32:58.681334 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.681294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:32:58.681595 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.681530    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:32:58.681687 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.681608    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls podName:b5e47679-aac4-4d6c-86dc-f0aa8470a620 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:59.681587873 +0000 UTC m=+39.926416435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-5lwhz" (UID: "b5e47679-aac4-4d6c-86dc-f0aa8470a620") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:32:58.691027 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.691006    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87"]
Sep 09 20:32:58.693519 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:58.693498    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083804f0_418b_45c5_bb6b_e04e132459f0.slice/crio-3083ed6de219e92665e66421236c7830678ae601310b3d113da6367a8ab602f5 WatchSource:0}: Error finding container 3083ed6de219e92665e66421236c7830678ae601310b3d113da6367a8ab602f5: Status 404 returned error can't find the container with id 3083ed6de219e92665e66421236c7830678ae601310b3d113da6367a8ab602f5
Sep 09 20:32:58.722543 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.722513    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft"]
Sep 09 20:32:58.725014 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:58.724990    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode372e750_ab89_4af3_abce_7451c51194d3.slice/crio-a56036ab4f12c1ca4a862a740ecdb3a9f2e1578aa0f9eaf2f1116becd0c6f022 WatchSource:0}: Error finding container a56036ab4f12c1ca4a862a740ecdb3a9f2e1578aa0f9eaf2f1116becd0c6f022: Status 404 returned error can't find the container with id a56036ab4f12c1ca4a862a740ecdb3a9f2e1578aa0f9eaf2f1116becd0c6f022
Sep 09 20:32:58.750620 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.750462    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-89qb9"]
Sep 09 20:32:58.753130 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:32:58.753109    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14dfc402_d1ec_4e2a_8b92_97cbea8ff336.slice/crio-61a990d46e0788e80caaf8a996294bcf8cffbfb319e9acdd57d3ab9091d5ad80 WatchSource:0}: Error finding container 61a990d46e0788e80caaf8a996294bcf8cffbfb319e9acdd57d3ab9091d5ad80: Status 404 returned error can't find the container with id 61a990d46e0788e80caaf8a996294bcf8cffbfb319e9acdd57d3ab9091d5ad80
Sep 09 20:32:58.782439 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.782417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.782538 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.782455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:58.782598 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.782562    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 20:32:58.782641 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.782569    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:59.782547468 +0000 UTC m=+40.027376046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : configmap references non-existent config key: service-ca.crt
Sep 09 20:32:58.782690 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.782645    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:59.782625959 +0000 UTC m=+40.027454522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : secret "router-metrics-certs-default" not found
Sep 09 20:32:58.883021 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.882995    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:32:58.883499 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.883097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:32:58.883499 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:58.883131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:58.883499 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.883168    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:32:58.883499 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.883225    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 20:32:58.883499 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.883246    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:32:58.883499 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.883259    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b497ff687-sxxqj: secret "image-registry-tls" not found
Sep 09 20:32:58.883499 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.883229    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert podName:b916b4e7-efa8-4bdf-80f8-b55053d694f1 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:59.883211108 +0000 UTC m=+40.128039686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-m8xnm" (UID: "b916b4e7-efa8-4bdf-80f8-b55053d694f1") : secret "networking-console-plugin-cert" not found
Sep 09 20:32:58.883499 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.883287    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls podName:79f0c4c7-b059-414c-83ea-6ce364f4efef nodeName:}" failed. No retries permitted until 2026-09-09 20:32:59.883271622 +0000 UTC m=+40.128100194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-v47sx" (UID: "79f0c4c7-b059-414c-83ea-6ce364f4efef") : secret "samples-operator-tls" not found
Sep 09 20:32:58.883499 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:58.883306    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls podName:53b83a06-1bed-4dc8-a5da-3efdeae42457 nodeName:}" failed. No retries permitted until 2026-09-09 20:32:59.883296258 +0000 UTC m=+40.128124830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls") pod "image-registry-5b497ff687-sxxqj" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457") : secret "image-registry-tls" not found
Sep 09 20:32:59.589786 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.589748    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft" event={"ID":"e372e750-ab89-4af3-abce-7451c51194d3","Type":"ContainerStarted","Data":"a56036ab4f12c1ca4a862a740ecdb3a9f2e1578aa0f9eaf2f1116becd0c6f022"}
Sep 09 20:32:59.595896 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.594995    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b191398-6bb5-4187-975f-b3f80cbfa755" containerID="3634ccd2b96da41a0d228db76afda54a143dd722f3e9d311559b6f9107369929" exitCode=0
Sep 09 20:32:59.595896 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.595113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vs4js" event={"ID":"6b191398-6bb5-4187-975f-b3f80cbfa755","Type":"ContainerDied","Data":"3634ccd2b96da41a0d228db76afda54a143dd722f3e9d311559b6f9107369929"}
Sep 09 20:32:59.598967 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.598889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsrhq" event={"ID":"a905cef8-9ede-4ef9-b010-ba78a21cf9e5","Type":"ContainerStarted","Data":"3ac17480ed83cb75e6c8e873cda989511b8e0286b34e60dcb0f34081d1d180e7"}
Sep 09 20:32:59.605252 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.605197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87" event={"ID":"083804f0-418b-45c5-bb6b-e04e132459f0","Type":"ContainerStarted","Data":"3083ed6de219e92665e66421236c7830678ae601310b3d113da6367a8ab602f5"}
Sep 09 20:32:59.606702 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.606643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-gh899" event={"ID":"fc713a86-f70e-46dd-b67f-680ce7b4d087","Type":"ContainerStarted","Data":"2c64361a6158109e9897c0eb5b94aeab08ba6fa4093e974e8d92a15ca1a4e2ed"}
Sep 09 20:32:59.609441 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.609415    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-89qb9" event={"ID":"14dfc402-d1ec-4e2a-8b92-97cbea8ff336","Type":"ContainerStarted","Data":"61a990d46e0788e80caaf8a996294bcf8cffbfb319e9acdd57d3ab9091d5ad80"}
Sep 09 20:32:59.614075 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.614008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n" event={"ID":"12779b83-c860-4919-8ec3-b4182eae8455","Type":"ContainerStarted","Data":"10eb1df069a801277a5a5042dd99d587c822ec7a54382e709dfcf6683e6b32a8"}
Sep 09 20:32:59.689373 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.689324    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:32:59.690228 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.690203    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:32:59.690352 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.690276    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls podName:b5e47679-aac4-4d6c-86dc-f0aa8470a620 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:01.69025478 +0000 UTC m=+41.935083339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-5lwhz" (UID: "b5e47679-aac4-4d6c-86dc-f0aa8470a620") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:32:59.791718 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.790345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:59.791718 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.790414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:32:59.791718 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.790692    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 20:32:59.791718 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.790753    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:01.790733662 +0000 UTC m=+42.035562222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : secret "router-metrics-certs-default" not found
Sep 09 20:32:59.791718 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.791508    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:01.791490377 +0000 UTC m=+42.036318940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : configmap references non-existent config key: service-ca.crt
Sep 09 20:32:59.891876 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.891781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:32:59.891876 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.891861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:32:59.892380 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:32:59.892001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:32:59.892380 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.892156    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:32:59.892380 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.892222    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert podName:b916b4e7-efa8-4bdf-80f8-b55053d694f1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:01.892202567 +0000 UTC m=+42.137031140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-m8xnm" (UID: "b916b4e7-efa8-4bdf-80f8-b55053d694f1") : secret "networking-console-plugin-cert" not found
Sep 09 20:32:59.892662 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.892621    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 20:32:59.892740 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.892679    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls podName:79f0c4c7-b059-414c-83ea-6ce364f4efef nodeName:}" failed. No retries permitted until 2026-09-09 20:33:01.892663564 +0000 UTC m=+42.137492146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-v47sx" (UID: "79f0c4c7-b059-414c-83ea-6ce364f4efef") : secret "samples-operator-tls" not found
Sep 09 20:32:59.892798 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.892748    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:32:59.892798 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.892759    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b497ff687-sxxqj: secret "image-registry-tls" not found
Sep 09 20:32:59.892798 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:32:59.892791    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls podName:53b83a06-1bed-4dc8-a5da-3efdeae42457 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:01.892780176 +0000 UTC m=+42.137608735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls") pod "image-registry-5b497ff687-sxxqj" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457") : secret "image-registry-tls" not found
Sep 09 20:33:00.625074 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:00.624279    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vs4js" event={"ID":"6b191398-6bb5-4187-975f-b3f80cbfa755","Type":"ContainerStarted","Data":"7961f5e835ca991915c9f1662cb7df3398b1b3402b5d23cba04571522505aaef"}
Sep 09 20:33:00.645677 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:00.645333    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vs4js" podStartSLOduration=7.719285623 podStartE2EDuration="39.645293276s" totalImagesPullingTime="31.926007653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:32:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:00.644830337 +0000 UTC m=+40.889658928" watchObservedRunningTime="2026-09-09 20:33:00.645293276 +0000 UTC m=+40.890121856"
Sep 09 20:33:01.711028 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:01.710996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:33:01.711418 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.711164    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:33:01.711418 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.711241    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls podName:b5e47679-aac4-4d6c-86dc-f0aa8470a620 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:05.711219909 +0000 UTC m=+45.956048472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-5lwhz" (UID: "b5e47679-aac4-4d6c-86dc-f0aa8470a620") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:33:01.811987 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:01.811946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:01.812175 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:01.812009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:01.812786 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.812417    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:05.812392488 +0000 UTC m=+46.057221050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : configmap references non-existent config key: service-ca.crt
Sep 09 20:33:01.812786 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.812549    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 20:33:01.812786 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.812602    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:05.812585246 +0000 UTC m=+46.057413820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : secret "router-metrics-certs-default" not found
Sep 09 20:33:01.912892 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:01.912850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:33:01.913030 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:01.912901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:33:01.913030 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:01.912938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:33:01.913030 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:01.912983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:33:01.913030 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.913005    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:33:01.913240 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.913044    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:33:01.913240 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.913086    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert podName:b916b4e7-efa8-4bdf-80f8-b55053d694f1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:05.913066836 +0000 UTC m=+46.157895408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-m8xnm" (UID: "b916b4e7-efa8-4bdf-80f8-b55053d694f1") : secret "networking-console-plugin-cert" not found
Sep 09 20:33:01.913240 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.913086    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 20:33:01.913240 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.913106    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:33:01.913240 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.913111    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls podName:09017953-d969-484e-a7f5-2b283dcc9057 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:09.913098274 +0000 UTC m=+50.157926836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls") pod "dns-default-qx7w6" (UID: "09017953-d969-484e-a7f5-2b283dcc9057") : secret "dns-default-metrics-tls" not found
Sep 09 20:33:01.913240 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.913117    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b497ff687-sxxqj: secret "image-registry-tls" not found
Sep 09 20:33:01.913240 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.913141    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls podName:79f0c4c7-b059-414c-83ea-6ce364f4efef nodeName:}" failed. No retries permitted until 2026-09-09 20:33:05.913127051 +0000 UTC m=+46.157955623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-v47sx" (UID: "79f0c4c7-b059-414c-83ea-6ce364f4efef") : secret "samples-operator-tls" not found
Sep 09 20:33:01.913240 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:01.913161    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls podName:53b83a06-1bed-4dc8-a5da-3efdeae42457 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:05.913150986 +0000 UTC m=+46.157979544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls") pod "image-registry-5b497ff687-sxxqj" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457") : secret "image-registry-tls" not found
Sep 09 20:33:05.642085 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.642029    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsrhq" event={"ID":"a905cef8-9ede-4ef9-b010-ba78a21cf9e5","Type":"ContainerStarted","Data":"a5c029391d3e9367db6d2fa4e40c2284389a10c407829b56a00a6cdcfc18ee59"}
Sep 09 20:33:05.644104 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.644032    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87" event={"ID":"083804f0-418b-45c5-bb6b-e04e132459f0","Type":"ContainerStarted","Data":"9d458f0c20cb0f01847b6d91f935669061a752137796e81402af05fbec60ae21"}
Sep 09 20:33:05.645777 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.645716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-gh899" event={"ID":"fc713a86-f70e-46dd-b67f-680ce7b4d087","Type":"ContainerStarted","Data":"9f1a170b9d622af830694b9af3489691f0b65b8138502d49420507719eb646b8"}
Sep 09 20:33:05.647532 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.647514    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/0.log"
Sep 09 20:33:05.647632 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.647552    2576 generic.go:356] "Generic (PLEG): container finished" podID="14dfc402-d1ec-4e2a-8b92-97cbea8ff336" containerID="9036e2e309b19991d2b40aedecbe9abdf1ef045c7f4938cbc1ace1b48a0d16ac" exitCode=255
Sep 09 20:33:05.647632 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.647627    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-89qb9" event={"ID":"14dfc402-d1ec-4e2a-8b92-97cbea8ff336","Type":"ContainerDied","Data":"9036e2e309b19991d2b40aedecbe9abdf1ef045c7f4938cbc1ace1b48a0d16ac"}
Sep 09 20:33:05.647841 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.647824    2576 scope.go:117] "RemoveContainer" containerID="9036e2e309b19991d2b40aedecbe9abdf1ef045c7f4938cbc1ace1b48a0d16ac"
Sep 09 20:33:05.652352 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.650403    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n" event={"ID":"12779b83-c860-4919-8ec3-b4182eae8455","Type":"ContainerStarted","Data":"7b2bbfeab1fbc31cb66623c57382216e3f5a2df000b75798c9cc21698545dd89"}
Sep 09 20:33:05.657989 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.657960    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft" event={"ID":"e372e750-ab89-4af3-abce-7451c51194d3","Type":"ContainerStarted","Data":"735359940ee58bca0c3e324bd490660c3d48e6b995fc50be9b4e9da6bdc6ed62"}
Sep 09 20:33:05.664514 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.664464    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsrhq" podStartSLOduration=2.266182035 podStartE2EDuration="8.66444996s" totalImagesPullingTime="6.398267925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:05.66362739 +0000 UTC m=+45.908455973" watchObservedRunningTime="2026-09-09 20:33:05.66444996 +0000 UTC m=+45.909278547"
Sep 09 20:33:05.688295 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.688255    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n" podStartSLOduration=2.31604446 podStartE2EDuration="8.688242771s" totalImagesPullingTime="6.372198311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:05.68804098 +0000 UTC m=+45.932869564" watchObservedRunningTime="2026-09-09 20:33:05.688242771 +0000 UTC m=+45.933071351"
Sep 09 20:33:05.745853 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.745283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:33:05.749315 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.747037    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87" podStartSLOduration=1.422739849 podStartE2EDuration="7.747018439s" totalImagesPullingTime="6.32427859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:05.714212962 +0000 UTC m=+45.959041543" watchObservedRunningTime="2026-09-09 20:33:05.747018439 +0000 UTC m=+45.991847022"
Sep 09 20:33:05.749315 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.747636    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft" podStartSLOduration=1.461698329 podStartE2EDuration="7.747623675s" totalImagesPullingTime="6.285925346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:05.745845358 +0000 UTC m=+45.990673939" watchObservedRunningTime="2026-09-09 20:33:05.747623675 +0000 UTC m=+45.992452257"
Sep 09 20:33:05.749315 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.747725    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:33:05.749315 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.747781    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls podName:b5e47679-aac4-4d6c-86dc-f0aa8470a620 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:13.74776319 +0000 UTC m=+53.992591752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-5lwhz" (UID: "b5e47679-aac4-4d6c-86dc-f0aa8470a620") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:33:05.799182 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.799118    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-gh899" podStartSLOduration=2.248506303 podStartE2EDuration="8.799097986s" totalImagesPullingTime="6.550591683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:05.79848561 +0000 UTC m=+46.043314189" watchObservedRunningTime="2026-09-09 20:33:05.799097986 +0000 UTC m=+46.043926567"
Sep 09 20:33:05.846631 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.846603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:05.846750 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.846685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:05.846750 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.846732    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:13.8467137 +0000 UTC m=+54.091542280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : configmap references non-existent config key: service-ca.crt
Sep 09 20:33:05.846860 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.846771    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 20:33:05.846860 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.846810    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:13.846798626 +0000 UTC m=+54.091627202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : secret "router-metrics-certs-default" not found
Sep 09 20:33:05.947686 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.947608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:33:05.947819 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.947696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:33:05.947819 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:05.947742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:33:05.947819 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.947771    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:33:05.947974 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.947834    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert podName:b916b4e7-efa8-4bdf-80f8-b55053d694f1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:13.94781552 +0000 UTC m=+54.192644086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-m8xnm" (UID: "b916b4e7-efa8-4bdf-80f8-b55053d694f1") : secret "networking-console-plugin-cert" not found
Sep 09 20:33:05.947974 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.947852    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 20:33:05.947974 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.947900    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:33:05.947974 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.947911    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls podName:79f0c4c7-b059-414c-83ea-6ce364f4efef nodeName:}" failed. No retries permitted until 2026-09-09 20:33:13.947894013 +0000 UTC m=+54.192722578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-v47sx" (UID: "79f0c4c7-b059-414c-83ea-6ce364f4efef") : secret "samples-operator-tls" not found
Sep 09 20:33:05.947974 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.947912    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b497ff687-sxxqj: secret "image-registry-tls" not found
Sep 09 20:33:05.947974 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:05.947960    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls podName:53b83a06-1bed-4dc8-a5da-3efdeae42457 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:13.947946727 +0000 UTC m=+54.192775290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls") pod "image-registry-5b497ff687-sxxqj" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457") : secret "image-registry-tls" not found
Sep 09 20:33:06.664077 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.664030    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/1.log"
Sep 09 20:33:06.665018 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.664998    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/0.log"
Sep 09 20:33:06.665213 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.665193    2576 generic.go:356] "Generic (PLEG): container finished" podID="14dfc402-d1ec-4e2a-8b92-97cbea8ff336" containerID="ce17fe113d68af4d53f4a28528fc689b4bc9fa77b643882f8d980f8ba76a8848" exitCode=255
Sep 09 20:33:06.665491 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.665456    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-89qb9" event={"ID":"14dfc402-d1ec-4e2a-8b92-97cbea8ff336","Type":"ContainerDied","Data":"ce17fe113d68af4d53f4a28528fc689b4bc9fa77b643882f8d980f8ba76a8848"}
Sep 09 20:33:06.665597 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.665523    2576 scope.go:117] "RemoveContainer" containerID="9036e2e309b19991d2b40aedecbe9abdf1ef045c7f4938cbc1ace1b48a0d16ac"
Sep 09 20:33:06.667081 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.666846    2576 scope.go:117] "RemoveContainer" containerID="ce17fe113d68af4d53f4a28528fc689b4bc9fa77b643882f8d980f8ba76a8848"
Sep 09 20:33:06.667081 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:06.667012    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-89qb9_openshift-console-operator(14dfc402-d1ec-4e2a-8b92-97cbea8ff336)\"" pod="openshift-console-operator/console-operator-85b454874b-89qb9" podUID="14dfc402-d1ec-4e2a-8b92-97cbea8ff336"
Sep 09 20:33:06.809191 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.809155    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-twshm"]
Sep 09 20:33:06.816139 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.816116    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:06.820291 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.820268    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 20:33:06.820440 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.820307    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 20:33:06.820440 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.820327    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ng47s\""
Sep 09 20:33:06.830942 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.830921    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-twshm"]
Sep 09 20:33:06.958306 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.958221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp9sn\" (UniqueName: \"kubernetes.io/projected/7cd53f81-f651-4934-9948-017af2f70ec8-kube-api-access-vp9sn\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:06.958306 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.958271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:06.958536 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.958393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7cd53f81-f651-4934-9948-017af2f70ec8-crio-socket\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:06.958536 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.958441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:06.958536 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:06.958478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7cd53f81-f651-4934-9948-017af2f70ec8-data-volume\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:07.059091 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.059029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7cd53f81-f651-4934-9948-017af2f70ec8-crio-socket\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:07.059256 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.059115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:07.059256 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.059141    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7cd53f81-f651-4934-9948-017af2f70ec8-data-volume\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:07.059256 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.059171    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7cd53f81-f651-4934-9948-017af2f70ec8-crio-socket\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:07.059256 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.059204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9sn\" (UniqueName: \"kubernetes.io/projected/7cd53f81-f651-4934-9948-017af2f70ec8-kube-api-access-vp9sn\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:07.059256 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.059234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:07.059256 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:07.059237    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:33:07.059569 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:07.059297    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm podName:7cd53f81-f651-4934-9948-017af2f70ec8 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:07.559280876 +0000 UTC m=+47.804109435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-twshm" (UID: "7cd53f81-f651-4934-9948-017af2f70ec8") : configmap "kube-rbac-proxy" not found
Sep 09 20:33:07.059569 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:07.059336    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:07.059569 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:07.059389    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls podName:7cd53f81-f651-4934-9948-017af2f70ec8 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:07.559375052 +0000 UTC m=+47.804203612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-twshm" (UID: "7cd53f81-f651-4934-9948-017af2f70ec8") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:07.059569 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.059501    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7cd53f81-f651-4934-9948-017af2f70ec8-data-volume\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:07.076836 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.076809    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn"]
Sep 09 20:33:07.098425 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.098370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp9sn\" (UniqueName: \"kubernetes.io/projected/7cd53f81-f651-4934-9948-017af2f70ec8-kube-api-access-vp9sn\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:07.098933 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.098910    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn"]
Sep 09 20:33:07.099073 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.099034    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn"
Sep 09 20:33:07.101519 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.101497    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 09 20:33:07.103658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.103486    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 09 20:33:07.103658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.103512    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-chlg2\""
Sep 09 20:33:07.261411 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.261331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k59g\" (UniqueName: \"kubernetes.io/projected/8190571a-3912-46ac-8a71-cd5d36404fbb-kube-api-access-6k59g\") pod \"migrator-fdbb8fdff-x6jkn\" (UID: \"8190571a-3912-46ac-8a71-cd5d36404fbb\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn"
Sep 09 20:33:07.362358 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.362323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k59g\" (UniqueName: \"kubernetes.io/projected/8190571a-3912-46ac-8a71-cd5d36404fbb-kube-api-access-6k59g\") pod \"migrator-fdbb8fdff-x6jkn\" (UID: \"8190571a-3912-46ac-8a71-cd5d36404fbb\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn"
Sep 09 20:33:07.370155 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.370125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k59g\" (UniqueName: \"kubernetes.io/projected/8190571a-3912-46ac-8a71-cd5d36404fbb-kube-api-access-6k59g\") pod \"migrator-fdbb8fdff-x6jkn\" (UID: \"8190571a-3912-46ac-8a71-cd5d36404fbb\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn"
Sep 09 20:33:07.412238 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.412214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn"
Sep 09 20:33:07.563717 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.563692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:07.563865 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:07.563848    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:07.563902 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.563867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:07.563936 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:07.563911    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls podName:7cd53f81-f651-4934-9948-017af2f70ec8 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:08.563896053 +0000 UTC m=+48.808724611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-twshm" (UID: "7cd53f81-f651-4934-9948-017af2f70ec8") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:07.563980 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:07.563939    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:33:07.564013 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:07.563993    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm podName:7cd53f81-f651-4934-9948-017af2f70ec8 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:08.563977628 +0000 UTC m=+48.808806202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-twshm" (UID: "7cd53f81-f651-4934-9948-017af2f70ec8") : configmap "kube-rbac-proxy" not found
Sep 09 20:33:07.672140 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.672113    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/1.log"
Sep 09 20:33:07.672483 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.672450    2576 scope.go:117] "RemoveContainer" containerID="ce17fe113d68af4d53f4a28528fc689b4bc9fa77b643882f8d980f8ba76a8848"
Sep 09 20:33:07.672661 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:07.672641    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-89qb9_openshift-console-operator(14dfc402-d1ec-4e2a-8b92-97cbea8ff336)\"" pod="openshift-console-operator/console-operator-85b454874b-89qb9" podUID="14dfc402-d1ec-4e2a-8b92-97cbea8ff336"
Sep 09 20:33:07.708370 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:07.708167    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn"]
Sep 09 20:33:07.710526 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:07.710504    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8190571a_3912_46ac_8a71_cd5d36404fbb.slice/crio-b43995abb46dc05dad6c9cd9746739b3e57a1a7054a67d422deb09fa9968e551 WatchSource:0}: Error finding container b43995abb46dc05dad6c9cd9746739b3e57a1a7054a67d422deb09fa9968e551: Status 404 returned error can't find the container with id b43995abb46dc05dad6c9cd9746739b3e57a1a7054a67d422deb09fa9968e551
Sep 09 20:33:08.404356 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:08.404314    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:33:08.404529 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:08.404389    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:33:08.517453 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:08.517424    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zcn9h_7603a07e-0f67-4839-8e2e-b2e311c996c6/dns-node-resolver/0.log"
Sep 09 20:33:08.573103 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:08.573075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:08.573255 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:08.573173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:08.573255 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:08.573244    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:08.573378 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:08.573281    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:33:08.573378 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:08.573319    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls podName:7cd53f81-f651-4934-9948-017af2f70ec8 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:10.573295329 +0000 UTC m=+50.818123888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-twshm" (UID: "7cd53f81-f651-4934-9948-017af2f70ec8") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:08.573378 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:08.573340    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm podName:7cd53f81-f651-4934-9948-017af2f70ec8 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:10.573329643 +0000 UTC m=+50.818158207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-twshm" (UID: "7cd53f81-f651-4934-9948-017af2f70ec8") : configmap "kube-rbac-proxy" not found
Sep 09 20:33:08.676448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:08.676375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn" event={"ID":"8190571a-3912-46ac-8a71-cd5d36404fbb","Type":"ContainerStarted","Data":"b43995abb46dc05dad6c9cd9746739b3e57a1a7054a67d422deb09fa9968e551"}
Sep 09 20:33:08.676787 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:08.676633    2576 scope.go:117] "RemoveContainer" containerID="ce17fe113d68af4d53f4a28528fc689b4bc9fa77b643882f8d980f8ba76a8848"
Sep 09 20:33:08.676787 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:08.676774    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-89qb9_openshift-console-operator(14dfc402-d1ec-4e2a-8b92-97cbea8ff336)\"" pod="openshift-console-operator/console-operator-85b454874b-89qb9" podUID="14dfc402-d1ec-4e2a-8b92-97cbea8ff336"
Sep 09 20:33:09.517072 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:09.517025    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-srzwr_da9f7d49-8d2b-467a-9a40-d426dd917c99/node-ca/0.log"
Sep 09 20:33:09.681117 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:09.681078    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn" event={"ID":"8190571a-3912-46ac-8a71-cd5d36404fbb","Type":"ContainerStarted","Data":"cb113260242713da89f19bb1fd9ce16b55ec571a57e7ede3a60f120032072eea"}
Sep 09 20:33:09.681536 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:09.681167    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn" event={"ID":"8190571a-3912-46ac-8a71-cd5d36404fbb","Type":"ContainerStarted","Data":"be1a29ecab00f0a106ad7801bcc9d243eed1824bd54d894219cdd27e2df72e21"}
Sep 09 20:33:09.702475 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:09.702419    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-x6jkn" podStartSLOduration=1.450726256 podStartE2EDuration="2.702402627s" totalImagesPullingTime="1.251676371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:09.701258491 +0000 UTC m=+49.946087072" watchObservedRunningTime="2026-09-09 20:33:09.702402627 +0000 UTC m=+49.947231206"
Sep 09 20:33:09.986324 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:09.986278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:33:09.986507 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:09.986439    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 20:33:09.986558 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:09.986537    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls podName:09017953-d969-484e-a7f5-2b283dcc9057 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:25.986520811 +0000 UTC m=+66.231349380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls") pod "dns-default-qx7w6" (UID: "09017953-d969-484e-a7f5-2b283dcc9057") : secret "dns-default-metrics-tls" not found
Sep 09 20:33:10.117557 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:10.117525    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wrk8d_c71a4735-d550-4196-9076-3649aab7c6c8/serve-healthcheck-canary/0.log"
Sep 09 20:33:10.589879 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:10.589841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:10.590066 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:10.589939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:10.590066 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:10.589950    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:10.590066 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:10.590019    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls podName:7cd53f81-f651-4934-9948-017af2f70ec8 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:14.589998757 +0000 UTC m=+54.834827315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-twshm" (UID: "7cd53f81-f651-4934-9948-017af2f70ec8") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:10.590191 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:10.590063    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:33:10.590191 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:10.590121    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm podName:7cd53f81-f651-4934-9948-017af2f70ec8 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:14.590108142 +0000 UTC m=+54.834936700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-twshm" (UID: "7cd53f81-f651-4934-9948-017af2f70ec8") : configmap "kube-rbac-proxy" not found
Sep 09 20:33:13.818705 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:13.818656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:33:13.819218 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:13.818830    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 20:33:13.819218 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:13.818916    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls podName:b5e47679-aac4-4d6c-86dc-f0aa8470a620 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:29.818894378 +0000 UTC m=+70.063722949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-5lwhz" (UID: "b5e47679-aac4-4d6c-86dc-f0aa8470a620") : secret "cluster-monitoring-operator-tls" not found
Sep 09 20:33:13.919559 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:13.919509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:13.919559 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:13.919572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:13.919770 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:13.919700    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:29.919680056 +0000 UTC m=+70.164508631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : configmap references non-existent config key: service-ca.crt
Sep 09 20:33:13.919770 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:13.919724    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 20:33:13.919846 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:13.919773    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs podName:07ac87e1-029c-4b8d-a3bf-d6824fc996b1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:29.919758846 +0000 UTC m=+70.164587404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs") pod "router-default-6ff78776b6-sf6fh" (UID: "07ac87e1-029c-4b8d-a3bf-d6824fc996b1") : secret "router-metrics-certs-default" not found
Sep 09 20:33:14.020954 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:14.020918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:33:14.021190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:14.020976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:33:14.021190 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:14.021073    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 20:33:14.021190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:14.021106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:33:14.021190 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:14.021140    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls podName:79f0c4c7-b059-414c-83ea-6ce364f4efef nodeName:}" failed. No retries permitted until 2026-09-09 20:33:30.021127702 +0000 UTC m=+70.265956260 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-v47sx" (UID: "79f0c4c7-b059-414c-83ea-6ce364f4efef") : secret "samples-operator-tls" not found
Sep 09 20:33:14.021190 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:14.021077    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 20:33:14.021190 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:14.021178    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 20:33:14.021190 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:14.021190    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b497ff687-sxxqj: secret "image-registry-tls" not found
Sep 09 20:33:14.021428 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:14.021216    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert podName:b916b4e7-efa8-4bdf-80f8-b55053d694f1 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:30.021203834 +0000 UTC m=+70.266032392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-m8xnm" (UID: "b916b4e7-efa8-4bdf-80f8-b55053d694f1") : secret "networking-console-plugin-cert" not found
Sep 09 20:33:14.021428 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:14.021238    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls podName:53b83a06-1bed-4dc8-a5da-3efdeae42457 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:30.021227049 +0000 UTC m=+70.266055608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls") pod "image-registry-5b497ff687-sxxqj" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457") : secret "image-registry-tls" not found
Sep 09 20:33:14.625446 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:14.625406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:14.625725 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:14.625519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:14.625725 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:14.625557    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:14.625725 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:14.625629    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 20:33:14.625725 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:14.625635    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls podName:7cd53f81-f651-4934-9948-017af2f70ec8 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:22.625615765 +0000 UTC m=+62.870444340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-twshm" (UID: "7cd53f81-f651-4934-9948-017af2f70ec8") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:14.625725 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:14.625690    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm podName:7cd53f81-f651-4934-9948-017af2f70ec8 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:22.625678482 +0000 UTC m=+62.870507045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-twshm" (UID: "7cd53f81-f651-4934-9948-017af2f70ec8") : configmap "kube-rbac-proxy" not found
Sep 09 20:33:21.277459 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:21.277432    2576 scope.go:117] "RemoveContainer" containerID="ce17fe113d68af4d53f4a28528fc689b4bc9fa77b643882f8d980f8ba76a8848"
Sep 09 20:33:21.566281 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:21.566261    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdv5s"
Sep 09 20:33:21.720558 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:21.720529    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:33:21.720970 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:21.720954    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/1.log"
Sep 09 20:33:21.721032 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:21.720987    2576 generic.go:356] "Generic (PLEG): container finished" podID="14dfc402-d1ec-4e2a-8b92-97cbea8ff336" containerID="ef2e354746bbd2679398dd0ceba779ee329e872ae3b618dda37251553880fc7e" exitCode=255
Sep 09 20:33:21.721032 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:21.721013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-89qb9" event={"ID":"14dfc402-d1ec-4e2a-8b92-97cbea8ff336","Type":"ContainerDied","Data":"ef2e354746bbd2679398dd0ceba779ee329e872ae3b618dda37251553880fc7e"}
Sep 09 20:33:21.721129 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:21.721048    2576 scope.go:117] "RemoveContainer" containerID="ce17fe113d68af4d53f4a28528fc689b4bc9fa77b643882f8d980f8ba76a8848"
Sep 09 20:33:21.721334 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:21.721318    2576 scope.go:117] "RemoveContainer" containerID="ef2e354746bbd2679398dd0ceba779ee329e872ae3b618dda37251553880fc7e"
Sep 09 20:33:21.721496 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:21.721476    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-89qb9_openshift-console-operator(14dfc402-d1ec-4e2a-8b92-97cbea8ff336)\"" pod="openshift-console-operator/console-operator-85b454874b-89qb9" podUID="14dfc402-d1ec-4e2a-8b92-97cbea8ff336"
Sep 09 20:33:22.690861 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:22.690824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:22.691340 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:22.690948    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:22.691340 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:22.690960    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:22.691340 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:22.691026    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls podName:7cd53f81-f651-4934-9948-017af2f70ec8 nodeName:}" failed. No retries permitted until 2026-09-09 20:33:38.691006095 +0000 UTC m=+78.935834656 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-twshm" (UID: "7cd53f81-f651-4934-9948-017af2f70ec8") : secret "insights-runtime-extractor-tls" not found
Sep 09 20:33:22.691491 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:22.691462    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7cd53f81-f651-4934-9948-017af2f70ec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:22.725830 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:22.725808    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:33:25.109919 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.109878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:33:25.109919 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.109931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:33:25.112452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.112429    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 20:33:25.112982 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.112967    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 20:33:25.122898 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.122873    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7694d961-a0ef-486a-b0a9-06f0d2952673-metrics-certs\") pod \"network-metrics-daemon-b7m4c\" (UID: \"7694d961-a0ef-486a-b0a9-06f0d2952673\") " pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:33:25.122976 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.122923    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bdc10f7-ca9b-4fca-8f00-646d10bd9fed-original-pull-secret\") pod \"global-pull-secret-syncer-bdq2b\" (UID: \"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed\") " pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:33:25.189409 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.189378    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bdq2b"
Sep 09 20:33:25.211151 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.211124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dks9\" (UniqueName: \"kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9\") pod \"network-check-target-2hstv\" (UID: \"e20392cd-f44f-424c-927a-c4462e4a1206\") " pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:33:25.213536 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.213514    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dks9\" (UniqueName: \"kubernetes.io/projected/e20392cd-f44f-424c-927a-c4462e4a1206-kube-api-access-6dks9\") pod \"network-check-target-2hstv\" (UID: \"e20392cd-f44f-424c-927a-c4462e4a1206\") " pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:33:25.292700 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.292667    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9w8hr\""
Sep 09 20:33:25.298678 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.298663    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7r4f4\""
Sep 09 20:33:25.301027 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.301009    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7m4c"
Sep 09 20:33:25.307737 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.307717    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:33:25.455460 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.455429    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bdq2b"]
Sep 09 20:33:25.458262 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:25.458235    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bdc10f7_ca9b_4fca_8f00_646d10bd9fed.slice/crio-c4975f73ca9ca72a952aa121956c5850eead2c4b987f2ddf82606f3d0188248a WatchSource:0}: Error finding container c4975f73ca9ca72a952aa121956c5850eead2c4b987f2ddf82606f3d0188248a: Status 404 returned error can't find the container with id c4975f73ca9ca72a952aa121956c5850eead2c4b987f2ddf82606f3d0188248a
Sep 09 20:33:25.582384 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.582336    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2hstv"]
Sep 09 20:33:25.583632 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.583609    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b7m4c"]
Sep 09 20:33:25.585442 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:25.585412    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7694d961_a0ef_486a_b0a9_06f0d2952673.slice/crio-ae4f5200f880c36557c0e8ed1b04178fb83a1e4a5ad995d9c3d8a357707733ae WatchSource:0}: Error finding container ae4f5200f880c36557c0e8ed1b04178fb83a1e4a5ad995d9c3d8a357707733ae: Status 404 returned error can't find the container with id ae4f5200f880c36557c0e8ed1b04178fb83a1e4a5ad995d9c3d8a357707733ae
Sep 09 20:33:25.585982 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:25.585958    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20392cd_f44f_424c_927a_c4462e4a1206.slice/crio-d06d42f353c455e94b48ec3b236b4979f497e9c3d1bbd90f69c48b1d9c1a9783 WatchSource:0}: Error finding container d06d42f353c455e94b48ec3b236b4979f497e9c3d1bbd90f69c48b1d9c1a9783: Status 404 returned error can't find the container with id d06d42f353c455e94b48ec3b236b4979f497e9c3d1bbd90f69c48b1d9c1a9783
Sep 09 20:33:25.735740 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.735707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2hstv" event={"ID":"e20392cd-f44f-424c-927a-c4462e4a1206","Type":"ContainerStarted","Data":"4490b1c3d2b2f4594b1a933e546800f41fd3126cc3f257ea49fdc04380212085"}
Sep 09 20:33:25.735844 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.735760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2hstv" event={"ID":"e20392cd-f44f-424c-927a-c4462e4a1206","Type":"ContainerStarted","Data":"d06d42f353c455e94b48ec3b236b4979f497e9c3d1bbd90f69c48b1d9c1a9783"}
Sep 09 20:33:25.735844 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.735826    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:33:25.737000 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.736977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7m4c" event={"ID":"7694d961-a0ef-486a-b0a9-06f0d2952673","Type":"ContainerStarted","Data":"ae4f5200f880c36557c0e8ed1b04178fb83a1e4a5ad995d9c3d8a357707733ae"}
Sep 09 20:33:25.738102 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.738080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bdq2b" event={"ID":"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed","Type":"ContainerStarted","Data":"c4975f73ca9ca72a952aa121956c5850eead2c4b987f2ddf82606f3d0188248a"}
Sep 09 20:33:25.752181 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:25.752141    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2hstv" podStartSLOduration=65.752128408 podStartE2EDuration="1m5.752128408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:25.751115989 +0000 UTC m=+65.995944572" watchObservedRunningTime="2026-09-09 20:33:25.752128408 +0000 UTC m=+65.996956988"
Sep 09 20:33:26.017200 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:26.017120    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:33:26.019798 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:26.019765    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/09017953-d969-484e-a7f5-2b283dcc9057-metrics-tls\") pod \"dns-default-qx7w6\" (UID: \"09017953-d969-484e-a7f5-2b283dcc9057\") " pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:33:26.280522 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:26.280452    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2sgfl\""
Sep 09 20:33:26.289150 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:26.289124    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:33:26.776411 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:26.776379    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qx7w6"]
Sep 09 20:33:26.817421 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:26.817348    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09017953_d969_484e_a7f5_2b283dcc9057.slice/crio-f7fd9d0f6b1d30de19eb55d1d2e95d8d576051ab0230a2b914773519fb67bf7e WatchSource:0}: Error finding container f7fd9d0f6b1d30de19eb55d1d2e95d8d576051ab0230a2b914773519fb67bf7e: Status 404 returned error can't find the container with id f7fd9d0f6b1d30de19eb55d1d2e95d8d576051ab0230a2b914773519fb67bf7e
Sep 09 20:33:27.749603 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:27.749565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7m4c" event={"ID":"7694d961-a0ef-486a-b0a9-06f0d2952673","Type":"ContainerStarted","Data":"cc9b1db065dc4de5bde40cd207187d003bb53f15d26f01000ec06687bc5e14b2"}
Sep 09 20:33:27.750004 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:27.749637    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7m4c" event={"ID":"7694d961-a0ef-486a-b0a9-06f0d2952673","Type":"ContainerStarted","Data":"cc6615bb16181e39096cd3b48f9fab256056d7d63bab20f795b8e51ae8cb9520"}
Sep 09 20:33:27.751025 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:27.750996    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx7w6" event={"ID":"09017953-d969-484e-a7f5-2b283dcc9057","Type":"ContainerStarted","Data":"f7fd9d0f6b1d30de19eb55d1d2e95d8d576051ab0230a2b914773519fb67bf7e"}
Sep 09 20:33:27.769078 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:27.768782    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b7m4c" podStartSLOduration=65.506709002 podStartE2EDuration="1m6.768764177s" totalImagesPullingTime="1.262055175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:27.767183452 +0000 UTC m=+68.012012033" watchObservedRunningTime="2026-09-09 20:33:27.768764177 +0000 UTC m=+68.013592758"
Sep 09 20:33:28.404790 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:28.404751    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:33:28.404991 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:28.404824    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:33:28.405267 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:28.405240    2576 scope.go:117] "RemoveContainer" containerID="ef2e354746bbd2679398dd0ceba779ee329e872ae3b618dda37251553880fc7e"
Sep 09 20:33:28.405468 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:28.405446    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-89qb9_openshift-console-operator(14dfc402-d1ec-4e2a-8b92-97cbea8ff336)\"" pod="openshift-console-operator/console-operator-85b454874b-89qb9" podUID="14dfc402-d1ec-4e2a-8b92-97cbea8ff336"
Sep 09 20:33:29.858380 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:29.858330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:33:29.861116 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:29.861089    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5e47679-aac4-4d6c-86dc-f0aa8470a620-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-5lwhz\" (UID: \"b5e47679-aac4-4d6c-86dc-f0aa8470a620\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:33:29.960139 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:29.959279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:29.960139 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:29.959439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:29.960139 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:29.960096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-service-ca-bundle\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:29.963392 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:29.963367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ac87e1-029c-4b8d-a3bf-d6824fc996b1-metrics-certs\") pod \"router-default-6ff78776b6-sf6fh\" (UID: \"07ac87e1-029c-4b8d-a3bf-d6824fc996b1\") " pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:30.060858 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.059943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:33:30.060858 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.060001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:33:30.060858 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.060500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:33:30.063401 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.063356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/79f0c4c7-b059-414c-83ea-6ce364f4efef-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v47sx\" (UID: \"79f0c4c7-b059-414c-83ea-6ce364f4efef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:33:30.063671 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.063652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls\") pod \"image-registry-5b497ff687-sxxqj\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") " pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:33:30.064044 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.063998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b916b4e7-efa8-4bdf-80f8-b55053d694f1-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-m8xnm\" (UID: \"b916b4e7-efa8-4bdf-80f8-b55053d694f1\") " pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:33:30.117852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.117788    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kptf5\""
Sep 09 20:33:30.125871 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.125849    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"
Sep 09 20:33:30.129911 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.129890    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b497ff687-sxxqj"]
Sep 09 20:33:30.132135 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.132115    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b4pxw\""
Sep 09 20:33:30.140923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.140898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:33:30.215133 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.214961    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7kghx\""
Sep 09 20:33:30.222308 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.222264    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:30.310655 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.310631    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bwxhb\""
Sep 09 20:33:30.316263 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.316245    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-64hlt\""
Sep 09 20:33:30.318709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.318694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm"
Sep 09 20:33:30.324967 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.324947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"
Sep 09 20:33:30.413642 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.413613    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz"]
Sep 09 20:33:30.416428 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:30.416398    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e47679_aac4_4d6c_86dc_f0aa8470a620.slice/crio-8b5f7f31e980347b50f5c1d68814e2f946e67c2f562a9bb316c1a7df2d4bf590 WatchSource:0}: Error finding container 8b5f7f31e980347b50f5c1d68814e2f946e67c2f562a9bb316c1a7df2d4bf590: Status 404 returned error can't find the container with id 8b5f7f31e980347b50f5c1d68814e2f946e67c2f562a9bb316c1a7df2d4bf590
Sep 09 20:33:30.422255 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.422224    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b497ff687-sxxqj"]
Sep 09 20:33:30.425470 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:30.425449    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b83a06_1bed_4dc8_a5da_3efdeae42457.slice/crio-25fb97545619a792d2a1297bcf7f87919522c2b4be3b988a5cc07beb0dd9ba87 WatchSource:0}: Error finding container 25fb97545619a792d2a1297bcf7f87919522c2b4be3b988a5cc07beb0dd9ba87: Status 404 returned error can't find the container with id 25fb97545619a792d2a1297bcf7f87919522c2b4be3b988a5cc07beb0dd9ba87
Sep 09 20:33:30.498707 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.498681    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6ff78776b6-sf6fh"]
Sep 09 20:33:30.500943 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:30.500921    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ac87e1_029c_4b8d_a3bf_d6824fc996b1.slice/crio-5451a85e6149726f8bd4e7b51bc30844dc53e7baaf134fc1952b9d5b7472d468 WatchSource:0}: Error finding container 5451a85e6149726f8bd4e7b51bc30844dc53e7baaf134fc1952b9d5b7472d468: Status 404 returned error can't find the container with id 5451a85e6149726f8bd4e7b51bc30844dc53e7baaf134fc1952b9d5b7472d468
Sep 09 20:33:30.602167 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.602138    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-m8xnm"]
Sep 09 20:33:30.603927 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:30.603898    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb916b4e7_efa8_4bdf_80f8_b55053d694f1.slice/crio-ed68d8c16e5eb9d0e6d72463dedfb1e5cb47ead4c6e5445387f5d9b37fe34e46 WatchSource:0}: Error finding container ed68d8c16e5eb9d0e6d72463dedfb1e5cb47ead4c6e5445387f5d9b37fe34e46: Status 404 returned error can't find the container with id ed68d8c16e5eb9d0e6d72463dedfb1e5cb47ead4c6e5445387f5d9b37fe34e46
Sep 09 20:33:30.613302 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.612217    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx"]
Sep 09 20:33:30.766831 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.766794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bdq2b" event={"ID":"3bdc10f7-ca9b-4fca-8f00-646d10bd9fed","Type":"ContainerStarted","Data":"19bd064cecc1da6b4f7a0febd24881de4b2b20236b7a746e23dda3e395d8797f"}
Sep 09 20:33:30.768588 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.768561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj" event={"ID":"53b83a06-1bed-4dc8-a5da-3efdeae42457","Type":"ContainerStarted","Data":"344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac"}
Sep 09 20:33:30.768713 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.768599    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj" event={"ID":"53b83a06-1bed-4dc8-a5da-3efdeae42457","Type":"ContainerStarted","Data":"25fb97545619a792d2a1297bcf7f87919522c2b4be3b988a5cc07beb0dd9ba87"}
Sep 09 20:33:30.768713 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.768649    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:33:30.769968 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.769932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz" event={"ID":"b5e47679-aac4-4d6c-86dc-f0aa8470a620","Type":"ContainerStarted","Data":"8b5f7f31e980347b50f5c1d68814e2f946e67c2f562a9bb316c1a7df2d4bf590"}
Sep 09 20:33:30.771827 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.771801    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx7w6" event={"ID":"09017953-d969-484e-a7f5-2b283dcc9057","Type":"ContainerStarted","Data":"ef5c7fd0c8443af69b5bd250a9bb2d9b83e2bda06652a4d22b0199747879d574"}
Sep 09 20:33:30.771918 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.771850    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx7w6" event={"ID":"09017953-d969-484e-a7f5-2b283dcc9057","Type":"ContainerStarted","Data":"b8840904485d8596a859ad585c6f1edd5bfe3f1004bb76e8d6cdb0aacf14d934"}
Sep 09 20:33:30.771918 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.771898    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:33:30.772994 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.772975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx" event={"ID":"79f0c4c7-b059-414c-83ea-6ce364f4efef","Type":"ContainerStarted","Data":"b5ddb3c23050437c02378dcd020eaf1b21ef925b27dd063280fe27b576f8a6b0"}
Sep 09 20:33:30.774098 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.774077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm" event={"ID":"b916b4e7-efa8-4bdf-80f8-b55053d694f1","Type":"ContainerStarted","Data":"ed68d8c16e5eb9d0e6d72463dedfb1e5cb47ead4c6e5445387f5d9b37fe34e46"}
Sep 09 20:33:30.775478 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.775462    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6ff78776b6-sf6fh" event={"ID":"07ac87e1-029c-4b8d-a3bf-d6824fc996b1","Type":"ContainerStarted","Data":"ce72fd3db929593f4fb63ada1df155a6d51a702f14f57f6df8101ac202eb6a48"}
Sep 09 20:33:30.775552 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.775495    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6ff78776b6-sf6fh" event={"ID":"07ac87e1-029c-4b8d-a3bf-d6824fc996b1","Type":"ContainerStarted","Data":"5451a85e6149726f8bd4e7b51bc30844dc53e7baaf134fc1952b9d5b7472d468"}
Sep 09 20:33:30.782682 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.782642    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bdq2b" podStartSLOduration=65.285225798 podStartE2EDuration="1m9.782629813s" totalImagesPullingTime="4.497404015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:30.781468062 +0000 UTC m=+71.026296632" watchObservedRunningTime="2026-09-09 20:33:30.782629813 +0000 UTC m=+71.027458392"
Sep 09 20:33:30.800204 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.800166    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj" podStartSLOduration=32.800155224 podStartE2EDuration="32.800155224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:30.799592298 +0000 UTC m=+71.044420888" watchObservedRunningTime="2026-09-09 20:33:30.800155224 +0000 UTC m=+71.044983798"
Sep 09 20:33:30.819410 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.819371    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qx7w6" podStartSLOduration=33.712350827 podStartE2EDuration="36.819358227s" totalImagesPullingTime="3.1070074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:30.818742832 +0000 UTC m=+71.063571412" watchObservedRunningTime="2026-09-09 20:33:30.819358227 +0000 UTC m=+71.064186807"
Sep 09 20:33:30.839924 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:30.839871    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6ff78776b6-sf6fh" podStartSLOduration=32.839851042 podStartE2EDuration="32.839851042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:30.838687565 +0000 UTC m=+71.083516159" watchObservedRunningTime="2026-09-09 20:33:30.839851042 +0000 UTC m=+71.084679623"
Sep 09 20:33:31.222691 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:31.222661    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:31.225327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:31.225300    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:31.780396 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:31.780320    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:31.781606 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:31.781580    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6ff78776b6-sf6fh"
Sep 09 20:33:33.793982 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:33.793950    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz" event={"ID":"b5e47679-aac4-4d6c-86dc-f0aa8470a620","Type":"ContainerStarted","Data":"277f8615a4bedb0313a38bbffed387b1daa561859841c7a772ad30afeeb8a23b"}
Sep 09 20:33:33.795911 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:33.795880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx" event={"ID":"79f0c4c7-b059-414c-83ea-6ce364f4efef","Type":"ContainerStarted","Data":"a38d2511f7a0619a984cf7f458bd06ecd32f3ee429971a2feac34b9db1e396dd"}
Sep 09 20:33:33.796080 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:33.795945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx" event={"ID":"79f0c4c7-b059-414c-83ea-6ce364f4efef","Type":"ContainerStarted","Data":"4d93462c15828371213c9530bb7b764e93750eb5494188964b7254e276b501cf"}
Sep 09 20:33:33.797520 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:33.797496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm" event={"ID":"b916b4e7-efa8-4bdf-80f8-b55053d694f1","Type":"ContainerStarted","Data":"b76556263ad9c0a3a745b086ff5ec6e8b95907e80da4147ec4bd3f192eb0b6d3"}
Sep 09 20:33:33.809576 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:33.809535    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-5lwhz" podStartSLOduration=34.335556078 podStartE2EDuration="36.809523117s" totalImagesPullingTime="2.473967039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:33.809028367 +0000 UTC m=+74.053856948" watchObservedRunningTime="2026-09-09 20:33:33.809523117 +0000 UTC m=+74.054351696"
Sep 09 20:33:33.824192 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:33.824152    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v47sx" podStartSLOduration=33.580057918 podStartE2EDuration="35.824139925s" totalImagesPullingTime="2.244082007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:33.823364554 +0000 UTC m=+74.068193135" watchObservedRunningTime="2026-09-09 20:33:33.824139925 +0000 UTC m=+74.068968501"
Sep 09 20:33:33.837001 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:33.836962    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-m8xnm" podStartSLOduration=33.556388731 podStartE2EDuration="35.836950673s" totalImagesPullingTime="2.280561942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:33.836687485 +0000 UTC m=+74.081516067" watchObservedRunningTime="2026-09-09 20:33:33.836950673 +0000 UTC m=+74.081779263"
Sep 09 20:33:38.732148 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:38.732113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:38.734288 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:38.734266    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7cd53f81-f651-4934-9948-017af2f70ec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twshm\" (UID: \"7cd53f81-f651-4934-9948-017af2f70ec8\") " pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:38.926517 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:38.926486    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ng47s\""
Sep 09 20:33:38.935324 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:38.935307    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-twshm"
Sep 09 20:33:39.235962 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:39.235932    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-twshm"]
Sep 09 20:33:39.238518 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:39.238489    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd53f81_f651_4934_9948_017af2f70ec8.slice/crio-28a66f0ecab118d2f1388228b3b1cc25df0e7a4fae99d442f6e7b2e13a0bb299 WatchSource:0}: Error finding container 28a66f0ecab118d2f1388228b3b1cc25df0e7a4fae99d442f6e7b2e13a0bb299: Status 404 returned error can't find the container with id 28a66f0ecab118d2f1388228b3b1cc25df0e7a4fae99d442f6e7b2e13a0bb299
Sep 09 20:33:39.820170 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:39.820135    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-twshm" event={"ID":"7cd53f81-f651-4934-9948-017af2f70ec8","Type":"ContainerStarted","Data":"ff7182d968cdef77c6cf5bdb5baa083ecb06face069807682095a11dc71c8bcf"}
Sep 09 20:33:39.820518 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:39.820191    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-twshm" event={"ID":"7cd53f81-f651-4934-9948-017af2f70ec8","Type":"ContainerStarted","Data":"28a66f0ecab118d2f1388228b3b1cc25df0e7a4fae99d442f6e7b2e13a0bb299"}
Sep 09 20:33:40.279185 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:40.279167    2576 scope.go:117] "RemoveContainer" containerID="ef2e354746bbd2679398dd0ceba779ee329e872ae3b618dda37251553880fc7e"
Sep 09 20:33:40.279371 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:40.279349    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-89qb9_openshift-console-operator(14dfc402-d1ec-4e2a-8b92-97cbea8ff336)\"" pod="openshift-console-operator/console-operator-85b454874b-89qb9" podUID="14dfc402-d1ec-4e2a-8b92-97cbea8ff336"
Sep 09 20:33:40.782323 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:40.782290    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qx7w6"
Sep 09 20:33:40.825666 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:40.825634    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-twshm" event={"ID":"7cd53f81-f651-4934-9948-017af2f70ec8","Type":"ContainerStarted","Data":"06155636d9f33de742a112ecea92528f8a6593ee1274a3b550bf59c056a746a4"}
Sep 09 20:33:41.863859 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.863830    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cdgsf"]
Sep 09 20:33:41.866184 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.866154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:41.868212 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.868180    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 20:33:41.868212 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.868201    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 20:33:41.868948 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.868927    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 20:33:41.869040 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.868997    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-97pg4\""
Sep 09 20:33:41.869125 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.869075    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 20:33:41.956451 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.956414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecb9ea66-639e-48ba-8eca-15c1f2912768-metrics-client-ca\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:41.956591 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.956525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-tls\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:41.956591 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.956579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsz6q\" (UniqueName: \"kubernetes.io/projected/ecb9ea66-639e-48ba-8eca-15c1f2912768-kube-api-access-gsz6q\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:41.956704 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.956636    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ecb9ea66-639e-48ba-8eca-15c1f2912768-root\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:41.956704 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.956669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-accelerators-collector-config\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:41.956814 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.956703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-textfile\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:41.956814 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.956743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:41.956814 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.956778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecb9ea66-639e-48ba-8eca-15c1f2912768-sys\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:41.956814 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:41.956796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-wtmp\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.057417 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecb9ea66-639e-48ba-8eca-15c1f2912768-sys\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.057581 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-wtmp\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.057581 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecb9ea66-639e-48ba-8eca-15c1f2912768-metrics-client-ca\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.057581 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057511    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecb9ea66-639e-48ba-8eca-15c1f2912768-sys\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.057581 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-tls\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.057785 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsz6q\" (UniqueName: \"kubernetes.io/projected/ecb9ea66-639e-48ba-8eca-15c1f2912768-kube-api-access-gsz6q\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.057785 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ecb9ea66-639e-48ba-8eca-15c1f2912768-root\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.057785 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-accelerators-collector-config\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.057785 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057643    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-wtmp\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.057785 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-textfile\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.057785 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057761    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ecb9ea66-639e-48ba-8eca-15c1f2912768-root\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.058043 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.057796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.058358 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.058309    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-textfile\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.058592 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.058564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-accelerators-collector-config\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.058679 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.058618    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecb9ea66-639e-48ba-8eca-15c1f2912768-metrics-client-ca\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.060529 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.060486    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.060777 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.060751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ecb9ea66-639e-48ba-8eca-15c1f2912768-node-exporter-tls\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.066495 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.066470    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsz6q\" (UniqueName: \"kubernetes.io/projected/ecb9ea66-639e-48ba-8eca-15c1f2912768-kube-api-access-gsz6q\") pod \"node-exporter-cdgsf\" (UID: \"ecb9ea66-639e-48ba-8eca-15c1f2912768\") " pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.175852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.175782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cdgsf"
Sep 09 20:33:42.187024 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:42.186998    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb9ea66_639e_48ba_8eca_15c1f2912768.slice/crio-bf0fac7a062f01dabdf72e8fcdba0a53861b190cef4322ed66c588e2b1ebfcb5 WatchSource:0}: Error finding container bf0fac7a062f01dabdf72e8fcdba0a53861b190cef4322ed66c588e2b1ebfcb5: Status 404 returned error can't find the container with id bf0fac7a062f01dabdf72e8fcdba0a53861b190cef4322ed66c588e2b1ebfcb5
Sep 09 20:33:42.836421 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.836274    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdgsf" event={"ID":"ecb9ea66-639e-48ba-8eca-15c1f2912768","Type":"ContainerStarted","Data":"bf0fac7a062f01dabdf72e8fcdba0a53861b190cef4322ed66c588e2b1ebfcb5"}
Sep 09 20:33:42.838820 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.838792    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-twshm" event={"ID":"7cd53f81-f651-4934-9948-017af2f70ec8","Type":"ContainerStarted","Data":"cb0f034aaf53b9a30b89db3daac68432346f71c04d56764c564b5a6fe8ea0e2b"}
Sep 09 20:33:42.857196 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:42.856480    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-twshm" podStartSLOduration=34.070103638 podStartE2EDuration="36.856461681s" totalImagesPullingTime="2.786358043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:33:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:42.855839749 +0000 UTC m=+83.100668354" watchObservedRunningTime="2026-09-09 20:33:42.856461681 +0000 UTC m=+83.101290261"
Sep 09 20:33:43.843860 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:43.843829    2576 generic.go:356] "Generic (PLEG): container finished" podID="ecb9ea66-639e-48ba-8eca-15c1f2912768" containerID="eb998941f15fcf43c8475081a088e504dda98a36d732dc723841e52b9cf8a37b" exitCode=0
Sep 09 20:33:43.844245 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:43.843915    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdgsf" event={"ID":"ecb9ea66-639e-48ba-8eca-15c1f2912768","Type":"ContainerDied","Data":"eb998941f15fcf43c8475081a088e504dda98a36d732dc723841e52b9cf8a37b"}
Sep 09 20:33:44.849803 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:44.849768    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdgsf" event={"ID":"ecb9ea66-639e-48ba-8eca-15c1f2912768","Type":"ContainerStarted","Data":"941bd0b5896de62adb7dc9730b128aed704d1826602aeb1366f30e7a22e73d0c"}
Sep 09 20:33:44.850295 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:44.849815    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdgsf" event={"ID":"ecb9ea66-639e-48ba-8eca-15c1f2912768","Type":"ContainerStarted","Data":"279e796bec6a559193a7eabe9e17dcfbff189d2fe01b23fedf084f89af183249"}
Sep 09 20:33:44.868541 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:44.868497    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cdgsf" podStartSLOduration=2.73272785 podStartE2EDuration="3.868484023s" totalImagesPullingTime="1.074564909s" totalInitContainerRuntime="61.191264ms" isStatefulPod=true podCreationTimestamp="2026-09-09 20:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:44.866820791 +0000 UTC m=+85.111649371" watchObservedRunningTime="2026-09-09 20:33:44.868484023 +0000 UTC m=+85.113312625"
Sep 09 20:33:50.773980 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:50.773952    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:33:53.278218 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:53.278190    2576 scope.go:117] "RemoveContainer" containerID="ef2e354746bbd2679398dd0ceba779ee329e872ae3b618dda37251553880fc7e"
Sep 09 20:33:53.884167 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:53.884136    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:33:53.884358 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:53.884217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-89qb9" event={"ID":"14dfc402-d1ec-4e2a-8b92-97cbea8ff336","Type":"ContainerStarted","Data":"6a2be8939b534c7c1ea7aaba8a1ea6c65d3023226f8975561da5eb4bd06e8cca"}
Sep 09 20:33:53.884572 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:53.884552    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:33:53.901011 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:53.900965    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-89qb9" podStartSLOduration=49.642722042 podStartE2EDuration="55.90095194s" totalImagesPullingTime="6.258229898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:33:53.900299435 +0000 UTC m=+94.145128018" watchObservedRunningTime="2026-09-09 20:33:53.90095194 +0000 UTC m=+94.145780519"
Sep 09 20:33:53.936114 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:53.936078    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-89qb9"
Sep 09 20:33:54.120468 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.120438    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-llmk7"]
Sep 09 20:33:54.122569 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.122548    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-llmk7"
Sep 09 20:33:54.124752 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.124731    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 20:33:54.124844 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.124799    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-284ml\""
Sep 09 20:33:54.124906 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.124883    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 20:33:54.133777 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.133757    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-llmk7"]
Sep 09 20:33:54.249237 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.249162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lllc\" (UniqueName: \"kubernetes.io/projected/16b76a60-dab3-45f4-a4f7-87989e648825-kube-api-access-4lllc\") pod \"downloads-85d98c998f-llmk7\" (UID: \"16b76a60-dab3-45f4-a4f7-87989e648825\") " pod="openshift-console/downloads-85d98c998f-llmk7"
Sep 09 20:33:54.350305 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.350279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lllc\" (UniqueName: \"kubernetes.io/projected/16b76a60-dab3-45f4-a4f7-87989e648825-kube-api-access-4lllc\") pod \"downloads-85d98c998f-llmk7\" (UID: \"16b76a60-dab3-45f4-a4f7-87989e648825\") " pod="openshift-console/downloads-85d98c998f-llmk7"
Sep 09 20:33:54.357786 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.357759    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lllc\" (UniqueName: \"kubernetes.io/projected/16b76a60-dab3-45f4-a4f7-87989e648825-kube-api-access-4lllc\") pod \"downloads-85d98c998f-llmk7\" (UID: \"16b76a60-dab3-45f4-a4f7-87989e648825\") " pod="openshift-console/downloads-85d98c998f-llmk7"
Sep 09 20:33:54.431388 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.431358    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-llmk7"
Sep 09 20:33:54.701085 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.701035    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-llmk7"]
Sep 09 20:33:54.703894 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:33:54.703866    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b76a60_dab3_45f4_a4f7_87989e648825.slice/crio-557765015d1be5cc217d34a8f7c72a7d15a2de61a87def79ccda474a02d7c350 WatchSource:0}: Error finding container 557765015d1be5cc217d34a8f7c72a7d15a2de61a87def79ccda474a02d7c350: Status 404 returned error can't find the container with id 557765015d1be5cc217d34a8f7c72a7d15a2de61a87def79ccda474a02d7c350
Sep 09 20:33:54.888913 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:54.888877    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-llmk7" event={"ID":"16b76a60-dab3-45f4-a4f7-87989e648825","Type":"ContainerStarted","Data":"557765015d1be5cc217d34a8f7c72a7d15a2de61a87def79ccda474a02d7c350"}
Sep 09 20:33:55.789670 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:55.789630    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj" podUID="53b83a06-1bed-4dc8-a5da-3efdeae42457" containerName="registry" containerID="cri-o://344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac" gracePeriod=30
Sep 09 20:33:56.047682 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.047625    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:33:56.165479 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.165447    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-bound-sa-token\") pod \"53b83a06-1bed-4dc8-a5da-3efdeae42457\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") "
Sep 09 20:33:56.165651 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.165545    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-certificates\") pod \"53b83a06-1bed-4dc8-a5da-3efdeae42457\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") "
Sep 09 20:33:56.165651 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.165580    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6bhk\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-kube-api-access-j6bhk\") pod \"53b83a06-1bed-4dc8-a5da-3efdeae42457\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") "
Sep 09 20:33:56.165773 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.165760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-image-registry-private-configuration\") pod \"53b83a06-1bed-4dc8-a5da-3efdeae42457\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") "
Sep 09 20:33:56.165835 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.165797    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-installation-pull-secrets\") pod \"53b83a06-1bed-4dc8-a5da-3efdeae42457\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") "
Sep 09 20:33:56.165906 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.165886    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-trusted-ca\") pod \"53b83a06-1bed-4dc8-a5da-3efdeae42457\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") "
Sep 09 20:33:56.165960 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.165916    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53b83a06-1bed-4dc8-a5da-3efdeae42457-ca-trust-extracted\") pod \"53b83a06-1bed-4dc8-a5da-3efdeae42457\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") "
Sep 09 20:33:56.165960 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.165949    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls\") pod \"53b83a06-1bed-4dc8-a5da-3efdeae42457\" (UID: \"53b83a06-1bed-4dc8-a5da-3efdeae42457\") "
Sep 09 20:33:56.166394 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.166213    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "53b83a06-1bed-4dc8-a5da-3efdeae42457" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:33:56.166394 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.166361    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-certificates\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:33:56.166579 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.166508    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "53b83a06-1bed-4dc8-a5da-3efdeae42457" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:33:56.174883 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.174428    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-kube-api-access-j6bhk" (OuterVolumeSpecName: "kube-api-access-j6bhk") pod "53b83a06-1bed-4dc8-a5da-3efdeae42457" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457"). InnerVolumeSpecName "kube-api-access-j6bhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:33:56.174883 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.174526    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "53b83a06-1bed-4dc8-a5da-3efdeae42457" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:33:56.174883 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.174692    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "53b83a06-1bed-4dc8-a5da-3efdeae42457" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:33:56.175550 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.174936    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "53b83a06-1bed-4dc8-a5da-3efdeae42457" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:33:56.175550 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.175333    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "53b83a06-1bed-4dc8-a5da-3efdeae42457" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:33:56.179034 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.179006    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53b83a06-1bed-4dc8-a5da-3efdeae42457-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "53b83a06-1bed-4dc8-a5da-3efdeae42457" (UID: "53b83a06-1bed-4dc8-a5da-3efdeae42457"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:33:56.267709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.267676    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6bhk\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-kube-api-access-j6bhk\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:33:56.267838 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.267714    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-image-registry-private-configuration\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:33:56.267838 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.267729    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53b83a06-1bed-4dc8-a5da-3efdeae42457-installation-pull-secrets\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:33:56.267838 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.267743    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53b83a06-1bed-4dc8-a5da-3efdeae42457-trusted-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:33:56.267838 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.267759    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53b83a06-1bed-4dc8-a5da-3efdeae42457-ca-trust-extracted\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:33:56.267838 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.267798    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-registry-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:33:56.267838 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.267810    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53b83a06-1bed-4dc8-a5da-3efdeae42457-bound-sa-token\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:33:56.745376 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.745344    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2hstv"
Sep 09 20:33:56.900368 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.900328    2576 generic.go:356] "Generic (PLEG): container finished" podID="53b83a06-1bed-4dc8-a5da-3efdeae42457" containerID="344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac" exitCode=0
Sep 09 20:33:56.900795 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.900419    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj"
Sep 09 20:33:56.900795 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.900410    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj" event={"ID":"53b83a06-1bed-4dc8-a5da-3efdeae42457","Type":"ContainerDied","Data":"344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac"}
Sep 09 20:33:56.900795 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.900547    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b497ff687-sxxqj" event={"ID":"53b83a06-1bed-4dc8-a5da-3efdeae42457","Type":"ContainerDied","Data":"25fb97545619a792d2a1297bcf7f87919522c2b4be3b988a5cc07beb0dd9ba87"}
Sep 09 20:33:56.900795 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.900574    2576 scope.go:117] "RemoveContainer" containerID="344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac"
Sep 09 20:33:56.910270 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.910239    2576 scope.go:117] "RemoveContainer" containerID="344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac"
Sep 09 20:33:56.910581 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:33:56.910559    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac\": container with ID starting with 344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac not found: ID does not exist" containerID="344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac"
Sep 09 20:33:56.910680 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.910589    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac"} err="failed to get container status \"344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac\": rpc error: code = NotFound desc = could not find container \"344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac\": container with ID starting with 344313960c0fd2bd1e5282221a05510fcd17af5bb512bc5bb0e00602757ec9ac not found: ID does not exist"
Sep 09 20:33:56.920494 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.920458    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b497ff687-sxxqj"]
Sep 09 20:33:56.922230 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:56.922210    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b497ff687-sxxqj"]
Sep 09 20:33:58.284105 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:33:58.284066    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53b83a06-1bed-4dc8-a5da-3efdeae42457" path="/var/lib/kubelet/pods/53b83a06-1bed-4dc8-a5da-3efdeae42457/volumes"
Sep 09 20:34:05.604195 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.604145    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bcd59b896-fbwx4"]
Sep 09 20:34:05.604656 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.604496    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b83a06-1bed-4dc8-a5da-3efdeae42457" containerName="registry"
Sep 09 20:34:05.604656 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.604509    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b83a06-1bed-4dc8-a5da-3efdeae42457" containerName="registry"
Sep 09 20:34:05.604656 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.604567    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b83a06-1bed-4dc8-a5da-3efdeae42457" containerName="registry"
Sep 09 20:34:05.626184 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.626127    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcd59b896-fbwx4"]
Sep 09 20:34:05.626322 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.626242    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.630553 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.630530    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 20:34:05.630684 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.630563    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 20:34:05.631311 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.631290    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-c4mgv\""
Sep 09 20:34:05.631311 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.631308    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 20:34:05.631496 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.631452    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 20:34:05.642612 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.642590    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 20:34:05.650478 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.650451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-config\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.650583 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.650494    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2pzs\" (UniqueName: \"kubernetes.io/projected/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-kube-api-access-x2pzs\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.650583 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.650529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-oauth-config\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.650687 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.650586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-oauth-serving-cert\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.650687 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.650633    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-serving-cert\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.650687 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.650658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-service-ca\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.752018 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.751979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2pzs\" (UniqueName: \"kubernetes.io/projected/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-kube-api-access-x2pzs\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.752221 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.752032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-oauth-config\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.752221 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.752087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-oauth-serving-cert\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.752221 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.752127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-serving-cert\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.752221 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.752145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-service-ca\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.752221 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.752193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-config\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.752962 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.752922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-oauth-serving-cert\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.753100 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.752975    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-config\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.753100 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.752985    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-service-ca\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.754820 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.754802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-oauth-config\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.754965 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.754947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-serving-cert\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.759778 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.759750    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2pzs\" (UniqueName: \"kubernetes.io/projected/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-kube-api-access-x2pzs\") pod \"console-7bcd59b896-fbwx4\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") " pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:05.937642 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:05.937567    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:10.677394 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:10.677322    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcd59b896-fbwx4"]
Sep 09 20:34:10.681095 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:34:10.681045    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc576ae5f_ec5f_4f48_a9df_45671f6efb0c.slice/crio-52ebfbc75a15d5ce27de0cd50ac6223f540477d326c039f9f476f3f19efc4835 WatchSource:0}: Error finding container 52ebfbc75a15d5ce27de0cd50ac6223f540477d326c039f9f476f3f19efc4835: Status 404 returned error can't find the container with id 52ebfbc75a15d5ce27de0cd50ac6223f540477d326c039f9f476f3f19efc4835
Sep 09 20:34:10.971908 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:10.971823    2576 generic.go:356] "Generic (PLEG): container finished" podID="12779b83-c860-4919-8ec3-b4182eae8455" containerID="7b2bbfeab1fbc31cb66623c57382216e3f5a2df000b75798c9cc21698545dd89" exitCode=0
Sep 09 20:34:10.972107 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:10.971916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n" event={"ID":"12779b83-c860-4919-8ec3-b4182eae8455","Type":"ContainerDied","Data":"7b2bbfeab1fbc31cb66623c57382216e3f5a2df000b75798c9cc21698545dd89"}
Sep 09 20:34:10.972387 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:10.972363    2576 scope.go:117] "RemoveContainer" containerID="7b2bbfeab1fbc31cb66623c57382216e3f5a2df000b75798c9cc21698545dd89"
Sep 09 20:34:10.973629 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:10.973601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcd59b896-fbwx4" event={"ID":"c576ae5f-ec5f-4f48-a9df-45671f6efb0c","Type":"ContainerStarted","Data":"52ebfbc75a15d5ce27de0cd50ac6223f540477d326c039f9f476f3f19efc4835"}
Sep 09 20:34:10.975588 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:10.975567    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-llmk7" event={"ID":"16b76a60-dab3-45f4-a4f7-87989e648825","Type":"ContainerStarted","Data":"0993cef11e3e299a5e7db3a4d1094d56290b07d1804a5146deefd25ddaa35f7c"}
Sep 09 20:34:10.975814 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:10.975795    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-llmk7"
Sep 09 20:34:10.982455 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:10.982426    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-llmk7"
Sep 09 20:34:11.011797 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:11.011619    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-llmk7" podStartSLOduration=1.217221089 podStartE2EDuration="17.011598171s" totalImagesPullingTime="15.794377082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:34:11.009888306 +0000 UTC m=+111.254716887" watchObservedRunningTime="2026-09-09 20:34:11.011598171 +0000 UTC m=+111.256426753"
Sep 09 20:34:11.810130 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:11.810042    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6ff78776b6-sf6fh_07ac87e1-029c-4b8d-a3bf-d6824fc996b1/router/0.log"
Sep 09 20:34:11.833915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:11.833826    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wrk8d_c71a4735-d550-4196-9076-3649aab7c6c8/serve-healthcheck-canary/0.log"
Sep 09 20:34:11.984694 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:11.984652    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-m6s8n" event={"ID":"12779b83-c860-4919-8ec3-b4182eae8455","Type":"ContainerStarted","Data":"e85f0f1396910c6b5730732700d8b7bb39191fd97a0b72ec2fcfcba18ccba08e"}
Sep 09 20:34:15.000464 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.000426    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcd59b896-fbwx4" event={"ID":"c576ae5f-ec5f-4f48-a9df-45671f6efb0c","Type":"ContainerStarted","Data":"7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0"}
Sep 09 20:34:15.018123 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.018046    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bcd59b896-fbwx4" podStartSLOduration=5.893990892 podStartE2EDuration="10.018025437s" totalImagesPullingTime="4.124034545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:34:15.01746104 +0000 UTC m=+115.262289622" watchObservedRunningTime="2026-09-09 20:34:15.018025437 +0000 UTC m=+115.262854019"
Sep 09 20:34:15.425774 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.425737    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc875c4db-dkdvz"]
Sep 09 20:34:15.447838 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.447810    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc875c4db-dkdvz"]
Sep 09 20:34:15.448000 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.447908    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.455968 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.455940    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 20:34:15.540104 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.540063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-service-ca\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.540283 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.540123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-trusted-ca-bundle\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.540283 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.540154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq9rb\" (UniqueName: \"kubernetes.io/projected/0e6029df-2c3a-4aad-b320-cf420a2be35f-kube-api-access-fq9rb\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.540283 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.540224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-oauth-config\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.540283 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.540274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-config\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.540464 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.540310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-serving-cert\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.540464 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.540334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-oauth-serving-cert\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.641584 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.641545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-oauth-config\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.641757 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.641602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-config\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.641757 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.641642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-serving-cert\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.641757 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.641665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-oauth-serving-cert\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.641757 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.641705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-service-ca\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.641757 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.641753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-trusted-ca-bundle\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.642009 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.641781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9rb\" (UniqueName: \"kubernetes.io/projected/0e6029df-2c3a-4aad-b320-cf420a2be35f-kube-api-access-fq9rb\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.642599 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.642568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-oauth-serving-cert\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.642721 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.642604    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-service-ca\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.642965 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.642940    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-trusted-ca-bundle\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.643286 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.643256    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-config\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.644587 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.644564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-serving-cert\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.644674 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.644608    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-oauth-config\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.649753 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.649726    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq9rb\" (UniqueName: \"kubernetes.io/projected/0e6029df-2c3a-4aad-b320-cf420a2be35f-kube-api-access-fq9rb\") pod \"console-fc875c4db-dkdvz\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") " pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.759777 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.759704    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:15.938257 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.938226    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:15.938407 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.938320    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:15.943773 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:15.943744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:16.009521 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:16.009492    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:16.066494 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:16.065229    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc875c4db-dkdvz"]
Sep 09 20:34:16.081307 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:34:16.081278    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6029df_2c3a_4aad_b320_cf420a2be35f.slice/crio-7bfae0af021f4356bbdabfdc89ff72b4844a06c645c3aa3ee0c323e800f86ed6 WatchSource:0}: Error finding container 7bfae0af021f4356bbdabfdc89ff72b4844a06c645c3aa3ee0c323e800f86ed6: Status 404 returned error can't find the container with id 7bfae0af021f4356bbdabfdc89ff72b4844a06c645c3aa3ee0c323e800f86ed6
Sep 09 20:34:17.011094 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:17.011040    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc875c4db-dkdvz" event={"ID":"0e6029df-2c3a-4aad-b320-cf420a2be35f","Type":"ContainerStarted","Data":"b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195"}
Sep 09 20:34:17.011658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:17.011116    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc875c4db-dkdvz" event={"ID":"0e6029df-2c3a-4aad-b320-cf420a2be35f","Type":"ContainerStarted","Data":"7bfae0af021f4356bbdabfdc89ff72b4844a06c645c3aa3ee0c323e800f86ed6"}
Sep 09 20:34:17.012844 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:17.012818    2576 generic.go:356] "Generic (PLEG): container finished" podID="e372e750-ab89-4af3-abce-7451c51194d3" containerID="735359940ee58bca0c3e324bd490660c3d48e6b995fc50be9b4e9da6bdc6ed62" exitCode=0
Sep 09 20:34:17.012956 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:17.012895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft" event={"ID":"e372e750-ab89-4af3-abce-7451c51194d3","Type":"ContainerDied","Data":"735359940ee58bca0c3e324bd490660c3d48e6b995fc50be9b4e9da6bdc6ed62"}
Sep 09 20:34:17.013400 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:17.013379    2576 scope.go:117] "RemoveContainer" containerID="735359940ee58bca0c3e324bd490660c3d48e6b995fc50be9b4e9da6bdc6ed62"
Sep 09 20:34:17.033959 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:17.033909    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fc875c4db-dkdvz" podStartSLOduration=2.033891186 podStartE2EDuration="2.033891186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:34:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:34:17.031805101 +0000 UTC m=+117.276633684" watchObservedRunningTime="2026-09-09 20:34:17.033891186 +0000 UTC m=+117.278719765"
Sep 09 20:34:18.019834 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:18.019790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-s79ft" event={"ID":"e372e750-ab89-4af3-abce-7451c51194d3","Type":"ContainerStarted","Data":"5a6047ac79098256463bafef98563e7a0095a3503fbd6b9c2fd99642c2a95dad"}
Sep 09 20:34:25.760232 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:25.760193    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:25.760693 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:25.760443    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:25.765135 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:25.765113    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:26.063789 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:26.063762    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:34:26.106513 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:26.106475    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcd59b896-fbwx4"]
Sep 09 20:34:37.105177 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:37.105141    2576 generic.go:356] "Generic (PLEG): container finished" podID="083804f0-418b-45c5-bb6b-e04e132459f0" containerID="9d458f0c20cb0f01847b6d91f935669061a752137796e81402af05fbec60ae21" exitCode=0
Sep 09 20:34:37.105522 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:37.105207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87" event={"ID":"083804f0-418b-45c5-bb6b-e04e132459f0","Type":"ContainerDied","Data":"9d458f0c20cb0f01847b6d91f935669061a752137796e81402af05fbec60ae21"}
Sep 09 20:34:37.105522 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:37.105510    2576 scope.go:117] "RemoveContainer" containerID="9d458f0c20cb0f01847b6d91f935669061a752137796e81402af05fbec60ae21"
Sep 09 20:34:38.110360 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:38.110322    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-s8d87" event={"ID":"083804f0-418b-45c5-bb6b-e04e132459f0","Type":"ContainerStarted","Data":"f4d6d4eff909438ba8442bc2261bf2d7149f5667e0b9f6e8170b96131c3c8684"}
Sep 09 20:34:51.128949 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.128906    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bcd59b896-fbwx4" podUID="c576ae5f-ec5f-4f48-a9df-45671f6efb0c" containerName="console" containerID="cri-o://7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0" gracePeriod=15
Sep 09 20:34:51.396040 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.395986    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:51.434776 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.434743    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-serving-cert\") pod \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") "
Sep 09 20:34:51.434892 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.434789    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2pzs\" (UniqueName: \"kubernetes.io/projected/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-kube-api-access-x2pzs\") pod \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") "
Sep 09 20:34:51.434892 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.434807    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-oauth-serving-cert\") pod \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") "
Sep 09 20:34:51.434892 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.434845    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-service-ca\") pod \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") "
Sep 09 20:34:51.435044 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.434893    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-config\") pod \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") "
Sep 09 20:34:51.435044 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.434934    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-oauth-config\") pod \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\" (UID: \"c576ae5f-ec5f-4f48-a9df-45671f6efb0c\") "
Sep 09 20:34:51.435293 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.435267    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c576ae5f-ec5f-4f48-a9df-45671f6efb0c" (UID: "c576ae5f-ec5f-4f48-a9df-45671f6efb0c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:34:51.435355 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.435284    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-service-ca" (OuterVolumeSpecName: "service-ca") pod "c576ae5f-ec5f-4f48-a9df-45671f6efb0c" (UID: "c576ae5f-ec5f-4f48-a9df-45671f6efb0c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:34:51.435355 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.435287    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-config" (OuterVolumeSpecName: "console-config") pod "c576ae5f-ec5f-4f48-a9df-45671f6efb0c" (UID: "c576ae5f-ec5f-4f48-a9df-45671f6efb0c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:34:51.436924 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.436904    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-kube-api-access-x2pzs" (OuterVolumeSpecName: "kube-api-access-x2pzs") pod "c576ae5f-ec5f-4f48-a9df-45671f6efb0c" (UID: "c576ae5f-ec5f-4f48-a9df-45671f6efb0c"). InnerVolumeSpecName "kube-api-access-x2pzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:34:51.437312 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.437277    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c576ae5f-ec5f-4f48-a9df-45671f6efb0c" (UID: "c576ae5f-ec5f-4f48-a9df-45671f6efb0c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:34:51.437312 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.437289    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c576ae5f-ec5f-4f48-a9df-45671f6efb0c" (UID: "c576ae5f-ec5f-4f48-a9df-45671f6efb0c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:34:51.535854 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.535822    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2pzs\" (UniqueName: \"kubernetes.io/projected/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-kube-api-access-x2pzs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:34:51.535854 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.535847    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-oauth-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:34:51.535854 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.535856    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:34:51.536029 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.535867    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:34:51.536029 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.535875    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-oauth-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:34:51.536029 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:51.535883    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c576ae5f-ec5f-4f48-a9df-45671f6efb0c-console-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:34:52.165603 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:52.165564    2576 generic.go:356] "Generic (PLEG): container finished" podID="c576ae5f-ec5f-4f48-a9df-45671f6efb0c" containerID="7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0" exitCode=0
Sep 09 20:34:52.165978 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:52.165625    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcd59b896-fbwx4"
Sep 09 20:34:52.165978 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:52.165653    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcd59b896-fbwx4" event={"ID":"c576ae5f-ec5f-4f48-a9df-45671f6efb0c","Type":"ContainerDied","Data":"7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0"}
Sep 09 20:34:52.165978 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:52.165730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcd59b896-fbwx4" event={"ID":"c576ae5f-ec5f-4f48-a9df-45671f6efb0c","Type":"ContainerDied","Data":"52ebfbc75a15d5ce27de0cd50ac6223f540477d326c039f9f476f3f19efc4835"}
Sep 09 20:34:52.165978 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:52.165752    2576 scope.go:117] "RemoveContainer" containerID="7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0"
Sep 09 20:34:52.174452 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:52.174432    2576 scope.go:117] "RemoveContainer" containerID="7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0"
Sep 09 20:34:52.174695 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:34:52.174676    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0\": container with ID starting with 7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0 not found: ID does not exist" containerID="7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0"
Sep 09 20:34:52.174738 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:52.174703    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0"} err="failed to get container status \"7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0\": rpc error: code = NotFound desc = could not find container \"7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0\": container with ID starting with 7a32e936a03cb3a55483148dba40eaebb31e8dd3de09642966c8d0b66ccf68e0 not found: ID does not exist"
Sep 09 20:34:52.186063 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:52.186028    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcd59b896-fbwx4"]
Sep 09 20:34:52.191871 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:52.191851    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bcd59b896-fbwx4"]
Sep 09 20:34:52.283295 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:34:52.283266    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c576ae5f-ec5f-4f48-a9df-45671f6efb0c" path="/var/lib/kubelet/pods/c576ae5f-ec5f-4f48-a9df-45671f6efb0c/volumes"
Sep 09 20:35:06.147598 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.147564    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85497c9447-5vthh"]
Sep 09 20:35:06.148034 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.147940    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c576ae5f-ec5f-4f48-a9df-45671f6efb0c" containerName="console"
Sep 09 20:35:06.148034 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.147959    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c576ae5f-ec5f-4f48-a9df-45671f6efb0c" containerName="console"
Sep 09 20:35:06.148140 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.148065    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c576ae5f-ec5f-4f48-a9df-45671f6efb0c" containerName="console"
Sep 09 20:35:06.151097 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.151076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.153162 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.153140    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jfnvx\""
Sep 09 20:35:06.153292 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.153273    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 09 20:35:06.153357 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.153331    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 09 20:35:06.153457 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.153439    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 09 20:35:06.153518 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.153456    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 09 20:35:06.153518 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.153448    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 09 20:35:06.158508 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.158407    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 09 20:35:06.163490 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.163465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85497c9447-5vthh"]
Sep 09 20:35:06.232201 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.232179    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.232316 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.232219    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-secret-telemeter-client\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.232316 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.232243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-federate-client-tls\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.232389 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.232323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-metrics-client-ca\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.232389 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.232353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.232451 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.232393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-serving-certs-ca-bundle\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.232451 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.232420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5nd7\" (UniqueName: \"kubernetes.io/projected/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-kube-api-access-t5nd7\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.232451 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.232442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-telemeter-client-tls\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.333588 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.333565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-serving-certs-ca-bundle\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.333709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.333599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5nd7\" (UniqueName: \"kubernetes.io/projected/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-kube-api-access-t5nd7\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.333709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.333620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-telemeter-client-tls\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.333709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.333669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.333709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.333699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-secret-telemeter-client\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.333892 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.333719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-federate-client-tls\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.333931 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.333887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-metrics-client-ca\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.333978 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.333924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.334603 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.334578    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-serving-certs-ca-bundle\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.334707 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.334618    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-metrics-client-ca\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.334884 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.334860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.336344 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.336324    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-telemeter-client-tls\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.336522 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.336498    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.336607 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.336590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-secret-telemeter-client\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.336664 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.336598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-federate-client-tls\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.340743 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.340723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5nd7\" (UniqueName: \"kubernetes.io/projected/e20bcb22-c59f-46f4-adf0-05ada86eb1f7-kube-api-access-t5nd7\") pod \"telemeter-client-85497c9447-5vthh\" (UID: \"e20bcb22-c59f-46f4-adf0-05ada86eb1f7\") " pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.460685 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.460573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85497c9447-5vthh"
Sep 09 20:35:06.758682 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:06.758597    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85497c9447-5vthh"]
Sep 09 20:35:06.762975 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:35:06.762937    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20bcb22_c59f_46f4_adf0_05ada86eb1f7.slice/crio-ac37c8b8b7fa2d8ba0d6dfcf51658602c6c4997a3a6e56ec25343807ada3f0bf WatchSource:0}: Error finding container ac37c8b8b7fa2d8ba0d6dfcf51658602c6c4997a3a6e56ec25343807ada3f0bf: Status 404 returned error can't find the container with id ac37c8b8b7fa2d8ba0d6dfcf51658602c6c4997a3a6e56ec25343807ada3f0bf
Sep 09 20:35:07.224354 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:07.224317    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85497c9447-5vthh" event={"ID":"e20bcb22-c59f-46f4-adf0-05ada86eb1f7","Type":"ContainerStarted","Data":"ac37c8b8b7fa2d8ba0d6dfcf51658602c6c4997a3a6e56ec25343807ada3f0bf"}
Sep 09 20:35:09.235031 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:09.234997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85497c9447-5vthh" event={"ID":"e20bcb22-c59f-46f4-adf0-05ada86eb1f7","Type":"ContainerStarted","Data":"c7a7b80b5365eaef4352d4bef139623fe8a82db8c035da8cf8e91fa67dbef4ca"}
Sep 09 20:35:10.241480 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.241446    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85497c9447-5vthh" event={"ID":"e20bcb22-c59f-46f4-adf0-05ada86eb1f7","Type":"ContainerStarted","Data":"6e164d4f1c59a66e1997cdcf17d8a7012a2e652adcbcb86109da4fcf6c428415"}
Sep 09 20:35:10.241861 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.241503    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85497c9447-5vthh" event={"ID":"e20bcb22-c59f-46f4-adf0-05ada86eb1f7","Type":"ContainerStarted","Data":"b480a2d75d541a27bb4fdb05120e5c1126734b9119f903e7f37a2fb747675b25"}
Sep 09 20:35:10.266422 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.266371    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85497c9447-5vthh" podStartSLOduration=1.3950245620000001 podStartE2EDuration="4.266356099s" totalImagesPullingTime="2.871331537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:35:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:35:10.265039916 +0000 UTC m=+170.509868523" watchObservedRunningTime="2026-09-09 20:35:10.266356099 +0000 UTC m=+170.511184681"
Sep 09 20:35:10.351511 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.351473    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cf64bf54c-4xs2j"]
Sep 09 20:35:10.353827 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.353804    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.367354 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.367321    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cf64bf54c-4xs2j"]
Sep 09 20:35:10.474533 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.474491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-442dr\" (UniqueName: \"kubernetes.io/projected/40bed320-1ced-4379-919b-8fb1e81caf37-kube-api-access-442dr\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.474719 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.474540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-oauth-config\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.474719 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.474606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-trusted-ca-bundle\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.474719 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.474626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-oauth-serving-cert\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.474719 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.474691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-service-ca\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.474911 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.474755    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-console-config\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.474911 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.474793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-serving-cert\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.575334 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.575303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-442dr\" (UniqueName: \"kubernetes.io/projected/40bed320-1ced-4379-919b-8fb1e81caf37-kube-api-access-442dr\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.575498 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.575341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-oauth-config\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.575498 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.575367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-trusted-ca-bundle\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.575498 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.575390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-oauth-serving-cert\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.575657 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.575515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-service-ca\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.575657 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.575568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-console-config\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.575657 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.575600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-serving-cert\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.576165 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.576136    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-oauth-serving-cert\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.576344 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.576320    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-service-ca\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.576415 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.576348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-trusted-ca-bundle\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.576472 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.576376    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-console-config\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.577864 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.577836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-oauth-config\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.578007 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.577990    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-serving-cert\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.583153 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.583131    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-442dr\" (UniqueName: \"kubernetes.io/projected/40bed320-1ced-4379-919b-8fb1e81caf37-kube-api-access-442dr\") pod \"console-5cf64bf54c-4xs2j\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") " pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.664252 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.664232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:10.936045 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:10.935975    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cf64bf54c-4xs2j"]
Sep 09 20:35:10.939425 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:35:10.939400    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40bed320_1ced_4379_919b_8fb1e81caf37.slice/crio-d6de42f98e84b3a31d54dc7ead9ee76f623cf865fb1fc6453cd68a24fb1d7d88 WatchSource:0}: Error finding container d6de42f98e84b3a31d54dc7ead9ee76f623cf865fb1fc6453cd68a24fb1d7d88: Status 404 returned error can't find the container with id d6de42f98e84b3a31d54dc7ead9ee76f623cf865fb1fc6453cd68a24fb1d7d88
Sep 09 20:35:11.248947 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:11.248853    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf64bf54c-4xs2j" event={"ID":"40bed320-1ced-4379-919b-8fb1e81caf37","Type":"ContainerStarted","Data":"a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b"}
Sep 09 20:35:11.248947 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:11.248917    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf64bf54c-4xs2j" event={"ID":"40bed320-1ced-4379-919b-8fb1e81caf37","Type":"ContainerStarted","Data":"d6de42f98e84b3a31d54dc7ead9ee76f623cf865fb1fc6453cd68a24fb1d7d88"}
Sep 09 20:35:11.267610 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:11.267567    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cf64bf54c-4xs2j" podStartSLOduration=1.267552496 podStartE2EDuration="1.267552496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:35:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:35:11.266888994 +0000 UTC m=+171.511717576" watchObservedRunningTime="2026-09-09 20:35:11.267552496 +0000 UTC m=+171.512381075"
Sep 09 20:35:20.665250 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:20.665210    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:20.665648 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:20.665295    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:20.669990 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:20.669966    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:21.300081 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:21.300039    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:35:21.343976 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:21.343936    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc875c4db-dkdvz"]
Sep 09 20:35:46.371686 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.371648    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fc875c4db-dkdvz" podUID="0e6029df-2c3a-4aad-b320-cf420a2be35f" containerName="console" containerID="cri-o://b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195" gracePeriod=15
Sep 09 20:35:46.614636 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.614612    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:35:46.752774 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.752698    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq9rb\" (UniqueName: \"kubernetes.io/projected/0e6029df-2c3a-4aad-b320-cf420a2be35f-kube-api-access-fq9rb\") pod \"0e6029df-2c3a-4aad-b320-cf420a2be35f\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") "
Sep 09 20:35:46.752774 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.752737    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-oauth-serving-cert\") pod \"0e6029df-2c3a-4aad-b320-cf420a2be35f\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") "
Sep 09 20:35:46.752989 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.752788    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-trusted-ca-bundle\") pod \"0e6029df-2c3a-4aad-b320-cf420a2be35f\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") "
Sep 09 20:35:46.752989 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.752822    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-oauth-config\") pod \"0e6029df-2c3a-4aad-b320-cf420a2be35f\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") "
Sep 09 20:35:46.752989 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.752851    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-service-ca\") pod \"0e6029df-2c3a-4aad-b320-cf420a2be35f\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") "
Sep 09 20:35:46.752989 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.752894    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-config\") pod \"0e6029df-2c3a-4aad-b320-cf420a2be35f\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") "
Sep 09 20:35:46.752989 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.752916    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-serving-cert\") pod \"0e6029df-2c3a-4aad-b320-cf420a2be35f\" (UID: \"0e6029df-2c3a-4aad-b320-cf420a2be35f\") "
Sep 09 20:35:46.753313 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.753283    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0e6029df-2c3a-4aad-b320-cf420a2be35f" (UID: "0e6029df-2c3a-4aad-b320-cf420a2be35f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:35:46.753388 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.753322    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0e6029df-2c3a-4aad-b320-cf420a2be35f" (UID: "0e6029df-2c3a-4aad-b320-cf420a2be35f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:35:46.753388 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.753339    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-config" (OuterVolumeSpecName: "console-config") pod "0e6029df-2c3a-4aad-b320-cf420a2be35f" (UID: "0e6029df-2c3a-4aad-b320-cf420a2be35f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:35:46.753388 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.753328    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-service-ca" (OuterVolumeSpecName: "service-ca") pod "0e6029df-2c3a-4aad-b320-cf420a2be35f" (UID: "0e6029df-2c3a-4aad-b320-cf420a2be35f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:35:46.754901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.754873    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6029df-2c3a-4aad-b320-cf420a2be35f-kube-api-access-fq9rb" (OuterVolumeSpecName: "kube-api-access-fq9rb") pod "0e6029df-2c3a-4aad-b320-cf420a2be35f" (UID: "0e6029df-2c3a-4aad-b320-cf420a2be35f"). InnerVolumeSpecName "kube-api-access-fq9rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:35:46.754998 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.754921    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0e6029df-2c3a-4aad-b320-cf420a2be35f" (UID: "0e6029df-2c3a-4aad-b320-cf420a2be35f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:35:46.754998 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.754942    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0e6029df-2c3a-4aad-b320-cf420a2be35f" (UID: "0e6029df-2c3a-4aad-b320-cf420a2be35f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:35:46.854082 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.854040    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:35:46.854082 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.854079    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:35:46.854242 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.854094    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq9rb\" (UniqueName: \"kubernetes.io/projected/0e6029df-2c3a-4aad-b320-cf420a2be35f-kube-api-access-fq9rb\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:35:46.854242 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.854106    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-oauth-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:35:46.854242 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.854119    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-trusted-ca-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:35:46.854242 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.854133    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e6029df-2c3a-4aad-b320-cf420a2be35f-console-oauth-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:35:46.854242 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:46.854145    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e6029df-2c3a-4aad-b320-cf420a2be35f-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:35:47.392966 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:47.392922    2576 generic.go:356] "Generic (PLEG): container finished" podID="0e6029df-2c3a-4aad-b320-cf420a2be35f" containerID="b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195" exitCode=0
Sep 09 20:35:47.392966 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:47.392968    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc875c4db-dkdvz"
Sep 09 20:35:47.393465 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:47.393007    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc875c4db-dkdvz" event={"ID":"0e6029df-2c3a-4aad-b320-cf420a2be35f","Type":"ContainerDied","Data":"b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195"}
Sep 09 20:35:47.393465 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:47.393079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc875c4db-dkdvz" event={"ID":"0e6029df-2c3a-4aad-b320-cf420a2be35f","Type":"ContainerDied","Data":"7bfae0af021f4356bbdabfdc89ff72b4844a06c645c3aa3ee0c323e800f86ed6"}
Sep 09 20:35:47.393465 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:47.393101    2576 scope.go:117] "RemoveContainer" containerID="b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195"
Sep 09 20:35:47.401983 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:47.401966    2576 scope.go:117] "RemoveContainer" containerID="b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195"
Sep 09 20:35:47.402311 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:35:47.402284    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195\": container with ID starting with b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195 not found: ID does not exist" containerID="b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195"
Sep 09 20:35:47.402409 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:47.402315    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195"} err="failed to get container status \"b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195\": rpc error: code = NotFound desc = could not find container \"b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195\": container with ID starting with b5f4005416fa490633daa6552fe4f8df3ec56f374997cfc82d7c05bcf9970195 not found: ID does not exist"
Sep 09 20:35:47.413375 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:47.413356    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc875c4db-dkdvz"]
Sep 09 20:35:47.417343 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:47.417321    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fc875c4db-dkdvz"]
Sep 09 20:35:48.282203 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:35:48.282171    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e6029df-2c3a-4aad-b320-cf420a2be35f" path="/var/lib/kubelet/pods/0e6029df-2c3a-4aad-b320-cf420a2be35f/volumes"
Sep 09 20:36:54.324125 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.324034    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d4d68cdf-rhkxz"]
Sep 09 20:36:54.324633 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.324372    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6029df-2c3a-4aad-b320-cf420a2be35f" containerName="console"
Sep 09 20:36:54.324633 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.324387    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6029df-2c3a-4aad-b320-cf420a2be35f" containerName="console"
Sep 09 20:36:54.324633 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.324445    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e6029df-2c3a-4aad-b320-cf420a2be35f" containerName="console"
Sep 09 20:36:54.327236 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.327216    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.338665 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.338641    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d4d68cdf-rhkxz"]
Sep 09 20:36:54.471427 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.471399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-oauth-serving-cert\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.471579 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.471443    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-serving-cert\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.471579 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.471479    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwfk4\" (UniqueName: \"kubernetes.io/projected/428a8737-edc9-4904-bb30-e78727ea3f27-kube-api-access-dwfk4\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.471579 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.471528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-trusted-ca-bundle\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.471579 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.471554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-console-config\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.471754 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.471579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-oauth-config\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.471754 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.471595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-service-ca\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.572333 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.572306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-serving-cert\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.572473 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.572347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwfk4\" (UniqueName: \"kubernetes.io/projected/428a8737-edc9-4904-bb30-e78727ea3f27-kube-api-access-dwfk4\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.572473 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.572378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-trusted-ca-bundle\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.572473 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.572409    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-console-config\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.572473 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.572433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-oauth-config\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.572473 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.572452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-service-ca\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.572734 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.572479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-oauth-serving-cert\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.573187 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.573164    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-oauth-serving-cert\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.573375 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.573352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-service-ca\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.573435 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.573419    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-console-config\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.573487 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.573420    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-trusted-ca-bundle\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.574979 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.574925    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-oauth-config\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.575104 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.575070    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-serving-cert\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.581816 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.581793    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwfk4\" (UniqueName: \"kubernetes.io/projected/428a8737-edc9-4904-bb30-e78727ea3f27-kube-api-access-dwfk4\") pod \"console-75d4d68cdf-rhkxz\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") " pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.637546 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.637520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:36:54.908217 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:54.908139    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d4d68cdf-rhkxz"]
Sep 09 20:36:54.911287 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:36:54.911258    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428a8737_edc9_4904_bb30_e78727ea3f27.slice/crio-4cd8f5613a12bfa920264b4aba605d8d1ae9370ee3523cfa6c6d1555ec8d94d8 WatchSource:0}: Error finding container 4cd8f5613a12bfa920264b4aba605d8d1ae9370ee3523cfa6c6d1555ec8d94d8: Status 404 returned error can't find the container with id 4cd8f5613a12bfa920264b4aba605d8d1ae9370ee3523cfa6c6d1555ec8d94d8
Sep 09 20:36:55.649584 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:55.649542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d4d68cdf-rhkxz" event={"ID":"428a8737-edc9-4904-bb30-e78727ea3f27","Type":"ContainerStarted","Data":"053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0"}
Sep 09 20:36:55.650037 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:55.649599    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d4d68cdf-rhkxz" event={"ID":"428a8737-edc9-4904-bb30-e78727ea3f27","Type":"ContainerStarted","Data":"4cd8f5613a12bfa920264b4aba605d8d1ae9370ee3523cfa6c6d1555ec8d94d8"}
Sep 09 20:36:55.668253 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:36:55.668180    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d4d68cdf-rhkxz" podStartSLOduration=1.668164013 podStartE2EDuration="1.668164013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:36:55.666659383 +0000 UTC m=+275.911488004" watchObservedRunningTime="2026-09-09 20:36:55.668164013 +0000 UTC m=+275.912992592"
Sep 09 20:37:04.638571 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:04.638532    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:37:04.639033 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:04.638588    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:37:04.643365 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:04.643338    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:37:04.692083 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:04.692042    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:37:04.738976 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:04.738947    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cf64bf54c-4xs2j"]
Sep 09 20:37:20.181850 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:20.181819    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:37:20.186727 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:20.186702    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:37:20.196876 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:20.196853    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:37:20.201309 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:20.201292    2576 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 20:37:20.201968 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:20.201951    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:37:29.764163 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:29.764120    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cf64bf54c-4xs2j" podUID="40bed320-1ced-4379-919b-8fb1e81caf37" containerName="console" containerID="cri-o://a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b" gracePeriod=15
Sep 09 20:37:30.002011 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.001987    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:37:30.033985 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.033921    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-442dr\" (UniqueName: \"kubernetes.io/projected/40bed320-1ced-4379-919b-8fb1e81caf37-kube-api-access-442dr\") pod \"40bed320-1ced-4379-919b-8fb1e81caf37\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") "
Sep 09 20:37:30.033985 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.033956    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-trusted-ca-bundle\") pod \"40bed320-1ced-4379-919b-8fb1e81caf37\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") "
Sep 09 20:37:30.033985 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.033976    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-oauth-serving-cert\") pod \"40bed320-1ced-4379-919b-8fb1e81caf37\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") "
Sep 09 20:37:30.034219 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.034040    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-console-config\") pod \"40bed320-1ced-4379-919b-8fb1e81caf37\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") "
Sep 09 20:37:30.034219 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.034100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-oauth-config\") pod \"40bed320-1ced-4379-919b-8fb1e81caf37\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") "
Sep 09 20:37:30.034219 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.034125    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-service-ca\") pod \"40bed320-1ced-4379-919b-8fb1e81caf37\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") "
Sep 09 20:37:30.034219 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.034154    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-serving-cert\") pod \"40bed320-1ced-4379-919b-8fb1e81caf37\" (UID: \"40bed320-1ced-4379-919b-8fb1e81caf37\") "
Sep 09 20:37:30.034506 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.034474    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-console-config" (OuterVolumeSpecName: "console-config") pod "40bed320-1ced-4379-919b-8fb1e81caf37" (UID: "40bed320-1ced-4379-919b-8fb1e81caf37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:37:30.034622 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.034509    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "40bed320-1ced-4379-919b-8fb1e81caf37" (UID: "40bed320-1ced-4379-919b-8fb1e81caf37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:37:30.034622 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.034535    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-service-ca" (OuterVolumeSpecName: "service-ca") pod "40bed320-1ced-4379-919b-8fb1e81caf37" (UID: "40bed320-1ced-4379-919b-8fb1e81caf37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:37:30.034774 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.034756    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "40bed320-1ced-4379-919b-8fb1e81caf37" (UID: "40bed320-1ced-4379-919b-8fb1e81caf37"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:37:30.036170 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.036150    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40bed320-1ced-4379-919b-8fb1e81caf37-kube-api-access-442dr" (OuterVolumeSpecName: "kube-api-access-442dr") pod "40bed320-1ced-4379-919b-8fb1e81caf37" (UID: "40bed320-1ced-4379-919b-8fb1e81caf37"). InnerVolumeSpecName "kube-api-access-442dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:37:30.036271 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.036256    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "40bed320-1ced-4379-919b-8fb1e81caf37" (UID: "40bed320-1ced-4379-919b-8fb1e81caf37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:37:30.036793 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.036768    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "40bed320-1ced-4379-919b-8fb1e81caf37" (UID: "40bed320-1ced-4379-919b-8fb1e81caf37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:37:30.135022 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.134991    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-oauth-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:37:30.135022 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.135021    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:37:30.135224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.135035    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40bed320-1ced-4379-919b-8fb1e81caf37-console-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:37:30.135224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.135047    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-442dr\" (UniqueName: \"kubernetes.io/projected/40bed320-1ced-4379-919b-8fb1e81caf37-kube-api-access-442dr\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:37:30.135224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.135082    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-trusted-ca-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:37:30.135224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.135094    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-oauth-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:37:30.135224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.135107    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40bed320-1ced-4379-919b-8fb1e81caf37-console-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:37:30.790925 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.790893    2576 generic.go:356] "Generic (PLEG): container finished" podID="40bed320-1ced-4379-919b-8fb1e81caf37" containerID="a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b" exitCode=0
Sep 09 20:37:30.791346 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.790935    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf64bf54c-4xs2j" event={"ID":"40bed320-1ced-4379-919b-8fb1e81caf37","Type":"ContainerDied","Data":"a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b"}
Sep 09 20:37:30.791346 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.790955    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf64bf54c-4xs2j"
Sep 09 20:37:30.791346 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.791000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf64bf54c-4xs2j" event={"ID":"40bed320-1ced-4379-919b-8fb1e81caf37","Type":"ContainerDied","Data":"d6de42f98e84b3a31d54dc7ead9ee76f623cf865fb1fc6453cd68a24fb1d7d88"}
Sep 09 20:37:30.791346 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.791021    2576 scope.go:117] "RemoveContainer" containerID="a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b"
Sep 09 20:37:30.798998 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.798980    2576 scope.go:117] "RemoveContainer" containerID="a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b"
Sep 09 20:37:30.799268 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:37:30.799249    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b\": container with ID starting with a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b not found: ID does not exist" containerID="a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b"
Sep 09 20:37:30.799330 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.799280    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b"} err="failed to get container status \"a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b\": rpc error: code = NotFound desc = could not find container \"a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b\": container with ID starting with a8bf96cce40ef653530e8a9b456a6c89895d543659ea6ba480c16a2785c8885b not found: ID does not exist"
Sep 09 20:37:30.804855 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.804830    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cf64bf54c-4xs2j"]
Sep 09 20:37:30.807455 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:30.807436    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cf64bf54c-4xs2j"]
Sep 09 20:37:32.283004 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:37:32.282959    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40bed320-1ced-4379-919b-8fb1e81caf37" path="/var/lib/kubelet/pods/40bed320-1ced-4379-919b-8fb1e81caf37/volumes"
Sep 09 20:38:58.199284 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.199251    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"]
Sep 09 20:38:58.199687 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.199560    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40bed320-1ced-4379-919b-8fb1e81caf37" containerName="console"
Sep 09 20:38:58.199687 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.199572    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="40bed320-1ced-4379-919b-8fb1e81caf37" containerName="console"
Sep 09 20:38:58.199687 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.199636    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="40bed320-1ced-4379-919b-8fb1e81caf37" containerName="console"
Sep 09 20:38:58.202517 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.202502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:38:58.204788 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.204763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 20:38:58.204920 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.204907    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 20:38:58.205404 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.205389    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ml86x\""
Sep 09 20:38:58.211432 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.211410    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"]
Sep 09 20:38:58.288901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.288873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:38:58.289031 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.288915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lht9\" (UniqueName: \"kubernetes.io/projected/71a7624b-c879-4561-b348-b6e77a458c9b-kube-api-access-4lht9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:38:58.289031 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.288946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:38:58.389712 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.389675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:38:58.389854 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.389747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lht9\" (UniqueName: \"kubernetes.io/projected/71a7624b-c879-4561-b348-b6e77a458c9b-kube-api-access-4lht9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:38:58.389854 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.389785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:38:58.390088 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.390045    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:38:58.390166 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.390133    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:38:58.399046 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.399023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lht9\" (UniqueName: \"kubernetes.io/projected/71a7624b-c879-4561-b348-b6e77a458c9b-kube-api-access-4lht9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:38:58.511494 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.511411    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:38:58.784255 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.784230    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"]
Sep 09 20:38:58.786711 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:38:58.786681    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a7624b_c879_4561_b348_b6e77a458c9b.slice/crio-6c87a0ad67b6997e4caaa0b45c272711cbbcd8db871f4f1eb9dacc6a0a9d99f8 WatchSource:0}: Error finding container 6c87a0ad67b6997e4caaa0b45c272711cbbcd8db871f4f1eb9dacc6a0a9d99f8: Status 404 returned error can't find the container with id 6c87a0ad67b6997e4caaa0b45c272711cbbcd8db871f4f1eb9dacc6a0a9d99f8
Sep 09 20:38:58.788754 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:58.788735    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:38:59.128974 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:38:59.128942    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs" event={"ID":"71a7624b-c879-4561-b348-b6e77a458c9b","Type":"ContainerStarted","Data":"6c87a0ad67b6997e4caaa0b45c272711cbbcd8db871f4f1eb9dacc6a0a9d99f8"}
Sep 09 20:39:06.156853 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:06.156811    2576 generic.go:356] "Generic (PLEG): container finished" podID="71a7624b-c879-4561-b348-b6e77a458c9b" containerID="068b2c8c43f5f5ed8f8d53cfa9c8b7731083015ff44ea764060f4956f236e4e9" exitCode=0
Sep 09 20:39:06.157232 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:06.156864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs" event={"ID":"71a7624b-c879-4561-b348-b6e77a458c9b","Type":"ContainerDied","Data":"068b2c8c43f5f5ed8f8d53cfa9c8b7731083015ff44ea764060f4956f236e4e9"}
Sep 09 20:39:09.172228 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:09.172194    2576 generic.go:356] "Generic (PLEG): container finished" podID="71a7624b-c879-4561-b348-b6e77a458c9b" containerID="363018f55a4ef2d69f12c5490c5a45e0ee1e2a8ce746efd6152b57876b92b427" exitCode=0
Sep 09 20:39:09.172577 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:09.172257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs" event={"ID":"71a7624b-c879-4561-b348-b6e77a458c9b","Type":"ContainerDied","Data":"363018f55a4ef2d69f12c5490c5a45e0ee1e2a8ce746efd6152b57876b92b427"}
Sep 09 20:39:16.204206 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:16.204170    2576 generic.go:356] "Generic (PLEG): container finished" podID="71a7624b-c879-4561-b348-b6e77a458c9b" containerID="019e0382c8d4212fbb0e277e3833a225b1e27fce278611f44ab7582d52c8f827" exitCode=0
Sep 09 20:39:16.204572 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:16.204250    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs" event={"ID":"71a7624b-c879-4561-b348-b6e77a458c9b","Type":"ContainerDied","Data":"019e0382c8d4212fbb0e277e3833a225b1e27fce278611f44ab7582d52c8f827"}
Sep 09 20:39:17.330208 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:17.330182    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:39:17.449702 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:17.449675    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lht9\" (UniqueName: \"kubernetes.io/projected/71a7624b-c879-4561-b348-b6e77a458c9b-kube-api-access-4lht9\") pod \"71a7624b-c879-4561-b348-b6e77a458c9b\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") "
Sep 09 20:39:17.449857 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:17.449732    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-bundle\") pod \"71a7624b-c879-4561-b348-b6e77a458c9b\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") "
Sep 09 20:39:17.449857 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:17.449755    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-util\") pod \"71a7624b-c879-4561-b348-b6e77a458c9b\" (UID: \"71a7624b-c879-4561-b348-b6e77a458c9b\") "
Sep 09 20:39:17.450408 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:17.450388    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-bundle" (OuterVolumeSpecName: "bundle") pod "71a7624b-c879-4561-b348-b6e77a458c9b" (UID: "71a7624b-c879-4561-b348-b6e77a458c9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:39:17.451898 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:17.451875    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a7624b-c879-4561-b348-b6e77a458c9b-kube-api-access-4lht9" (OuterVolumeSpecName: "kube-api-access-4lht9") pod "71a7624b-c879-4561-b348-b6e77a458c9b" (UID: "71a7624b-c879-4561-b348-b6e77a458c9b"). InnerVolumeSpecName "kube-api-access-4lht9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:39:17.453793 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:17.453773    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-util" (OuterVolumeSpecName: "util") pod "71a7624b-c879-4561-b348-b6e77a458c9b" (UID: "71a7624b-c879-4561-b348-b6e77a458c9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:39:17.551116 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:17.551085    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lht9\" (UniqueName: \"kubernetes.io/projected/71a7624b-c879-4561-b348-b6e77a458c9b-kube-api-access-4lht9\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:39:17.551116 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:17.551114    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:39:17.551263 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:17.551128    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71a7624b-c879-4561-b348-b6e77a458c9b-util\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:39:18.214315 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:18.214282    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs" event={"ID":"71a7624b-c879-4561-b348-b6e77a458c9b","Type":"ContainerDied","Data":"6c87a0ad67b6997e4caaa0b45c272711cbbcd8db871f4f1eb9dacc6a0a9d99f8"}
Sep 09 20:39:18.214459 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:18.214335    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c87a0ad67b6997e4caaa0b45c272711cbbcd8db871f4f1eb9dacc6a0a9d99f8"
Sep 09 20:39:18.214459 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:18.214296    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bfkxs"
Sep 09 20:39:21.215703 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.215671    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff"]
Sep 09 20:39:21.216045 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.215945    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a7624b-c879-4561-b348-b6e77a458c9b" containerName="pull"
Sep 09 20:39:21.216045 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.215956    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a7624b-c879-4561-b348-b6e77a458c9b" containerName="pull"
Sep 09 20:39:21.216045 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.215974    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a7624b-c879-4561-b348-b6e77a458c9b" containerName="util"
Sep 09 20:39:21.216045 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.215979    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a7624b-c879-4561-b348-b6e77a458c9b" containerName="util"
Sep 09 20:39:21.216045 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.215991    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a7624b-c879-4561-b348-b6e77a458c9b" containerName="extract"
Sep 09 20:39:21.216045 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.215997    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a7624b-c879-4561-b348-b6e77a458c9b" containerName="extract"
Sep 09 20:39:21.216045 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.216046    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="71a7624b-c879-4561-b348-b6e77a458c9b" containerName="extract"
Sep 09 20:39:21.248453 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.248428    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff"]
Sep 09 20:39:21.248592 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.248512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff"
Sep 09 20:39:21.250875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.250854    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xpzq8\""
Sep 09 20:39:21.250948 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.250930    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:39:21.250982 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.250956    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 09 20:39:21.379809 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.379775    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa4cfae3-1f17-42bc-a3fb-c925732db6d0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jh5ff\" (UID: \"aa4cfae3-1f17-42bc-a3fb-c925732db6d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff"
Sep 09 20:39:21.379950 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.379818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwzsq\" (UniqueName: \"kubernetes.io/projected/aa4cfae3-1f17-42bc-a3fb-c925732db6d0-kube-api-access-gwzsq\") pod \"cert-manager-operator-controller-manager-55c444bf86-jh5ff\" (UID: \"aa4cfae3-1f17-42bc-a3fb-c925732db6d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff"
Sep 09 20:39:21.480604 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.480540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa4cfae3-1f17-42bc-a3fb-c925732db6d0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jh5ff\" (UID: \"aa4cfae3-1f17-42bc-a3fb-c925732db6d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff"
Sep 09 20:39:21.480604 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.480579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzsq\" (UniqueName: \"kubernetes.io/projected/aa4cfae3-1f17-42bc-a3fb-c925732db6d0-kube-api-access-gwzsq\") pod \"cert-manager-operator-controller-manager-55c444bf86-jh5ff\" (UID: \"aa4cfae3-1f17-42bc-a3fb-c925732db6d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff"
Sep 09 20:39:21.480907 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.480888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa4cfae3-1f17-42bc-a3fb-c925732db6d0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jh5ff\" (UID: \"aa4cfae3-1f17-42bc-a3fb-c925732db6d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff"
Sep 09 20:39:21.489456 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.489437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwzsq\" (UniqueName: \"kubernetes.io/projected/aa4cfae3-1f17-42bc-a3fb-c925732db6d0-kube-api-access-gwzsq\") pod \"cert-manager-operator-controller-manager-55c444bf86-jh5ff\" (UID: \"aa4cfae3-1f17-42bc-a3fb-c925732db6d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff"
Sep 09 20:39:21.558334 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.558316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff"
Sep 09 20:39:21.847381 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:21.846942    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff"]
Sep 09 20:39:21.852362 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:39:21.852332    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4cfae3_1f17_42bc_a3fb_c925732db6d0.slice/crio-0cc616407d02e25611d8f62a5fabf93f946b052d65b0f4f7d2527084258ac9fd WatchSource:0}: Error finding container 0cc616407d02e25611d8f62a5fabf93f946b052d65b0f4f7d2527084258ac9fd: Status 404 returned error can't find the container with id 0cc616407d02e25611d8f62a5fabf93f946b052d65b0f4f7d2527084258ac9fd
Sep 09 20:39:22.233378 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:22.233291    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff" event={"ID":"aa4cfae3-1f17-42bc-a3fb-c925732db6d0","Type":"ContainerStarted","Data":"0cc616407d02e25611d8f62a5fabf93f946b052d65b0f4f7d2527084258ac9fd"}
Sep 09 20:39:24.244966 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:24.244880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff" event={"ID":"aa4cfae3-1f17-42bc-a3fb-c925732db6d0","Type":"ContainerStarted","Data":"ee89b85fc03c77ddb7f6ca45a12830a65309615b734c5c64defdc200a2b38e5c"}
Sep 09 20:39:24.265542 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:24.265488    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jh5ff" podStartSLOduration=1.143335128 podStartE2EDuration="3.265473535s" totalImagesPullingTime="2.122138407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:39:24.262994054 +0000 UTC m=+424.507822633" watchObservedRunningTime="2026-09-09 20:39:24.265473535 +0000 UTC m=+424.510302115"
Sep 09 20:39:25.145975 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.145936    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-drxvm"]
Sep 09 20:39:25.148608 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.148591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm"
Sep 09 20:39:25.151009 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.150979    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 20:39:25.151745 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.151728    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 20:39:25.151834 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.151735    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jpm7t\""
Sep 09 20:39:25.163325 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.163303    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-drxvm"]
Sep 09 20:39:25.212111 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.212073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4gh4\" (UniqueName: \"kubernetes.io/projected/01775910-041a-4783-8c1e-361944765246-kube-api-access-j4gh4\") pod \"cert-manager-webhook-6486ffd997-drxvm\" (UID: \"01775910-041a-4783-8c1e-361944765246\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm"
Sep 09 20:39:25.212260 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.212124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01775910-041a-4783-8c1e-361944765246-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-drxvm\" (UID: \"01775910-041a-4783-8c1e-361944765246\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm"
Sep 09 20:39:25.313212 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.313179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4gh4\" (UniqueName: \"kubernetes.io/projected/01775910-041a-4783-8c1e-361944765246-kube-api-access-j4gh4\") pod \"cert-manager-webhook-6486ffd997-drxvm\" (UID: \"01775910-041a-4783-8c1e-361944765246\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm"
Sep 09 20:39:25.313212 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.313220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01775910-041a-4783-8c1e-361944765246-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-drxvm\" (UID: \"01775910-041a-4783-8c1e-361944765246\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm"
Sep 09 20:39:25.321733 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.321697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01775910-041a-4783-8c1e-361944765246-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-drxvm\" (UID: \"01775910-041a-4783-8c1e-361944765246\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm"
Sep 09 20:39:25.321844 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.321812    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4gh4\" (UniqueName: \"kubernetes.io/projected/01775910-041a-4783-8c1e-361944765246-kube-api-access-j4gh4\") pod \"cert-manager-webhook-6486ffd997-drxvm\" (UID: \"01775910-041a-4783-8c1e-361944765246\") " pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm"
Sep 09 20:39:25.482795 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.482700    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm"
Sep 09 20:39:25.751634 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:25.751561    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-drxvm"]
Sep 09 20:39:25.754744 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:39:25.754713    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01775910_041a_4783_8c1e_361944765246.slice/crio-47ba821709ec189041442fb3b0964bb125d0983c6e6ed12f908a394ac4108e4a WatchSource:0}: Error finding container 47ba821709ec189041442fb3b0964bb125d0983c6e6ed12f908a394ac4108e4a: Status 404 returned error can't find the container with id 47ba821709ec189041442fb3b0964bb125d0983c6e6ed12f908a394ac4108e4a
Sep 09 20:39:26.253555 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:26.253517    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm" event={"ID":"01775910-041a-4783-8c1e-361944765246","Type":"ContainerStarted","Data":"47ba821709ec189041442fb3b0964bb125d0983c6e6ed12f908a394ac4108e4a"}
Sep 09 20:39:29.268790 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:29.268755    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm" event={"ID":"01775910-041a-4783-8c1e-361944765246","Type":"ContainerStarted","Data":"bcc63a926bf26022cd95d2e3fa2d107767c8787dfa3e934fbe400569c47cfbbb"}
Sep 09 20:39:29.269251 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:29.268819    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm"
Sep 09 20:39:29.284722 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:29.284674    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm" podStartSLOduration=1.56931807 podStartE2EDuration="4.284659356s" totalImagesPullingTime="2.715341286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:39:29.284469482 +0000 UTC m=+429.529298062" watchObservedRunningTime="2026-09-09 20:39:29.284659356 +0000 UTC m=+429.529487935"
Sep 09 20:39:30.675456 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.675420    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77856c6bbc-86db7"]
Sep 09 20:39:30.677871 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.677851    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.705155 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.705128    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77856c6bbc-86db7"]
Sep 09 20:39:30.758908 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.758882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e20699ba-94ca-46f2-a327-9c444742fdea-console-oauth-config\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.759018 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.758910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-console-config\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.759018 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.758928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-service-ca\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.759018 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.758944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-trusted-ca-bundle\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.759149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.759018    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg8wx\" (UniqueName: \"kubernetes.io/projected/e20699ba-94ca-46f2-a327-9c444742fdea-kube-api-access-sg8wx\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.759149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.759106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e20699ba-94ca-46f2-a327-9c444742fdea-console-serving-cert\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.759214 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.759163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-oauth-serving-cert\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.860251 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.860209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e20699ba-94ca-46f2-a327-9c444742fdea-console-serving-cert\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.860443 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.860262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-oauth-serving-cert\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.860443 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.860296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e20699ba-94ca-46f2-a327-9c444742fdea-console-oauth-config\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.860443 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.860310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-console-config\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.860443 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.860327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-service-ca\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.860443 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.860346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-trusted-ca-bundle\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.860443 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.860367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg8wx\" (UniqueName: \"kubernetes.io/projected/e20699ba-94ca-46f2-a327-9c444742fdea-kube-api-access-sg8wx\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.861198 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.861172    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-console-config\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.861198 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.861190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-service-ca\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.861343 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.861192    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-oauth-serving-cert\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.861376 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.861353    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e20699ba-94ca-46f2-a327-9c444742fdea-trusted-ca-bundle\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.863021 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.862999    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e20699ba-94ca-46f2-a327-9c444742fdea-console-serving-cert\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.863364 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.863344    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e20699ba-94ca-46f2-a327-9c444742fdea-console-oauth-config\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.873278 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.873260    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg8wx\" (UniqueName: \"kubernetes.io/projected/e20699ba-94ca-46f2-a327-9c444742fdea-kube-api-access-sg8wx\") pod \"console-77856c6bbc-86db7\" (UID: \"e20699ba-94ca-46f2-a327-9c444742fdea\") " pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:30.987261 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:30.987175    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:31.258562 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:31.258539    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77856c6bbc-86db7"]
Sep 09 20:39:31.260989 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:39:31.260960    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20699ba_94ca_46f2_a327_9c444742fdea.slice/crio-7e422a59fdd096abb531d342ea0cb195032df7b0460dc4e0b35f25a6b228d1cb WatchSource:0}: Error finding container 7e422a59fdd096abb531d342ea0cb195032df7b0460dc4e0b35f25a6b228d1cb: Status 404 returned error can't find the container with id 7e422a59fdd096abb531d342ea0cb195032df7b0460dc4e0b35f25a6b228d1cb
Sep 09 20:39:31.278329 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:31.278303    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77856c6bbc-86db7" event={"ID":"e20699ba-94ca-46f2-a327-9c444742fdea","Type":"ContainerStarted","Data":"7e422a59fdd096abb531d342ea0cb195032df7b0460dc4e0b35f25a6b228d1cb"}
Sep 09 20:39:32.284524 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:32.284494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77856c6bbc-86db7" event={"ID":"e20699ba-94ca-46f2-a327-9c444742fdea","Type":"ContainerStarted","Data":"fb84323d42510efa483a45c902bcbb0015fd1fc0ffd4dacba3a364345ab9b913"}
Sep 09 20:39:32.303859 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:32.303808    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77856c6bbc-86db7" podStartSLOduration=2.30379324 podStartE2EDuration="2.30379324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:39:32.302257395 +0000 UTC m=+432.547085977" watchObservedRunningTime="2026-09-09 20:39:32.30379324 +0000 UTC m=+432.548621820"
Sep 09 20:39:35.275745 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:35.275702    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-drxvm"
Sep 09 20:39:40.987835 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:40.987799    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:40.988249 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:40.987869    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:40.992464 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:40.992438    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:41.327850 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:41.327821    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77856c6bbc-86db7"
Sep 09 20:39:41.375367 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:41.375332    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d4d68cdf-rhkxz"]
Sep 09 20:39:49.404120 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.404014    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9"]
Sep 09 20:39:49.406498 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.406471    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9"
Sep 09 20:39:49.408714 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.408688    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:39:49.408714 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.408700    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 20:39:49.409314 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.409297    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gkfs7\""
Sep 09 20:39:49.415001 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.414974    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9"]
Sep 09 20:39:49.521167 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.521142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svw6q\" (UniqueName: \"kubernetes.io/projected/4d941521-2f57-451a-9be3-1682a6dd0bd9-kube-api-access-svw6q\") pod \"openshift-lws-operator-fd8ccff4c-npkf9\" (UID: \"4d941521-2f57-451a-9be3-1682a6dd0bd9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9"
Sep 09 20:39:49.521337 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.521202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d941521-2f57-451a-9be3-1682a6dd0bd9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-npkf9\" (UID: \"4d941521-2f57-451a-9be3-1682a6dd0bd9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9"
Sep 09 20:39:49.621595 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.621563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svw6q\" (UniqueName: \"kubernetes.io/projected/4d941521-2f57-451a-9be3-1682a6dd0bd9-kube-api-access-svw6q\") pod \"openshift-lws-operator-fd8ccff4c-npkf9\" (UID: \"4d941521-2f57-451a-9be3-1682a6dd0bd9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9"
Sep 09 20:39:49.621705 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.621624    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d941521-2f57-451a-9be3-1682a6dd0bd9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-npkf9\" (UID: \"4d941521-2f57-451a-9be3-1682a6dd0bd9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9"
Sep 09 20:39:49.621942 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.621920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d941521-2f57-451a-9be3-1682a6dd0bd9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-npkf9\" (UID: \"4d941521-2f57-451a-9be3-1682a6dd0bd9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9"
Sep 09 20:39:49.630319 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.630292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svw6q\" (UniqueName: \"kubernetes.io/projected/4d941521-2f57-451a-9be3-1682a6dd0bd9-kube-api-access-svw6q\") pod \"openshift-lws-operator-fd8ccff4c-npkf9\" (UID: \"4d941521-2f57-451a-9be3-1682a6dd0bd9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9"
Sep 09 20:39:49.716984 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.716928    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9"
Sep 09 20:39:49.984408 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:49.984263    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9"]
Sep 09 20:39:49.987512 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:39:49.987482    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d941521_2f57_451a_9be3_1682a6dd0bd9.slice/crio-1bba0c13f726fc6fd9adf8f940502c80fa6979d8dbf7931e011be1e028e1c9f5 WatchSource:0}: Error finding container 1bba0c13f726fc6fd9adf8f940502c80fa6979d8dbf7931e011be1e028e1c9f5: Status 404 returned error can't find the container with id 1bba0c13f726fc6fd9adf8f940502c80fa6979d8dbf7931e011be1e028e1c9f5
Sep 09 20:39:50.361794 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:50.361758    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9" event={"ID":"4d941521-2f57-451a-9be3-1682a6dd0bd9","Type":"ContainerStarted","Data":"1bba0c13f726fc6fd9adf8f940502c80fa6979d8dbf7931e011be1e028e1c9f5"}
Sep 09 20:39:53.383963 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:53.383922    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9" event={"ID":"4d941521-2f57-451a-9be3-1682a6dd0bd9","Type":"ContainerStarted","Data":"b75c863dcd3ff5fd572db41082cdff7bc6fc93071fd7e40db7a574fc9ca2f34f"}
Sep 09 20:39:53.400510 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:39:53.400467    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-npkf9" podStartSLOduration=1.948193856 podStartE2EDuration="4.400453664s" totalImagesPullingTime="2.452259808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:39:53.399205074 +0000 UTC m=+453.644033656" watchObservedRunningTime="2026-09-09 20:39:53.400453664 +0000 UTC m=+453.645282245"
Sep 09 20:40:00.655383 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.655350    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"]
Sep 09 20:40:00.659718 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.659702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.661897 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.661873    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 20:40:00.662105 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.662091    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hbn94\""
Sep 09 20:40:00.662216 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.662172    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 20:40:00.662293 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.662240    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 20:40:00.670823 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.670801    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"]
Sep 09 20:40:00.705768 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.705747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ba6560a-9e88-48b9-a257-8a48fba85524-manager-config\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.705864 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.705783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ba6560a-9e88-48b9-a257-8a48fba85524-cert\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.705864 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.705809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ba6560a-9e88-48b9-a257-8a48fba85524-metrics-cert\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.705951 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.705931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkzhz\" (UniqueName: \"kubernetes.io/projected/4ba6560a-9e88-48b9-a257-8a48fba85524-kube-api-access-bkzhz\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.807023 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.806995    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkzhz\" (UniqueName: \"kubernetes.io/projected/4ba6560a-9e88-48b9-a257-8a48fba85524-kube-api-access-bkzhz\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.807023 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.807027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ba6560a-9e88-48b9-a257-8a48fba85524-manager-config\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.807206 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.807074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ba6560a-9e88-48b9-a257-8a48fba85524-cert\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.807206 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.807109    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ba6560a-9e88-48b9-a257-8a48fba85524-metrics-cert\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.807733 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.807716    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ba6560a-9e88-48b9-a257-8a48fba85524-manager-config\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.809535 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.809519    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ba6560a-9e88-48b9-a257-8a48fba85524-cert\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.809657 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.809641    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ba6560a-9e88-48b9-a257-8a48fba85524-metrics-cert\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.814440 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.814416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkzhz\" (UniqueName: \"kubernetes.io/projected/4ba6560a-9e88-48b9-a257-8a48fba85524-kube-api-access-bkzhz\") pod \"lws-controller-manager-6cdf7f9947-hlvtl\" (UID: \"4ba6560a-9e88-48b9-a257-8a48fba85524\") " pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:00.969428 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:00.969347    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:01.246742 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:01.246717    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"]
Sep 09 20:40:01.249308 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:40:01.249283    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba6560a_9e88_48b9_a257_8a48fba85524.slice/crio-69566fe4e42658c1efb077f1a1583176ba3c3d3f083b6e7a2ff81446e8fc20c7 WatchSource:0}: Error finding container 69566fe4e42658c1efb077f1a1583176ba3c3d3f083b6e7a2ff81446e8fc20c7: Status 404 returned error can't find the container with id 69566fe4e42658c1efb077f1a1583176ba3c3d3f083b6e7a2ff81446e8fc20c7
Sep 09 20:40:01.420527 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:01.420493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl" event={"ID":"4ba6560a-9e88-48b9-a257-8a48fba85524","Type":"ContainerStarted","Data":"69566fe4e42658c1efb077f1a1583176ba3c3d3f083b6e7a2ff81446e8fc20c7"}
Sep 09 20:40:04.436342 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:04.436256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl" event={"ID":"4ba6560a-9e88-48b9-a257-8a48fba85524","Type":"ContainerStarted","Data":"dd0fb725c4f3e480bcd1982b1fa7794df7855c8107bac58cab39c79459b16a22"}
Sep 09 20:40:04.436762 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:04.436376    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:04.452798 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:04.452754    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl" podStartSLOduration=1.620998482 podStartE2EDuration="4.452741023s" totalImagesPullingTime="2.831742541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:40:04.450847719 +0000 UTC m=+464.695676301" watchObservedRunningTime="2026-09-09 20:40:04.452741023 +0000 UTC m=+464.697569603"
Sep 09 20:40:06.396884 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.396844    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75d4d68cdf-rhkxz" podUID="428a8737-edc9-4904-bb30-e78727ea3f27" containerName="console" containerID="cri-o://053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0" gracePeriod=15
Sep 09 20:40:06.640036 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.640013    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:40:06.653653 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.653597    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-serving-cert\") pod \"428a8737-edc9-4904-bb30-e78727ea3f27\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") "
Sep 09 20:40:06.653653 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.653631    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwfk4\" (UniqueName: \"kubernetes.io/projected/428a8737-edc9-4904-bb30-e78727ea3f27-kube-api-access-dwfk4\") pod \"428a8737-edc9-4904-bb30-e78727ea3f27\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") "
Sep 09 20:40:06.653839 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.653667    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-service-ca\") pod \"428a8737-edc9-4904-bb30-e78727ea3f27\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") "
Sep 09 20:40:06.653839 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.653692    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-oauth-serving-cert\") pod \"428a8737-edc9-4904-bb30-e78727ea3f27\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") "
Sep 09 20:40:06.653839 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.653787    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-oauth-config\") pod \"428a8737-edc9-4904-bb30-e78727ea3f27\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") "
Sep 09 20:40:06.653839 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.653821    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-console-config\") pod \"428a8737-edc9-4904-bb30-e78727ea3f27\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") "
Sep 09 20:40:06.654038 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.653920    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-trusted-ca-bundle\") pod \"428a8737-edc9-4904-bb30-e78727ea3f27\" (UID: \"428a8737-edc9-4904-bb30-e78727ea3f27\") "
Sep 09 20:40:06.654038 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.654000    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-service-ca" (OuterVolumeSpecName: "service-ca") pod "428a8737-edc9-4904-bb30-e78727ea3f27" (UID: "428a8737-edc9-4904-bb30-e78727ea3f27"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:40:06.654212 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.654037    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "428a8737-edc9-4904-bb30-e78727ea3f27" (UID: "428a8737-edc9-4904-bb30-e78727ea3f27"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:40:06.654212 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.654190    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:40:06.654212 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.654209    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-oauth-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:40:06.654374 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.654330    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-console-config" (OuterVolumeSpecName: "console-config") pod "428a8737-edc9-4904-bb30-e78727ea3f27" (UID: "428a8737-edc9-4904-bb30-e78727ea3f27"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:40:06.654430 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.654373    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "428a8737-edc9-4904-bb30-e78727ea3f27" (UID: "428a8737-edc9-4904-bb30-e78727ea3f27"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:40:06.655773 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.655751    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "428a8737-edc9-4904-bb30-e78727ea3f27" (UID: "428a8737-edc9-4904-bb30-e78727ea3f27"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:40:06.655913 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.655894    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "428a8737-edc9-4904-bb30-e78727ea3f27" (UID: "428a8737-edc9-4904-bb30-e78727ea3f27"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:40:06.655969 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.655938    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428a8737-edc9-4904-bb30-e78727ea3f27-kube-api-access-dwfk4" (OuterVolumeSpecName: "kube-api-access-dwfk4") pod "428a8737-edc9-4904-bb30-e78727ea3f27" (UID: "428a8737-edc9-4904-bb30-e78727ea3f27"). InnerVolumeSpecName "kube-api-access-dwfk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:40:06.754725 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.754701    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-trusted-ca-bundle\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:40:06.754725 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.754725    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-serving-cert\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:40:06.754896 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.754739    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwfk4\" (UniqueName: \"kubernetes.io/projected/428a8737-edc9-4904-bb30-e78727ea3f27-kube-api-access-dwfk4\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:40:06.754896 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.754753    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/428a8737-edc9-4904-bb30-e78727ea3f27-console-oauth-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:40:06.754896 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:06.754764    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/428a8737-edc9-4904-bb30-e78727ea3f27-console-config\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:40:07.450818 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:07.450778    2576 generic.go:356] "Generic (PLEG): container finished" podID="428a8737-edc9-4904-bb30-e78727ea3f27" containerID="053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0" exitCode=0
Sep 09 20:40:07.451320 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:07.450832    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d4d68cdf-rhkxz"
Sep 09 20:40:07.451320 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:07.450864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d4d68cdf-rhkxz" event={"ID":"428a8737-edc9-4904-bb30-e78727ea3f27","Type":"ContainerDied","Data":"053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0"}
Sep 09 20:40:07.451320 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:07.450916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d4d68cdf-rhkxz" event={"ID":"428a8737-edc9-4904-bb30-e78727ea3f27","Type":"ContainerDied","Data":"4cd8f5613a12bfa920264b4aba605d8d1ae9370ee3523cfa6c6d1555ec8d94d8"}
Sep 09 20:40:07.451320 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:07.450937    2576 scope.go:117] "RemoveContainer" containerID="053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0"
Sep 09 20:40:07.459873 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:07.459854    2576 scope.go:117] "RemoveContainer" containerID="053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0"
Sep 09 20:40:07.460123 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:40:07.460103    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0\": container with ID starting with 053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0 not found: ID does not exist" containerID="053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0"
Sep 09 20:40:07.460182 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:07.460131    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0"} err="failed to get container status \"053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0\": rpc error: code = NotFound desc = could not find container \"053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0\": container with ID starting with 053afca8d0c9e477c08c9a76fd69e3ffbe81c69caef2bb0dcfcb86bef45a20c0 not found: ID does not exist"
Sep 09 20:40:07.474395 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:07.474368    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d4d68cdf-rhkxz"]
Sep 09 20:40:07.479398 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:07.479379    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75d4d68cdf-rhkxz"]
Sep 09 20:40:08.283525 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:08.283492    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="428a8737-edc9-4904-bb30-e78727ea3f27" path="/var/lib/kubelet/pods/428a8737-edc9-4904-bb30-e78727ea3f27/volumes"
Sep 09 20:40:12.677412 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.677363    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"]
Sep 09 20:40:12.677819 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.677724    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="428a8737-edc9-4904-bb30-e78727ea3f27" containerName="console"
Sep 09 20:40:12.677819 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.677737    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="428a8737-edc9-4904-bb30-e78727ea3f27" containerName="console"
Sep 09 20:40:12.677819 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.677798    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="428a8737-edc9-4904-bb30-e78727ea3f27" containerName="console"
Sep 09 20:40:12.680702 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.680682    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.682774 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.682751    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 20:40:12.682921 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.682905    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 20:40:12.682989 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.682951    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 20:40:12.683048 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.682950    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 20:40:12.683104 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.683046    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p8mdg\""
Sep 09 20:40:12.695715 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.695694    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"]
Sep 09 20:40:12.798537 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.798506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-tmp\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.798667 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.798549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-manifests\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.798667 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.798574    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-webhook-cert\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.798667 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.798625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.798776 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.798722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4ptb\" (UniqueName: \"kubernetes.io/projected/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-kube-api-access-s4ptb\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.899709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.899681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-tmp\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.899844 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.899717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-manifests\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.899844 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.899739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-webhook-cert\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.899844 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.899755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.899844 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.899821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4ptb\" (UniqueName: \"kubernetes.io/projected/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-kube-api-access-s4ptb\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.900271 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.900228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-manifests\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.902106 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.902075    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-tmp\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.902194 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.902157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-webhook-cert\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.902233 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.902190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.912927 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.912901    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4ptb\" (UniqueName: \"kubernetes.io/projected/6de65ffc-ebcf-4ad3-9a79-a21071b0892c-kube-api-access-s4ptb\") pod \"opendatahub-operator-controller-manager-859cf57674-fpbz2\" (UID: \"6de65ffc-ebcf-4ad3-9a79-a21071b0892c\") " pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:12.990979 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:12.990904    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:13.272106 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:13.272076    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"]
Sep 09 20:40:13.274645 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:40:13.274616    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de65ffc_ebcf_4ad3_9a79_a21071b0892c.slice/crio-2ba1a9de3486d311cae7e24c3b00ea798a3ed361a7511945fba83dd0e2f2b00f WatchSource:0}: Error finding container 2ba1a9de3486d311cae7e24c3b00ea798a3ed361a7511945fba83dd0e2f2b00f: Status 404 returned error can't find the container with id 2ba1a9de3486d311cae7e24c3b00ea798a3ed361a7511945fba83dd0e2f2b00f
Sep 09 20:40:13.478893 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:13.478856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2" event={"ID":"6de65ffc-ebcf-4ad3-9a79-a21071b0892c","Type":"ContainerStarted","Data":"2ba1a9de3486d311cae7e24c3b00ea798a3ed361a7511945fba83dd0e2f2b00f"}
Sep 09 20:40:15.443800 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:15.443767    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6cdf7f9947-hlvtl"
Sep 09 20:40:16.497644 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:16.497613    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2" event={"ID":"6de65ffc-ebcf-4ad3-9a79-a21071b0892c","Type":"ContainerStarted","Data":"e795b8673c69f704581005a1c425998ed1fbbc061eda803fa93d38fb5d247637"}
Sep 09 20:40:17.504268 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:17.504234    2576 generic.go:356] "Generic (PLEG): container finished" podID="6de65ffc-ebcf-4ad3-9a79-a21071b0892c" containerID="e795b8673c69f704581005a1c425998ed1fbbc061eda803fa93d38fb5d247637" exitCode=0
Sep 09 20:40:17.504624 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:17.504284    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2" event={"ID":"6de65ffc-ebcf-4ad3-9a79-a21071b0892c","Type":"ContainerDied","Data":"e795b8673c69f704581005a1c425998ed1fbbc061eda803fa93d38fb5d247637"}
Sep 09 20:40:18.511035 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:18.510997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2" event={"ID":"6de65ffc-ebcf-4ad3-9a79-a21071b0892c","Type":"ContainerStarted","Data":"6d91fd4740b51ed7c8f7b37c5e3cf20e27ec4aaf0d5caa338287e7e2027c0c1c"}
Sep 09 20:40:18.511428 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:18.511191    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:18.531777 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:18.531725    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2" podStartSLOduration=2.138485409 podStartE2EDuration="6.531707932s" totalImagesPullingTime="3.355976107s" totalInitContainerRuntime="1.037246416s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:40:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:40:18.53092519 +0000 UTC m=+478.775753778" watchObservedRunningTime="2026-09-09 20:40:18.531707932 +0000 UTC m=+478.776536513"
Sep 09 20:40:29.524419 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:29.524387    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-859cf57674-fpbz2"
Sep 09 20:40:42.817533 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:42.817497    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qcjdv"]
Sep 09 20:40:42.830163 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:42.830136    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:40:42.830583 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:42.830557    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qcjdv"]
Sep 09 20:40:42.832554 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:42.832529    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 09 20:40:42.832672 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:42.832610    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2pq7f\""
Sep 09 20:40:42.952866 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:42.952832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjd27\" (UniqueName: \"kubernetes.io/projected/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-kube-api-access-gjd27\") pod \"odh-model-controller-7998c67dc4-qcjdv\" (UID: \"859a7174-9a0f-47ec-b0ea-5c9039b6ea2c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:40:42.953043 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:42.952918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-cert\") pod \"odh-model-controller-7998c67dc4-qcjdv\" (UID: \"859a7174-9a0f-47ec-b0ea-5c9039b6ea2c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:40:43.053362 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.053324    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-cert\") pod \"odh-model-controller-7998c67dc4-qcjdv\" (UID: \"859a7174-9a0f-47ec-b0ea-5c9039b6ea2c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:40:43.053546 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.053408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjd27\" (UniqueName: \"kubernetes.io/projected/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-kube-api-access-gjd27\") pod \"odh-model-controller-7998c67dc4-qcjdv\" (UID: \"859a7174-9a0f-47ec-b0ea-5c9039b6ea2c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:40:43.053546 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:40:43.053484    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 09 20:40:43.053666 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:40:43.053567    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-cert podName:859a7174-9a0f-47ec-b0ea-5c9039b6ea2c nodeName:}" failed. No retries permitted until 2026-09-09 20:40:43.553551448 +0000 UTC m=+503.798380006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-cert") pod "odh-model-controller-7998c67dc4-qcjdv" (UID: "859a7174-9a0f-47ec-b0ea-5c9039b6ea2c") : secret "odh-model-controller-webhook-cert" not found
Sep 09 20:40:43.061938 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.061908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjd27\" (UniqueName: \"kubernetes.io/projected/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-kube-api-access-gjd27\") pod \"odh-model-controller-7998c67dc4-qcjdv\" (UID: \"859a7174-9a0f-47ec-b0ea-5c9039b6ea2c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:40:43.350601 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.350565    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4vv59"]
Sep 09 20:40:43.354160 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.354139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4vv59"
Sep 09 20:40:43.356115 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.356086    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 20:40:43.356218 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.356134    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-fwwj9\""
Sep 09 20:40:43.363895 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.363867    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4vv59"]
Sep 09 20:40:43.456529 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.456493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7a75abd-e205-466d-90c5-7c51ca86911b-tls-certs\") pod \"model-serving-api-54d89bd5fc-4vv59\" (UID: \"c7a75abd-e205-466d-90c5-7c51ca86911b\") " pod="opendatahub/model-serving-api-54d89bd5fc-4vv59"
Sep 09 20:40:43.456704 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.456548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9rrl\" (UniqueName: \"kubernetes.io/projected/c7a75abd-e205-466d-90c5-7c51ca86911b-kube-api-access-d9rrl\") pod \"model-serving-api-54d89bd5fc-4vv59\" (UID: \"c7a75abd-e205-466d-90c5-7c51ca86911b\") " pod="opendatahub/model-serving-api-54d89bd5fc-4vv59"
Sep 09 20:40:43.557405 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.557359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-cert\") pod \"odh-model-controller-7998c67dc4-qcjdv\" (UID: \"859a7174-9a0f-47ec-b0ea-5c9039b6ea2c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:40:43.557604 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.557422    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7a75abd-e205-466d-90c5-7c51ca86911b-tls-certs\") pod \"model-serving-api-54d89bd5fc-4vv59\" (UID: \"c7a75abd-e205-466d-90c5-7c51ca86911b\") " pod="opendatahub/model-serving-api-54d89bd5fc-4vv59"
Sep 09 20:40:43.557604 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.557483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9rrl\" (UniqueName: \"kubernetes.io/projected/c7a75abd-e205-466d-90c5-7c51ca86911b-kube-api-access-d9rrl\") pod \"model-serving-api-54d89bd5fc-4vv59\" (UID: \"c7a75abd-e205-466d-90c5-7c51ca86911b\") " pod="opendatahub/model-serving-api-54d89bd5fc-4vv59"
Sep 09 20:40:43.557604 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:40:43.557518    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 09 20:40:43.557604 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:40:43.557582    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a75abd-e205-466d-90c5-7c51ca86911b-tls-certs podName:c7a75abd-e205-466d-90c5-7c51ca86911b nodeName:}" failed. No retries permitted until 2026-09-09 20:40:44.057557236 +0000 UTC m=+504.302385810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c7a75abd-e205-466d-90c5-7c51ca86911b-tls-certs") pod "model-serving-api-54d89bd5fc-4vv59" (UID: "c7a75abd-e205-466d-90c5-7c51ca86911b") : secret "model-serving-api-tls" not found
Sep 09 20:40:43.557825 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:40:43.557651    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 09 20:40:43.557825 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:40:43.557704    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-cert podName:859a7174-9a0f-47ec-b0ea-5c9039b6ea2c nodeName:}" failed. No retries permitted until 2026-09-09 20:40:44.557691876 +0000 UTC m=+504.802520433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-cert") pod "odh-model-controller-7998c67dc4-qcjdv" (UID: "859a7174-9a0f-47ec-b0ea-5c9039b6ea2c") : secret "odh-model-controller-webhook-cert" not found
Sep 09 20:40:43.568588 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:43.568558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9rrl\" (UniqueName: \"kubernetes.io/projected/c7a75abd-e205-466d-90c5-7c51ca86911b-kube-api-access-d9rrl\") pod \"model-serving-api-54d89bd5fc-4vv59\" (UID: \"c7a75abd-e205-466d-90c5-7c51ca86911b\") " pod="opendatahub/model-serving-api-54d89bd5fc-4vv59"
Sep 09 20:40:44.061151 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:44.061115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7a75abd-e205-466d-90c5-7c51ca86911b-tls-certs\") pod \"model-serving-api-54d89bd5fc-4vv59\" (UID: \"c7a75abd-e205-466d-90c5-7c51ca86911b\") " pod="opendatahub/model-serving-api-54d89bd5fc-4vv59"
Sep 09 20:40:44.063785 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:44.063755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7a75abd-e205-466d-90c5-7c51ca86911b-tls-certs\") pod \"model-serving-api-54d89bd5fc-4vv59\" (UID: \"c7a75abd-e205-466d-90c5-7c51ca86911b\") " pod="opendatahub/model-serving-api-54d89bd5fc-4vv59"
Sep 09 20:40:44.265897 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:44.265861    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4vv59"
Sep 09 20:40:44.544886 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:44.544739    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4vv59"]
Sep 09 20:40:44.547516 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:40:44.547488    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a75abd_e205_466d_90c5_7c51ca86911b.slice/crio-ded74a4ce9a1199b8e1f8f7b55b475fc22beb6d70780f11f54855fa31c84bee6 WatchSource:0}: Error finding container ded74a4ce9a1199b8e1f8f7b55b475fc22beb6d70780f11f54855fa31c84bee6: Status 404 returned error can't find the container with id ded74a4ce9a1199b8e1f8f7b55b475fc22beb6d70780f11f54855fa31c84bee6
Sep 09 20:40:44.565769 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:44.565747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-cert\") pod \"odh-model-controller-7998c67dc4-qcjdv\" (UID: \"859a7174-9a0f-47ec-b0ea-5c9039b6ea2c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:40:44.567979 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:44.567952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/859a7174-9a0f-47ec-b0ea-5c9039b6ea2c-cert\") pod \"odh-model-controller-7998c67dc4-qcjdv\" (UID: \"859a7174-9a0f-47ec-b0ea-5c9039b6ea2c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:40:44.634172 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:44.634108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4vv59" event={"ID":"c7a75abd-e205-466d-90c5-7c51ca86911b","Type":"ContainerStarted","Data":"ded74a4ce9a1199b8e1f8f7b55b475fc22beb6d70780f11f54855fa31c84bee6"}
Sep 09 20:40:44.641203 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:44.641186    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:40:44.912552 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:44.912475    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qcjdv"]
Sep 09 20:40:44.916108 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:40:44.916077    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859a7174_9a0f_47ec_b0ea_5c9039b6ea2c.slice/crio-a9b99e924f651fdab80b4809c819de82f96ac6ab6942ce3482052ebaa24a62b7 WatchSource:0}: Error finding container a9b99e924f651fdab80b4809c819de82f96ac6ab6942ce3482052ebaa24a62b7: Status 404 returned error can't find the container with id a9b99e924f651fdab80b4809c819de82f96ac6ab6942ce3482052ebaa24a62b7
Sep 09 20:40:45.640958 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:45.640924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv" event={"ID":"859a7174-9a0f-47ec-b0ea-5c9039b6ea2c","Type":"ContainerStarted","Data":"a9b99e924f651fdab80b4809c819de82f96ac6ab6942ce3482052ebaa24a62b7"}
Sep 09 20:40:49.665992 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:49.665952    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4vv59" event={"ID":"c7a75abd-e205-466d-90c5-7c51ca86911b","Type":"ContainerStarted","Data":"4ee1fd28ebbc17f23610f6c9701995c9b8ffaecce0f5d51cf50f72e232a19cdf"}
Sep 09 20:40:49.666477 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:49.666122    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-4vv59"
Sep 09 20:40:49.667580 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:49.667555    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv" event={"ID":"859a7174-9a0f-47ec-b0ea-5c9039b6ea2c","Type":"ContainerStarted","Data":"b96378ee7d55c5db49a91f2347660a78e0981e3d34e5b5264a4414148accfac7"}
Sep 09 20:40:49.667713 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:49.667695    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:40:49.702765 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:49.702723    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-4vv59" podStartSLOduration=2.622480677 podStartE2EDuration="6.702710478s" totalImagesPullingTime="4.080229801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:40:49.701497095 +0000 UTC m=+509.946325690" watchObservedRunningTime="2026-09-09 20:40:49.702710478 +0000 UTC m=+509.947539058"
Sep 09 20:40:49.740365 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:49.740323    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv" podStartSLOduration=3.968126759 podStartE2EDuration="7.740309224s" totalImagesPullingTime="3.772182465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:40:49.737783198 +0000 UTC m=+509.982611778" watchObservedRunningTime="2026-09-09 20:40:49.740309224 +0000 UTC m=+509.985137804"
Sep 09 20:40:50.273671 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.273633    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"]
Sep 09 20:40:50.280365 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.280339    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.285528 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.285504    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 20:40:50.285642 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.285521    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 20:40:50.285642 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.285511    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b2crw\""
Sep 09 20:40:50.286351 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.286331    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 20:40:50.286632 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.286618    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 20:40:50.305146 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.305126    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"]
Sep 09 20:40:50.419691 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.419659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.419852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.419697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dde0acaa-abc2-461f-b484-0d0c2ca231ed-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.419852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.419715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.419852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.419733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dde0acaa-abc2-461f-b484-0d0c2ca231ed-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.419852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.419747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.419852 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.419836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt85k\" (UniqueName: \"kubernetes.io/projected/dde0acaa-abc2-461f-b484-0d0c2ca231ed-kube-api-access-qt85k\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.420012 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.419873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.521202 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.521161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.521384 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.521206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dde0acaa-abc2-461f-b484-0d0c2ca231ed-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.521384 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.521319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.521384 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.521356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dde0acaa-abc2-461f-b484-0d0c2ca231ed-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.521384 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.521373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.521592 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.521421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt85k\" (UniqueName: \"kubernetes.io/projected/dde0acaa-abc2-461f-b484-0d0c2ca231ed-kube-api-access-qt85k\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.521592 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.521464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.522008 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.521981    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.523724 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.523663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.523724 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.523665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dde0acaa-abc2-461f-b484-0d0c2ca231ed-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.523724 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.523673    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dde0acaa-abc2-461f-b484-0d0c2ca231ed-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.523863 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.523757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.528912 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.528890    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dde0acaa-abc2-461f-b484-0d0c2ca231ed-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.529284 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.529265    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt85k\" (UniqueName: \"kubernetes.io/projected/dde0acaa-abc2-461f-b484-0d0c2ca231ed-kube-api-access-qt85k\") pod \"istiod-openshift-gateway-5677ccb49b-4lrb5\" (UID: \"dde0acaa-abc2-461f-b484-0d0c2ca231ed\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.590142 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.590116    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:50.899079 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:50.898879    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"]
Sep 09 20:40:50.902114 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:40:50.902084    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde0acaa_abc2_461f_b484_0d0c2ca231ed.slice/crio-38f54bcb9e45c5021cef7f4c4dbec82498dbb59877a73dbe3fdbbeba519bc31a WatchSource:0}: Error finding container 38f54bcb9e45c5021cef7f4c4dbec82498dbb59877a73dbe3fdbbeba519bc31a: Status 404 returned error can't find the container with id 38f54bcb9e45c5021cef7f4c4dbec82498dbb59877a73dbe3fdbbeba519bc31a
Sep 09 20:40:51.684699 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:51.684645    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5" event={"ID":"dde0acaa-abc2-461f-b484-0d0c2ca231ed","Type":"ContainerStarted","Data":"38f54bcb9e45c5021cef7f4c4dbec82498dbb59877a73dbe3fdbbeba519bc31a"}
Sep 09 20:40:53.448656 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:53.448615    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 20:40:53.448902 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:53.448687    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 20:40:53.696772 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:53.696689    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5" event={"ID":"dde0acaa-abc2-461f-b484-0d0c2ca231ed","Type":"ContainerStarted","Data":"68f289934e52ad2325602c52ca0cd8ace01232fe664e7c7d42ea44cf2bbb2790"}
Sep 09 20:40:53.696772 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:53.696754    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:40:53.730563 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:53.730513    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5" podStartSLOduration=1.18655629 podStartE2EDuration="3.730498632s" totalImagesPullingTime="2.543942342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:40:53.728420833 +0000 UTC m=+513.973249412" watchObservedRunningTime="2026-09-09 20:40:53.730498632 +0000 UTC m=+513.975327211"
Sep 09 20:40:54.704208 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:40:54.704173    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5"
Sep 09 20:41:00.675556 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:41:00.675521    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-qcjdv"
Sep 09 20:41:00.678259 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:41:00.678235    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-4vv59"
Sep 09 20:42:20.218929 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:42:20.218899    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:42:20.221350 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:42:20.221325    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:42:20.226872 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:42:20.226851    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:42:20.229316 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:42:20.229293    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:43:08.193660 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.193625    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dbhqb"]
Sep 09 20:43:08.197118 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.197097    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:08.199298 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.199275    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 20:43:08.199397 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.199339    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 20:43:08.199777 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.199760    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 20:43:08.199821 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.199783    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nm6fs\""
Sep 09 20:43:08.207284 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.207261    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dbhqb"]
Sep 09 20:43:08.297709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.297678    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dbhqb"]
Sep 09 20:43:08.322904 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.322875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk6hk\" (UniqueName: \"kubernetes.io/projected/089f735b-ceea-4879-9eeb-4daaebdf09e8-kube-api-access-rk6hk\") pod \"limitador-limitador-8588749977-dbhqb\" (UID: \"089f735b-ceea-4879-9eeb-4daaebdf09e8\") " pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:08.322904 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.322906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/089f735b-ceea-4879-9eeb-4daaebdf09e8-config-file\") pod \"limitador-limitador-8588749977-dbhqb\" (UID: \"089f735b-ceea-4879-9eeb-4daaebdf09e8\") " pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:08.423873 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.423840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk6hk\" (UniqueName: \"kubernetes.io/projected/089f735b-ceea-4879-9eeb-4daaebdf09e8-kube-api-access-rk6hk\") pod \"limitador-limitador-8588749977-dbhqb\" (UID: \"089f735b-ceea-4879-9eeb-4daaebdf09e8\") " pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:08.424074 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.423883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/089f735b-ceea-4879-9eeb-4daaebdf09e8-config-file\") pod \"limitador-limitador-8588749977-dbhqb\" (UID: \"089f735b-ceea-4879-9eeb-4daaebdf09e8\") " pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:08.424576 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.424556    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/089f735b-ceea-4879-9eeb-4daaebdf09e8-config-file\") pod \"limitador-limitador-8588749977-dbhqb\" (UID: \"089f735b-ceea-4879-9eeb-4daaebdf09e8\") " pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:08.432912 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.432888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk6hk\" (UniqueName: \"kubernetes.io/projected/089f735b-ceea-4879-9eeb-4daaebdf09e8-kube-api-access-rk6hk\") pod \"limitador-limitador-8588749977-dbhqb\" (UID: \"089f735b-ceea-4879-9eeb-4daaebdf09e8\") " pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:08.508524 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.508461    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:08.784130 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:08.784031    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dbhqb"]
Sep 09 20:43:08.786489 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:43:08.786463    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod089f735b_ceea_4879_9eeb_4daaebdf09e8.slice/crio-3346cdcf433e4c4e7be7df2c0b03c4f0ef0bf3d6d9563db86483c75b33aad279 WatchSource:0}: Error finding container 3346cdcf433e4c4e7be7df2c0b03c4f0ef0bf3d6d9563db86483c75b33aad279: Status 404 returned error can't find the container with id 3346cdcf433e4c4e7be7df2c0b03c4f0ef0bf3d6d9563db86483c75b33aad279
Sep 09 20:43:09.316575 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:09.316538    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb" event={"ID":"089f735b-ceea-4879-9eeb-4daaebdf09e8","Type":"ContainerStarted","Data":"3346cdcf433e4c4e7be7df2c0b03c4f0ef0bf3d6d9563db86483c75b33aad279"}
Sep 09 20:43:12.333642 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:12.333601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb" event={"ID":"089f735b-ceea-4879-9eeb-4daaebdf09e8","Type":"ContainerStarted","Data":"00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa"}
Sep 09 20:43:12.334009 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:12.333714    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:12.349634 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:12.349591    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb" podStartSLOduration=1.6013486239999999 podStartE2EDuration="4.3495746s" totalImagesPullingTime="2.748225976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:43:12.348655237 +0000 UTC m=+652.593483828" watchObservedRunningTime="2026-09-09 20:43:12.3495746 +0000 UTC m=+652.594403182"
Sep 09 20:43:22.747141 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:22.747102    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dbhqb"]
Sep 09 20:43:22.747566 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:22.747293    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb" podUID="089f735b-ceea-4879-9eeb-4daaebdf09e8" containerName="limitador" containerID="cri-o://00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa" gracePeriod=30
Sep 09 20:43:22.748015 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:22.747967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:23.292010 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.291984    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:23.333252 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.333178    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/089f735b-ceea-4879-9eeb-4daaebdf09e8-config-file\") pod \"089f735b-ceea-4879-9eeb-4daaebdf09e8\" (UID: \"089f735b-ceea-4879-9eeb-4daaebdf09e8\") "
Sep 09 20:43:23.333504 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.333482    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/089f735b-ceea-4879-9eeb-4daaebdf09e8-config-file" (OuterVolumeSpecName: "config-file") pod "089f735b-ceea-4879-9eeb-4daaebdf09e8" (UID: "089f735b-ceea-4879-9eeb-4daaebdf09e8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:43:23.386014 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.385981    2576 generic.go:356] "Generic (PLEG): container finished" podID="089f735b-ceea-4879-9eeb-4daaebdf09e8" containerID="00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa" exitCode=0
Sep 09 20:43:23.386197 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.386024    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb" event={"ID":"089f735b-ceea-4879-9eeb-4daaebdf09e8","Type":"ContainerDied","Data":"00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa"}
Sep 09 20:43:23.386197 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.386032    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb"
Sep 09 20:43:23.386197 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.386116    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-dbhqb" event={"ID":"089f735b-ceea-4879-9eeb-4daaebdf09e8","Type":"ContainerDied","Data":"3346cdcf433e4c4e7be7df2c0b03c4f0ef0bf3d6d9563db86483c75b33aad279"}
Sep 09 20:43:23.386197 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.386140    2576 scope.go:117] "RemoveContainer" containerID="00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa"
Sep 09 20:43:23.394262 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.394242    2576 scope.go:117] "RemoveContainer" containerID="00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa"
Sep 09 20:43:23.394538 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:43:23.394517    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa\": container with ID starting with 00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa not found: ID does not exist" containerID="00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa"
Sep 09 20:43:23.394605 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.394552    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa"} err="failed to get container status \"00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa\": rpc error: code = NotFound desc = could not find container \"00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa\": container with ID starting with 00be38fb32f530f0b418cef480bac8d07515e86b5f8863fc2a2b0a7fdf69c6aa not found: ID does not exist"
Sep 09 20:43:23.433903 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.433875    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk6hk\" (UniqueName: \"kubernetes.io/projected/089f735b-ceea-4879-9eeb-4daaebdf09e8-kube-api-access-rk6hk\") pod \"089f735b-ceea-4879-9eeb-4daaebdf09e8\" (UID: \"089f735b-ceea-4879-9eeb-4daaebdf09e8\") "
Sep 09 20:43:23.434033 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.434008    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/089f735b-ceea-4879-9eeb-4daaebdf09e8-config-file\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:43:23.435975 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.435951    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/089f735b-ceea-4879-9eeb-4daaebdf09e8-kube-api-access-rk6hk" (OuterVolumeSpecName: "kube-api-access-rk6hk") pod "089f735b-ceea-4879-9eeb-4daaebdf09e8" (UID: "089f735b-ceea-4879-9eeb-4daaebdf09e8"). InnerVolumeSpecName "kube-api-access-rk6hk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:43:23.534878 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.534847    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk6hk\" (UniqueName: \"kubernetes.io/projected/089f735b-ceea-4879-9eeb-4daaebdf09e8-kube-api-access-rk6hk\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:43:23.707405 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.707379    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dbhqb"]
Sep 09 20:43:23.711479 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:23.711458    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-dbhqb"]
Sep 09 20:43:24.283251 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:24.283217    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="089f735b-ceea-4879-9eeb-4daaebdf09e8" path="/var/lib/kubelet/pods/089f735b-ceea-4879-9eeb-4daaebdf09e8/volumes"
Sep 09 20:43:28.625158 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.625122    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"]
Sep 09 20:43:28.625623 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.625604    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="089f735b-ceea-4879-9eeb-4daaebdf09e8" containerName="limitador"
Sep 09 20:43:28.625673 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.625624    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="089f735b-ceea-4879-9eeb-4daaebdf09e8" containerName="limitador"
Sep 09 20:43:28.625748 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.625707    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="089f735b-ceea-4879-9eeb-4daaebdf09e8" containerName="limitador"
Sep 09 20:43:28.630378 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.630355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"
Sep 09 20:43:28.636084 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.636045    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 09 20:43:28.636084 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.636073    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 20:43:28.636272 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.636110    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jsbrc\""
Sep 09 20:43:28.636692 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.636678    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 20:43:28.642371 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.642350    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"]
Sep 09 20:43:28.670934 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.670900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44jhp\" (UniqueName: \"kubernetes.io/projected/41a41bca-8d05-49dd-a79f-9ca665caef45-kube-api-access-44jhp\") pod \"postgres-69fb4594cf-zvqq6\" (UID: \"41a41bca-8d05-49dd-a79f-9ca665caef45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"
Sep 09 20:43:28.671118 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.670973    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/41a41bca-8d05-49dd-a79f-9ca665caef45-data\") pod \"postgres-69fb4594cf-zvqq6\" (UID: \"41a41bca-8d05-49dd-a79f-9ca665caef45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"
Sep 09 20:43:28.771569 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.771534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/41a41bca-8d05-49dd-a79f-9ca665caef45-data\") pod \"postgres-69fb4594cf-zvqq6\" (UID: \"41a41bca-8d05-49dd-a79f-9ca665caef45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"
Sep 09 20:43:28.771739 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.771580    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44jhp\" (UniqueName: \"kubernetes.io/projected/41a41bca-8d05-49dd-a79f-9ca665caef45-kube-api-access-44jhp\") pod \"postgres-69fb4594cf-zvqq6\" (UID: \"41a41bca-8d05-49dd-a79f-9ca665caef45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"
Sep 09 20:43:28.771918 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.771900    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/41a41bca-8d05-49dd-a79f-9ca665caef45-data\") pod \"postgres-69fb4594cf-zvqq6\" (UID: \"41a41bca-8d05-49dd-a79f-9ca665caef45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"
Sep 09 20:43:28.779367 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.779346    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44jhp\" (UniqueName: \"kubernetes.io/projected/41a41bca-8d05-49dd-a79f-9ca665caef45-kube-api-access-44jhp\") pod \"postgres-69fb4594cf-zvqq6\" (UID: \"41a41bca-8d05-49dd-a79f-9ca665caef45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"
Sep 09 20:43:28.940700 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:28.940603    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"
Sep 09 20:43:29.208665 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:29.208639    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"]
Sep 09 20:43:29.211415 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:43:29.211390    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a41bca_8d05_49dd_a79f_9ca665caef45.slice/crio-c86b79a9a37a5f30903454843072762c9fbf4c848909653937bd39e6b5fb5647 WatchSource:0}: Error finding container c86b79a9a37a5f30903454843072762c9fbf4c848909653937bd39e6b5fb5647: Status 404 returned error can't find the container with id c86b79a9a37a5f30903454843072762c9fbf4c848909653937bd39e6b5fb5647
Sep 09 20:43:29.416371 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:29.416339    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6" event={"ID":"41a41bca-8d05-49dd-a79f-9ca665caef45","Type":"ContainerStarted","Data":"c86b79a9a37a5f30903454843072762c9fbf4c848909653937bd39e6b5fb5647"}
Sep 09 20:43:34.445575 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:34.445496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6" event={"ID":"41a41bca-8d05-49dd-a79f-9ca665caef45","Type":"ContainerStarted","Data":"a4138479b7ab7121055ffd0e432d17d5065cde779b47e93fe077130061e865ac"}
Sep 09 20:43:34.445899 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:34.445578    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"
Sep 09 20:43:34.463077 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:34.463001    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6" podStartSLOduration=1.6350696340000002 podStartE2EDuration="6.462986427s" totalImagesPullingTime="4.827916793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:43:34.460652175 +0000 UTC m=+674.705480754" watchObservedRunningTime="2026-09-09 20:43:34.462986427 +0000 UTC m=+674.707815007"
Sep 09 20:43:40.479068 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:43:40.479027    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zvqq6"
Sep 09 20:44:24.812638 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:24.812605    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"]
Sep 09 20:44:24.816748 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:24.816730    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"
Sep 09 20:44:24.819271 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:24.819253    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 09 20:44:24.819474 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:24.819448    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-l4zps\""
Sep 09 20:44:24.825257 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:24.825233    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"]
Sep 09 20:44:24.845849 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:24.845817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8cef09e-03d5-4102-8c13-73e2c5a96941-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8prfq\" (UID: \"c8cef09e-03d5-4102-8c13-73e2c5a96941\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"
Sep 09 20:44:24.845958 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:24.845905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s67th\" (UniqueName: \"kubernetes.io/projected/c8cef09e-03d5-4102-8c13-73e2c5a96941-kube-api-access-s67th\") pod \"payload-pre-processing-59fbc47bf8-8prfq\" (UID: \"c8cef09e-03d5-4102-8c13-73e2c5a96941\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"
Sep 09 20:44:24.946915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:24.946866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8cef09e-03d5-4102-8c13-73e2c5a96941-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8prfq\" (UID: \"c8cef09e-03d5-4102-8c13-73e2c5a96941\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"
Sep 09 20:44:24.947096 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:24.946977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s67th\" (UniqueName: \"kubernetes.io/projected/c8cef09e-03d5-4102-8c13-73e2c5a96941-kube-api-access-s67th\") pod \"payload-pre-processing-59fbc47bf8-8prfq\" (UID: \"c8cef09e-03d5-4102-8c13-73e2c5a96941\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"
Sep 09 20:44:24.947857 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:24.947832    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8cef09e-03d5-4102-8c13-73e2c5a96941-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8prfq\" (UID: \"c8cef09e-03d5-4102-8c13-73e2c5a96941\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"
Sep 09 20:44:24.954416 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:24.954396    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s67th\" (UniqueName: \"kubernetes.io/projected/c8cef09e-03d5-4102-8c13-73e2c5a96941-kube-api-access-s67th\") pod \"payload-pre-processing-59fbc47bf8-8prfq\" (UID: \"c8cef09e-03d5-4102-8c13-73e2c5a96941\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"
Sep 09 20:44:25.127719 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:25.127631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"
Sep 09 20:44:25.400669 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:25.400640    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"]
Sep 09 20:44:25.403928 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:44:25.403903    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8cef09e_03d5_4102_8c13_73e2c5a96941.slice/crio-4d7db59f076e4e510a6eb101a936d20377eeb7fe5d105bf35f185f00578016ea WatchSource:0}: Error finding container 4d7db59f076e4e510a6eb101a936d20377eeb7fe5d105bf35f185f00578016ea: Status 404 returned error can't find the container with id 4d7db59f076e4e510a6eb101a936d20377eeb7fe5d105bf35f185f00578016ea
Sep 09 20:44:25.405959 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:25.405942    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:44:25.680612 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:25.680529    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq" event={"ID":"c8cef09e-03d5-4102-8c13-73e2c5a96941","Type":"ContainerStarted","Data":"4d7db59f076e4e510a6eb101a936d20377eeb7fe5d105bf35f185f00578016ea"}
Sep 09 20:44:27.692986 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:27.692881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq" event={"ID":"c8cef09e-03d5-4102-8c13-73e2c5a96941","Type":"ContainerStarted","Data":"8eefc2693abde5bc0751971d515e50ec0b5eddf5ba9adea3b57845d3e900c3b4"}
Sep 09 20:44:27.693410 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:27.693069    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"
Sep 09 20:44:27.709980 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:27.709933    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq" podStartSLOduration=1.802215012 podStartE2EDuration="3.709920805s" totalImagesPullingTime="1.907705793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:44:27.708008927 +0000 UTC m=+727.952837709" watchObservedRunningTime="2026-09-09 20:44:27.709920805 +0000 UTC m=+727.954749385"
Sep 09 20:44:38.699816 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:38.699785    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq"
Sep 09 20:44:46.697631 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.697594    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"]
Sep 09 20:44:46.701232 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.701214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.703344 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.703327    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 20:44:46.703344 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.703331    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 20:44:46.703987 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.703968    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ddfsp\""
Sep 09 20:44:46.704103 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.703986    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 09 20:44:46.710474 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.710453    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"]
Sep 09 20:44:46.822861 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.822829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.823015 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.822867    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.823015 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.822888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.823015 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.822990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.823152 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.823020    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj7dz\" (UniqueName: \"kubernetes.io/projected/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-kube-api-access-pj7dz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.823152 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.823083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.924180 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.924145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.924331 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.924190    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.924331 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.924209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.924331 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.924251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.924331 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.924273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj7dz\" (UniqueName: \"kubernetes.io/projected/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-kube-api-access-pj7dz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.924331 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.924310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.924676 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.924642    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.924676 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.924668    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.924841 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.924687    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.926455 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.926429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.926614 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.926595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:46.932244 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:46.932221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj7dz\" (UniqueName: \"kubernetes.io/projected/a9fe94d4-6e62-4a93-9cfc-c7d2d16667af-kube-api-access-pj7dz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf\" (UID: \"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:47.011775 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:47.011713    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:47.284239 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:47.284216    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"]
Sep 09 20:44:47.286474 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:44:47.286446    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9fe94d4_6e62_4a93_9cfc_c7d2d16667af.slice/crio-5951a0b11ac24ebbbfb561cb7b87093b4e104e4528ceb4aedf23f814bda0291f WatchSource:0}: Error finding container 5951a0b11ac24ebbbfb561cb7b87093b4e104e4528ceb4aedf23f814bda0291f: Status 404 returned error can't find the container with id 5951a0b11ac24ebbbfb561cb7b87093b4e104e4528ceb4aedf23f814bda0291f
Sep 09 20:44:47.794548 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:47.794511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf" event={"ID":"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af","Type":"ContainerStarted","Data":"5951a0b11ac24ebbbfb561cb7b87093b4e104e4528ceb4aedf23f814bda0291f"}
Sep 09 20:44:48.800558 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:48.800524    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf" event={"ID":"a9fe94d4-6e62-4a93-9cfc-c7d2d16667af","Type":"ContainerStarted","Data":"b0e7eeab55d8f9c9ea3c65fb70f94d0d81cdb54e01c891d46ead2deac3488b68"}
Sep 09 20:44:48.819675 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:48.819628    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf" podStartSLOduration=1.80637734 podStartE2EDuration="2.8196132s" totalImagesPullingTime="1.01323586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:44:48.818105563 +0000 UTC m=+749.062934140" watchObservedRunningTime="2026-09-09 20:44:48.8196132 +0000 UTC m=+749.064441779"
Sep 09 20:44:57.012235 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:57.012199    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:57.012717 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:57.012496    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:57.024915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:57.024893    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:44:57.853235 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:44:57.853207    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf"
Sep 09 20:45:28.692110 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.692063    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"]
Sep 09 20:45:28.695833 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.695815    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.698200 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.698179    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 09 20:45:28.703997 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.703977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"]
Sep 09 20:45:28.776941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.776914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.776941 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.776945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24gvm\" (UniqueName: \"kubernetes.io/projected/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-kube-api-access-24gvm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.777163 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.776974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.777163 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.777047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.777163 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.777102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.777163 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.777129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.878459 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.878429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.878590 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.878463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24gvm\" (UniqueName: \"kubernetes.io/projected/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-kube-api-access-24gvm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.878590 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.878496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.878590 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.878554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.878590 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.878585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.878769 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.878719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.878900 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.878878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.878973 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.878956    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.879041 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.879021    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.880743 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.880723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.880961 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.880945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:28.885731 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:28.885709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24gvm\" (UniqueName: \"kubernetes.io/projected/d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c-kube-api-access-24gvm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd\" (UID: \"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:29.007752 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:29.007685    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:29.282696 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:29.282671    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"]
Sep 09 20:45:29.284704 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:45:29.284680    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91e6d65_4fa2_4f97_bc49_bfd2ca5b025c.slice/crio-1f33d4d0ab69a386632ed561ca6d9e206f74e4f1671683e79c93f72e58ed3102 WatchSource:0}: Error finding container 1f33d4d0ab69a386632ed561ca6d9e206f74e4f1671683e79c93f72e58ed3102: Status 404 returned error can't find the container with id 1f33d4d0ab69a386632ed561ca6d9e206f74e4f1671683e79c93f72e58ed3102
Sep 09 20:45:30.001384 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:30.001293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd" event={"ID":"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c","Type":"ContainerStarted","Data":"d9478759419a0eaf40ac0aae6175dac62724d46306ff51d7c4890e14ddb8410f"}
Sep 09 20:45:30.001384 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:30.001350    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd" event={"ID":"d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c","Type":"ContainerStarted","Data":"1f33d4d0ab69a386632ed561ca6d9e206f74e4f1671683e79c93f72e58ed3102"}
Sep 09 20:45:30.020378 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:30.020326    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd" podStartSLOduration=1.72287682 podStartE2EDuration="2.020310921s" totalImagesPullingTime="297.434101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:45:30.01902242 +0000 UTC m=+790.263850992" watchObservedRunningTime="2026-09-09 20:45:30.020310921 +0000 UTC m=+790.265139500"
Sep 09 20:45:39.008610 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:39.008569    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:39.009087 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:39.008659    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:39.021031 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:39.021002    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:39.057719 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:39.057693    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd"
Sep 09 20:45:41.786211 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.786179    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"]
Sep 09 20:45:41.790114 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.790090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.792205 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.792184    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 09 20:45:41.797858 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.797835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"]
Sep 09 20:45:41.888114 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.888077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.888254 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.888181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.888254 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.888226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.888417 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.888253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.888417 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.888293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jgvf\" (UniqueName: \"kubernetes.io/projected/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-kube-api-access-5jgvf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.888417 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.888365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.989563 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.989532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.989724 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.989569    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jgvf\" (UniqueName: \"kubernetes.io/projected/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-kube-api-access-5jgvf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.989724 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.989589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.989724 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.989608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.989724 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.989690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.989933 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.989750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.990005 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.989945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.990071 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.990015    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.990118 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.990047    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.991685 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.991663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.991946 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.991928    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:41.997283 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:41.997261    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jgvf\" (UniqueName: \"kubernetes.io/projected/0c3f81b4-57dc-40ae-bf95-66c7d47a3748-kube-api-access-5jgvf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ztp9m\" (UID: \"0c3f81b4-57dc-40ae-bf95-66c7d47a3748\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:42.102988 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:42.102920    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:42.370161 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:42.370128    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"]
Sep 09 20:45:42.372354 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:45:42.372324    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3f81b4_57dc_40ae_bf95_66c7d47a3748.slice/crio-abdfc8f849dda3d8a5ae5092e2238d557a81601f2987f1da9cf83ba56710a589 WatchSource:0}: Error finding container abdfc8f849dda3d8a5ae5092e2238d557a81601f2987f1da9cf83ba56710a589: Status 404 returned error can't find the container with id abdfc8f849dda3d8a5ae5092e2238d557a81601f2987f1da9cf83ba56710a589
Sep 09 20:45:43.067679 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:43.067645    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m" event={"ID":"0c3f81b4-57dc-40ae-bf95-66c7d47a3748","Type":"ContainerStarted","Data":"590f3e0483e8f08cbe91b89a40a94ef680a8b5cfed6592263f5e6c89103a0205"}
Sep 09 20:45:43.068025 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:43.067726    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m" event={"ID":"0c3f81b4-57dc-40ae-bf95-66c7d47a3748","Type":"ContainerStarted","Data":"abdfc8f849dda3d8a5ae5092e2238d557a81601f2987f1da9cf83ba56710a589"}
Sep 09 20:45:43.084190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:43.084145    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m" podStartSLOduration=1.878006172 podStartE2EDuration="2.084130547s" totalImagesPullingTime="206.124375ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:45:43.082538553 +0000 UTC m=+803.327367133" watchObservedRunningTime="2026-09-09 20:45:43.084130547 +0000 UTC m=+803.328959128"
Sep 09 20:45:52.103931 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:52.103894    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:52.104379 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:52.103976    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:52.117022 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:52.116999    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:45:52.128182 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:45:52.128161    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ztp9m"
Sep 09 20:46:46.129431 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.129396    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"]
Sep 09 20:46:46.133224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.133206    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 20:46:46.144533 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.144509    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-933e9d-dockercfg-4hzv9\""
Sep 09 20:46:46.144634 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.144528    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-933e9d\""
Sep 09 20:46:46.154956 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.154932    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"]
Sep 09 20:46:46.243973 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.243932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52c2n\" (UniqueName: \"kubernetes.io/projected/7352d53b-51aa-41e4-bb66-c63217dd6bb8-kube-api-access-52c2n\") pod \"payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8\" (UID: \"7352d53b-51aa-41e4-bb66-c63217dd6bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 20:46:46.244326 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.244305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7352d53b-51aa-41e4-bb66-c63217dd6bb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8\" (UID: \"7352d53b-51aa-41e4-bb66-c63217dd6bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 20:46:46.345918 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.345883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7352d53b-51aa-41e4-bb66-c63217dd6bb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8\" (UID: \"7352d53b-51aa-41e4-bb66-c63217dd6bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 20:46:46.346076 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.345992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52c2n\" (UniqueName: \"kubernetes.io/projected/7352d53b-51aa-41e4-bb66-c63217dd6bb8-kube-api-access-52c2n\") pod \"payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8\" (UID: \"7352d53b-51aa-41e4-bb66-c63217dd6bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 20:46:46.346643 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.346625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7352d53b-51aa-41e4-bb66-c63217dd6bb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8\" (UID: \"7352d53b-51aa-41e4-bb66-c63217dd6bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 20:46:46.358522 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.358497    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52c2n\" (UniqueName: \"kubernetes.io/projected/7352d53b-51aa-41e4-bb66-c63217dd6bb8-kube-api-access-52c2n\") pod \"payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8\" (UID: \"7352d53b-51aa-41e4-bb66-c63217dd6bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 20:46:46.443559 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.443502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 20:46:46.727372 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:46.727347    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"]
Sep 09 20:46:46.729776 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:46:46.729751    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7352d53b_51aa_41e4_bb66_c63217dd6bb8.slice/crio-1d1f441cae700c9c521f9a18c07a86e3db11b8e8aac591a4a3b3d0803c54ef4e WatchSource:0}: Error finding container 1d1f441cae700c9c521f9a18c07a86e3db11b8e8aac591a4a3b3d0803c54ef4e: Status 404 returned error can't find the container with id 1d1f441cae700c9c521f9a18c07a86e3db11b8e8aac591a4a3b3d0803c54ef4e
Sep 09 20:46:47.381277 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.381238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8" event={"ID":"7352d53b-51aa-41e4-bb66-c63217dd6bb8","Type":"ContainerStarted","Data":"7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c"}
Sep 09 20:46:47.381638 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.381294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8" event={"ID":"7352d53b-51aa-41e4-bb66-c63217dd6bb8","Type":"ContainerStarted","Data":"1d1f441cae700c9c521f9a18c07a86e3db11b8e8aac591a4a3b3d0803c54ef4e"}
Sep 09 20:46:47.381638 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.381338    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 20:46:47.402144 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.402089    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8" podStartSLOduration=1.402046237 podStartE2EDuration="1.402046237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:46:47.401185941 +0000 UTC m=+867.646014586" watchObservedRunningTime="2026-09-09 20:46:47.402046237 +0000 UTC m=+867.646874810"
Sep 09 20:46:47.691095 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.691013    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"]
Sep 09 20:46:47.694708 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.694690    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:46:47.696717 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.696692    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-2b2343-dockercfg-bnz85\""
Sep 09 20:46:47.697211 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.697188    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-2b2343\""
Sep 09 20:46:47.706136 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.706108    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"]
Sep 09 20:46:47.857952 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.857922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0a480-cfab-47c4-9dde-44f6b16896e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z\" (UID: \"44e0a480-cfab-47c4-9dde-44f6b16896e9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:46:47.858130 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.858027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t2jm\" (UniqueName: \"kubernetes.io/projected/44e0a480-cfab-47c4-9dde-44f6b16896e9-kube-api-access-7t2jm\") pod \"payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z\" (UID: \"44e0a480-cfab-47c4-9dde-44f6b16896e9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:46:47.959342 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.959270    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0a480-cfab-47c4-9dde-44f6b16896e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z\" (UID: \"44e0a480-cfab-47c4-9dde-44f6b16896e9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:46:47.959476 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.959392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t2jm\" (UniqueName: \"kubernetes.io/projected/44e0a480-cfab-47c4-9dde-44f6b16896e9-kube-api-access-7t2jm\") pod \"payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z\" (UID: \"44e0a480-cfab-47c4-9dde-44f6b16896e9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:46:47.960038 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.960019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0a480-cfab-47c4-9dde-44f6b16896e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z\" (UID: \"44e0a480-cfab-47c4-9dde-44f6b16896e9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:46:47.968570 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:47.968542    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t2jm\" (UniqueName: \"kubernetes.io/projected/44e0a480-cfab-47c4-9dde-44f6b16896e9-kube-api-access-7t2jm\") pod \"payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z\" (UID: \"44e0a480-cfab-47c4-9dde-44f6b16896e9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:46:48.005832 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.005791    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:46:48.286094 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:46:48.286039    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e0a480_cfab_47c4_9dde_44f6b16896e9.slice/crio-a9a9ad2adeb87f34060c4bf123382d7a4a1c554b4e2f825aec26e10aab8d8cad WatchSource:0}: Error finding container a9a9ad2adeb87f34060c4bf123382d7a4a1c554b4e2f825aec26e10aab8d8cad: Status 404 returned error can't find the container with id a9a9ad2adeb87f34060c4bf123382d7a4a1c554b4e2f825aec26e10aab8d8cad
Sep 09 20:46:48.286606 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.286582    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"]
Sep 09 20:46:48.387793 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.387760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z" event={"ID":"44e0a480-cfab-47c4-9dde-44f6b16896e9","Type":"ContainerStarted","Data":"279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3"}
Sep 09 20:46:48.388263 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.387812    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z" event={"ID":"44e0a480-cfab-47c4-9dde-44f6b16896e9","Type":"ContainerStarted","Data":"a9a9ad2adeb87f34060c4bf123382d7a4a1c554b4e2f825aec26e10aab8d8cad"}
Sep 09 20:46:48.388263 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.387991    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:46:48.413986 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.413938    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z" podStartSLOduration=1.413921292 podStartE2EDuration="1.413921292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:46:48.412164455 +0000 UTC m=+868.656993035" watchObservedRunningTime="2026-09-09 20:46:48.413921292 +0000 UTC m=+868.658749872"
Sep 09 20:46:48.701687 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.701649    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"]
Sep 09 20:46:48.705173 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.705153    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:46:48.708194 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.708171    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-c7643f-dockercfg-fh2lr\""
Sep 09 20:46:48.708314 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.708197    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-c7643f\""
Sep 09 20:46:48.722560 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.722521    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"]
Sep 09 20:46:48.742724 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.742695    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"]
Sep 09 20:46:48.746018 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.745997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:46:48.764453 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.764421    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"]
Sep 09 20:46:48.866374 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.866336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpqln\" (UniqueName: \"kubernetes.io/projected/ec60401c-6bec-40d9-a3a3-213f833c96bc-kube-api-access-gpqln\") pod \"payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2\" (UID: \"ec60401c-6bec-40d9-a3a3-213f833c96bc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:46:48.866542 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.866396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec60401c-6bec-40d9-a3a3-213f833c96bc-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2\" (UID: \"ec60401c-6bec-40d9-a3a3-213f833c96bc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:46:48.866602 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.866572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999\" (UID: \"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:46:48.866642 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.866620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khh7j\" (UniqueName: \"kubernetes.io/projected/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-kube-api-access-khh7j\") pod \"payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999\" (UID: \"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:46:48.967709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.967631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999\" (UID: \"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:46:48.967709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.967671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khh7j\" (UniqueName: \"kubernetes.io/projected/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-kube-api-access-khh7j\") pod \"payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999\" (UID: \"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:46:48.967933 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.967721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqln\" (UniqueName: \"kubernetes.io/projected/ec60401c-6bec-40d9-a3a3-213f833c96bc-kube-api-access-gpqln\") pod \"payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2\" (UID: \"ec60401c-6bec-40d9-a3a3-213f833c96bc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:46:48.967933 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.967757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec60401c-6bec-40d9-a3a3-213f833c96bc-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2\" (UID: \"ec60401c-6bec-40d9-a3a3-213f833c96bc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:46:48.968502 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.968476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999\" (UID: \"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:46:48.968601 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.968507    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec60401c-6bec-40d9-a3a3-213f833c96bc-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2\" (UID: \"ec60401c-6bec-40d9-a3a3-213f833c96bc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:46:48.976866 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.976841    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khh7j\" (UniqueName: \"kubernetes.io/projected/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-kube-api-access-khh7j\") pod \"payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999\" (UID: \"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:46:48.977019 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:48.977000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpqln\" (UniqueName: \"kubernetes.io/projected/ec60401c-6bec-40d9-a3a3-213f833c96bc-kube-api-access-gpqln\") pod \"payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2\" (UID: \"ec60401c-6bec-40d9-a3a3-213f833c96bc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:46:49.016249 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:49.016226    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:46:49.057919 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:49.057887    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:46:49.295804 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:49.295777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"]
Sep 09 20:46:49.297800 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:46:49.297769    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e480df6_4fd2_40a5_9316_3d9c2f9c82c9.slice/crio-8d26b8e90442993c6d70a8f316437c08c4b55f586991f1c60e9ed443315d63a8 WatchSource:0}: Error finding container 8d26b8e90442993c6d70a8f316437c08c4b55f586991f1c60e9ed443315d63a8: Status 404 returned error can't find the container with id 8d26b8e90442993c6d70a8f316437c08c4b55f586991f1c60e9ed443315d63a8
Sep 09 20:46:49.345098 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:49.345070    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"]
Sep 09 20:46:49.347688 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:46:49.347665    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec60401c_6bec_40d9_a3a3_213f833c96bc.slice/crio-57a7b42fb5b790258e03e594ab510a208a220d9101de865aea30e3499aa32fe6 WatchSource:0}: Error finding container 57a7b42fb5b790258e03e594ab510a208a220d9101de865aea30e3499aa32fe6: Status 404 returned error can't find the container with id 57a7b42fb5b790258e03e594ab510a208a220d9101de865aea30e3499aa32fe6
Sep 09 20:46:49.395863 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:49.395838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2" event={"ID":"ec60401c-6bec-40d9-a3a3-213f833c96bc","Type":"ContainerStarted","Data":"57a7b42fb5b790258e03e594ab510a208a220d9101de865aea30e3499aa32fe6"}
Sep 09 20:46:49.397623 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:49.397586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999" event={"ID":"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9","Type":"ContainerStarted","Data":"c382d3110341404575e57fb24ac2124b9364cb00cfe277b4accba65a009350ba"}
Sep 09 20:46:49.397744 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:49.397640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999" event={"ID":"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9","Type":"ContainerStarted","Data":"8d26b8e90442993c6d70a8f316437c08c4b55f586991f1c60e9ed443315d63a8"}
Sep 09 20:46:49.397744 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:49.397705    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:46:49.420979 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:49.420929    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999" podStartSLOduration=1.420909582 podStartE2EDuration="1.420909582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:46:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:46:49.419661039 +0000 UTC m=+869.664489621" watchObservedRunningTime="2026-09-09 20:46:49.420909582 +0000 UTC m=+869.665738162"
Sep 09 20:46:50.405316 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:50.405282    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2" event={"ID":"ec60401c-6bec-40d9-a3a3-213f833c96bc","Type":"ContainerStarted","Data":"858438f562abbca614f21550d0dfb433588b5bf9a782a07de8e60c595f2f3f4f"}
Sep 09 20:46:50.429239 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:50.429188    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2" podStartSLOduration=2.429173455 podStartE2EDuration="2.429173455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:46:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:46:50.427124625 +0000 UTC m=+870.671953206" watchObservedRunningTime="2026-09-09 20:46:50.429173455 +0000 UTC m=+870.674002036"
Sep 09 20:46:51.410433 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:51.410394    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:46:54.584135 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.584101    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"]
Sep 09 20:46:54.587719 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.587699    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:54.590327 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.590301    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pzpjp\""
Sep 09 20:46:54.590454 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.590365    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-04f122cb-serving-cert\""
Sep 09 20:46:54.590802 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.590781    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 20:46:54.599691 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.599665    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"]
Sep 09 20:46:54.618007 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.617975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-metrics-certs\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:54.618130 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.618021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rzs5\" (UniqueName: \"kubernetes.io/projected/a80e313e-155e-41a1-b232-11d1277c757e-kube-api-access-7rzs5\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:54.618130 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.618107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80e313e-155e-41a1-b232-11d1277c757e-openshift-service-ca\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:54.618230 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.618162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-maas-api-tls\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:54.718622 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.718582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-metrics-certs\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:54.718832 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.718633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rzs5\" (UniqueName: \"kubernetes.io/projected/a80e313e-155e-41a1-b232-11d1277c757e-kube-api-access-7rzs5\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:54.718832 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.718670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80e313e-155e-41a1-b232-11d1277c757e-openshift-service-ca\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:54.718832 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.718715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-maas-api-tls\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:54.718994 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:46:54.718878    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-serving-cert: secret "maas-api-e2e-ait-04f122cb-serving-cert" not found
Sep 09 20:46:54.718994 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:46:54.718940    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-maas-api-tls podName:a80e313e-155e-41a1-b232-11d1277c757e nodeName:}" failed. No retries permitted until 2026-09-09 20:46:55.218924621 +0000 UTC m=+875.463753179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-maas-api-tls") pod "maas-api-e2e-ait-04f122cb-7b787769d-6jhp5" (UID: "a80e313e-155e-41a1-b232-11d1277c757e") : secret "maas-api-e2e-ait-04f122cb-serving-cert" not found
Sep 09 20:46:54.719488 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.719456    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80e313e-155e-41a1-b232-11d1277c757e-openshift-service-ca\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:54.722833 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.722806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-metrics-certs\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:54.727577 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:54.727556    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rzs5\" (UniqueName: \"kubernetes.io/projected/a80e313e-155e-41a1-b232-11d1277c757e-kube-api-access-7rzs5\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:55.221993 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:55.221961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-maas-api-tls\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:55.224498 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:55.224472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-maas-api-tls\") pod \"maas-api-e2e-ait-04f122cb-7b787769d-6jhp5\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:55.502036 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:55.501961    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:55.781463 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:55.781118    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"]
Sep 09 20:46:55.781943 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:46:55.781911    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80e313e_155e_41a1_b232_11d1277c757e.slice/crio-60183eaedf6ddc57ba7555e2bea51a9e5ae41f7b1d5c9289e6b7bb5d80d69c7b WatchSource:0}: Error finding container 60183eaedf6ddc57ba7555e2bea51a9e5ae41f7b1d5c9289e6b7bb5d80d69c7b: Status 404 returned error can't find the container with id 60183eaedf6ddc57ba7555e2bea51a9e5ae41f7b1d5c9289e6b7bb5d80d69c7b
Sep 09 20:46:56.435731 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:56.435689    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5" event={"ID":"a80e313e-155e-41a1-b232-11d1277c757e","Type":"ContainerStarted","Data":"60183eaedf6ddc57ba7555e2bea51a9e5ae41f7b1d5c9289e6b7bb5d80d69c7b"}
Sep 09 20:46:57.638486 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.638389    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"]
Sep 09 20:46:57.648014 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.647989    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:57.651100 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.650533    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-2beba0-serving-cert\""
Sep 09 20:46:57.653917 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.653792    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"]
Sep 09 20:46:57.747165 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.747130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzzb9\" (UniqueName: \"kubernetes.io/projected/b0251002-8a6b-45fd-9449-39ea5bef7149-kube-api-access-nzzb9\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:57.747343 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.747191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:57.747343 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.747217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-metrics-certs\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:57.747343 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.747298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0251002-8a6b-45fd-9449-39ea5bef7149-openshift-service-ca\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:57.848622 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.848587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0251002-8a6b-45fd-9449-39ea5bef7149-openshift-service-ca\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:57.848820 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.848709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzzb9\" (UniqueName: \"kubernetes.io/projected/b0251002-8a6b-45fd-9449-39ea5bef7149-kube-api-access-nzzb9\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:57.848820 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.848759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:57.848820 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.848781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-metrics-certs\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:57.848983 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:46:57.848893    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-serving-cert: secret "maas-api-e2e-autores-2beba0-serving-cert" not found
Sep 09 20:46:57.848983 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:46:57.848962    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls podName:b0251002-8a6b-45fd-9449-39ea5bef7149 nodeName:}" failed. No retries permitted until 2026-09-09 20:46:58.348940412 +0000 UTC m=+878.593768973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls") pod "maas-api-e2e-autores-2beba0-86884b4cb5-hp996" (UID: "b0251002-8a6b-45fd-9449-39ea5bef7149") : secret "maas-api-e2e-autores-2beba0-serving-cert" not found
Sep 09 20:46:57.849394 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.849367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0251002-8a6b-45fd-9449-39ea5bef7149-openshift-service-ca\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:57.851284 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.851265    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-metrics-certs\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:57.858388 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:57.858366    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzzb9\" (UniqueName: \"kubernetes.io/projected/b0251002-8a6b-45fd-9449-39ea5bef7149-kube-api-access-nzzb9\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:58.354183 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.354152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:58.354299 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:46:58.354280    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-serving-cert: secret "maas-api-e2e-autores-2beba0-serving-cert" not found
Sep 09 20:46:58.354395 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:46:58.354384    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls podName:b0251002-8a6b-45fd-9449-39ea5bef7149 nodeName:}" failed. No retries permitted until 2026-09-09 20:46:59.354368192 +0000 UTC m=+879.599196750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls") pod "maas-api-e2e-autores-2beba0-86884b4cb5-hp996" (UID: "b0251002-8a6b-45fd-9449-39ea5bef7149") : secret "maas-api-e2e-autores-2beba0-serving-cert" not found
Sep 09 20:46:58.390744 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.390721    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 20:46:58.449797 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.449744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5" event={"ID":"a80e313e-155e-41a1-b232-11d1277c757e","Type":"ContainerStarted","Data":"92d66077112785d43bc52bd6a2aa14b654334e196df3a5bbb13c9034a494fe95"}
Sep 09 20:46:58.449951 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.449881    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:46:58.471673 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.471624    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5" podStartSLOduration=1.906076749 podStartE2EDuration="4.47160846s" totalImagesPullingTime="2.565531711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:46:58.46937329 +0000 UTC m=+878.714201863" watchObservedRunningTime="2026-09-09 20:46:58.47160846 +0000 UTC m=+878.716437041"
Sep 09 20:46:58.811477 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.811442    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"]
Sep 09 20:46:58.815245 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.815220    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:46:58.817795 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.817769    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-2beba0\""
Sep 09 20:46:58.817924 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.817844    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-2beba0-dockercfg-bd44j\""
Sep 09 20:46:58.826366 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.826342    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"]
Sep 09 20:46:58.859032 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.859006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23688693-b23e-4bc6-bc31-96bef0371b70-plugins-config-volume\") pod \"payload-processing-e2e-autores-2beba0-c49869485-x7gk5\" (UID: \"23688693-b23e-4bc6-bc31-96bef0371b70\") " pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:46:58.859032 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.859035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm4pq\" (UniqueName: \"kubernetes.io/projected/23688693-b23e-4bc6-bc31-96bef0371b70-kube-api-access-xm4pq\") pod \"payload-processing-e2e-autores-2beba0-c49869485-x7gk5\" (UID: \"23688693-b23e-4bc6-bc31-96bef0371b70\") " pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:46:58.959632 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.959583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23688693-b23e-4bc6-bc31-96bef0371b70-plugins-config-volume\") pod \"payload-processing-e2e-autores-2beba0-c49869485-x7gk5\" (UID: \"23688693-b23e-4bc6-bc31-96bef0371b70\") " pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:46:58.959632 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.959635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm4pq\" (UniqueName: \"kubernetes.io/projected/23688693-b23e-4bc6-bc31-96bef0371b70-kube-api-access-xm4pq\") pod \"payload-processing-e2e-autores-2beba0-c49869485-x7gk5\" (UID: \"23688693-b23e-4bc6-bc31-96bef0371b70\") " pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:46:58.960375 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.960353    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23688693-b23e-4bc6-bc31-96bef0371b70-plugins-config-volume\") pod \"payload-processing-e2e-autores-2beba0-c49869485-x7gk5\" (UID: \"23688693-b23e-4bc6-bc31-96bef0371b70\") " pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:46:58.968925 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:58.968905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm4pq\" (UniqueName: \"kubernetes.io/projected/23688693-b23e-4bc6-bc31-96bef0371b70-kube-api-access-xm4pq\") pod \"payload-processing-e2e-autores-2beba0-c49869485-x7gk5\" (UID: \"23688693-b23e-4bc6-bc31-96bef0371b70\") " pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:46:59.128609 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:59.128517    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:46:59.363147 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:59.363112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:59.365805 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:59.365775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls\") pod \"maas-api-e2e-autores-2beba0-86884b4cb5-hp996\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:59.400381 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:59.400306    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:46:59.404357 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:59.404335    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"]
Sep 09 20:46:59.406201 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:46:59.406169    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23688693_b23e_4bc6_bc31_96bef0371b70.slice/crio-ac47d711298904d47a545ea5ece34ac7539f1a509aba271dab8370f29c9b04cb WatchSource:0}: Error finding container ac47d711298904d47a545ea5ece34ac7539f1a509aba271dab8370f29c9b04cb: Status 404 returned error can't find the container with id ac47d711298904d47a545ea5ece34ac7539f1a509aba271dab8370f29c9b04cb
Sep 09 20:46:59.457366 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:59.457334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5" event={"ID":"23688693-b23e-4bc6-bc31-96bef0371b70","Type":"ContainerStarted","Data":"ac47d711298904d47a545ea5ece34ac7539f1a509aba271dab8370f29c9b04cb"}
Sep 09 20:46:59.462242 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:59.462220    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:46:59.741920 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:46:59.741890    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"]
Sep 09 20:46:59.743654 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:46:59.743625    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0251002_8a6b_45fd_9449_39ea5bef7149.slice/crio-82e277a96bcf9b20f967c8c2f43112deec2425177b1d9be050d6486a6ea16463 WatchSource:0}: Error finding container 82e277a96bcf9b20f967c8c2f43112deec2425177b1d9be050d6486a6ea16463: Status 404 returned error can't find the container with id 82e277a96bcf9b20f967c8c2f43112deec2425177b1d9be050d6486a6ea16463
Sep 09 20:47:00.407511 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:00.407490    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:47:00.466172 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:00.466134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5" event={"ID":"23688693-b23e-4bc6-bc31-96bef0371b70","Type":"ContainerStarted","Data":"acc24b8ea236599fbecbdaf598b4e6a867ddbc1566c6ca16ace69e42dc34e931"}
Sep 09 20:47:00.466358 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:00.466200    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:47:00.467930 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:00.467898    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996" event={"ID":"b0251002-8a6b-45fd-9449-39ea5bef7149","Type":"ContainerStarted","Data":"972a03d3facc991abcafeb64571eba4939e97e567f414350117f75dd75b7680a"}
Sep 09 20:47:00.468075 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:00.467954    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996" event={"ID":"b0251002-8a6b-45fd-9449-39ea5bef7149","Type":"ContainerStarted","Data":"82e277a96bcf9b20f967c8c2f43112deec2425177b1d9be050d6486a6ea16463"}
Sep 09 20:47:00.468075 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:00.467984    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:47:00.483537 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:00.483408    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5" podStartSLOduration=2.483389342 podStartE2EDuration="2.483389342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:00.481846788 +0000 UTC m=+880.726675367" watchObservedRunningTime="2026-09-09 20:47:00.483389342 +0000 UTC m=+880.728217924"
Sep 09 20:47:00.500817 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:00.500758    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996" podStartSLOduration=2.874561261 podStartE2EDuration="3.500744297s" totalImagesPullingTime="626.183036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:00.498254284 +0000 UTC m=+880.743082868" watchObservedRunningTime="2026-09-09 20:47:00.500744297 +0000 UTC m=+880.745572876"
Sep 09 20:47:02.417300 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:02.417270    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:47:04.462912 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:04.462882    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:47:06.479432 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:06.479402    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:47:11.475915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:11.475885    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:47:20.255713 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:20.255640    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:47:20.256279 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:20.256028    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:47:20.263548 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:20.263526    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:47:20.264108 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:20.264087    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:47:25.461459 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.461406    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"]
Sep 09 20:47:25.461905 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.461706    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5" podUID="a80e313e-155e-41a1-b232-11d1277c757e" containerName="maas-api" containerID="cri-o://92d66077112785d43bc52bd6a2aa14b654334e196df3a5bbb13c9034a494fe95" gracePeriod=30
Sep 09 20:47:25.607088 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.607043    2576 generic.go:356] "Generic (PLEG): container finished" podID="a80e313e-155e-41a1-b232-11d1277c757e" containerID="92d66077112785d43bc52bd6a2aa14b654334e196df3a5bbb13c9034a494fe95" exitCode=0
Sep 09 20:47:25.607088 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.607079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5" event={"ID":"a80e313e-155e-41a1-b232-11d1277c757e","Type":"ContainerDied","Data":"92d66077112785d43bc52bd6a2aa14b654334e196df3a5bbb13c9034a494fe95"}
Sep 09 20:47:25.715287 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.715228    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:47:25.803882 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.803849    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rzs5\" (UniqueName: \"kubernetes.io/projected/a80e313e-155e-41a1-b232-11d1277c757e-kube-api-access-7rzs5\") pod \"a80e313e-155e-41a1-b232-11d1277c757e\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") "
Sep 09 20:47:25.804035 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.803890    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80e313e-155e-41a1-b232-11d1277c757e-openshift-service-ca\") pod \"a80e313e-155e-41a1-b232-11d1277c757e\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") "
Sep 09 20:47:25.804035 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.803959    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-metrics-certs\") pod \"a80e313e-155e-41a1-b232-11d1277c757e\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") "
Sep 09 20:47:25.804035 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.803994    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-maas-api-tls\") pod \"a80e313e-155e-41a1-b232-11d1277c757e\" (UID: \"a80e313e-155e-41a1-b232-11d1277c757e\") "
Sep 09 20:47:25.804344 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.804317    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a80e313e-155e-41a1-b232-11d1277c757e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a80e313e-155e-41a1-b232-11d1277c757e" (UID: "a80e313e-155e-41a1-b232-11d1277c757e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:47:25.806238 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.806215    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a80e313e-155e-41a1-b232-11d1277c757e" (UID: "a80e313e-155e-41a1-b232-11d1277c757e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:47:25.806333 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.806245    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a80e313e-155e-41a1-b232-11d1277c757e" (UID: "a80e313e-155e-41a1-b232-11d1277c757e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:47:25.806396 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.806375    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a80e313e-155e-41a1-b232-11d1277c757e-kube-api-access-7rzs5" (OuterVolumeSpecName: "kube-api-access-7rzs5") pod "a80e313e-155e-41a1-b232-11d1277c757e" (UID: "a80e313e-155e-41a1-b232-11d1277c757e"). InnerVolumeSpecName "kube-api-access-7rzs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:47:25.904731 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.904699    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:47:25.904731 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.904727    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rzs5\" (UniqueName: \"kubernetes.io/projected/a80e313e-155e-41a1-b232-11d1277c757e-kube-api-access-7rzs5\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:47:25.904908 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.904739    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80e313e-155e-41a1-b232-11d1277c757e-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:47:25.904908 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:25.904748    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a80e313e-155e-41a1-b232-11d1277c757e-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:47:26.620776 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:26.620696    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"
Sep 09 20:47:26.621251 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:26.620688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5" event={"ID":"a80e313e-155e-41a1-b232-11d1277c757e","Type":"ContainerDied","Data":"60183eaedf6ddc57ba7555e2bea51a9e5ae41f7b1d5c9289e6b7bb5d80d69c7b"}
Sep 09 20:47:26.621251 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:26.620867    2576 scope.go:117] "RemoveContainer" containerID="92d66077112785d43bc52bd6a2aa14b654334e196df3a5bbb13c9034a494fe95"
Sep 09 20:47:26.664628 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:26.664602    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"]
Sep 09 20:47:26.668613 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:26.668584    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-04f122cb-7b787769d-6jhp5"]
Sep 09 20:47:28.283705 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:28.283663    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a80e313e-155e-41a1-b232-11d1277c757e" path="/var/lib/kubelet/pods/a80e313e-155e-41a1-b232-11d1277c757e/volumes"
Sep 09 20:47:30.260966 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.260933    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"]
Sep 09 20:47:30.261559 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.261539    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a80e313e-155e-41a1-b232-11d1277c757e" containerName="maas-api"
Sep 09 20:47:30.261650 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.261561    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a80e313e-155e-41a1-b232-11d1277c757e" containerName="maas-api"
Sep 09 20:47:30.261706 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.261694    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a80e313e-155e-41a1-b232-11d1277c757e" containerName="maas-api"
Sep 09 20:47:30.268220 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.268199    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.271292 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.271272    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-5333ad9e-serving-cert\""
Sep 09 20:47:30.293015 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.292991    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"]
Sep 09 20:47:30.345263 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.345230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-metrics-certs\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.345417 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.345298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-maas-api-tls\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.345417 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.345331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31984860-a645-4ea3-b1f4-2d4327e246d2-openshift-service-ca\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.345417 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.345378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqbdm\" (UniqueName: \"kubernetes.io/projected/31984860-a645-4ea3-b1f4-2d4327e246d2-kube-api-access-pqbdm\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.445840 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.445812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31984860-a645-4ea3-b1f4-2d4327e246d2-openshift-service-ca\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.446027 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.445874    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqbdm\" (UniqueName: \"kubernetes.io/projected/31984860-a645-4ea3-b1f4-2d4327e246d2-kube-api-access-pqbdm\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.446027 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.445929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-metrics-certs\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.446027 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.445980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-maas-api-tls\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.446242 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:47:30.446099    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-serving-cert: secret "maas-api-e2e-migrate-5333ad9e-serving-cert" not found
Sep 09 20:47:30.446242 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:47:30.446161    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-maas-api-tls podName:31984860-a645-4ea3-b1f4-2d4327e246d2 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:30.946141881 +0000 UTC m=+911.190970439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-maas-api-tls") pod "maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c" (UID: "31984860-a645-4ea3-b1f4-2d4327e246d2") : secret "maas-api-e2e-migrate-5333ad9e-serving-cert" not found
Sep 09 20:47:30.446549 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.446524    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31984860-a645-4ea3-b1f4-2d4327e246d2-openshift-service-ca\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.448740 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.448712    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-metrics-certs\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.461661 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.461637    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqbdm\" (UniqueName: \"kubernetes.io/projected/31984860-a645-4ea3-b1f4-2d4327e246d2-kube-api-access-pqbdm\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.951310 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.951274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-maas-api-tls\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:30.953632 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:30.953612    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-maas-api-tls\") pod \"maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:31.178612 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:31.178573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:31.494337 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:31.494255    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"]
Sep 09 20:47:31.502177 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:47:31.502146    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31984860_a645_4ea3_b1f4_2d4327e246d2.slice/crio-eaa723de928024fc568078e89f25353ab723b07e781f1d7cd402ab844462be9e WatchSource:0}: Error finding container eaa723de928024fc568078e89f25353ab723b07e781f1d7cd402ab844462be9e: Status 404 returned error can't find the container with id eaa723de928024fc568078e89f25353ab723b07e781f1d7cd402ab844462be9e
Sep 09 20:47:31.648364 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:31.648331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c" event={"ID":"31984860-a645-4ea3-b1f4-2d4327e246d2","Type":"ContainerStarted","Data":"eaa723de928024fc568078e89f25353ab723b07e781f1d7cd402ab844462be9e"}
Sep 09 20:47:32.655759 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:32.655719    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c" event={"ID":"31984860-a645-4ea3-b1f4-2d4327e246d2","Type":"ContainerStarted","Data":"0027c70d41caa2a67dade7e73a619fb47a8bb8489886dab57a99689478894817"}
Sep 09 20:47:32.656168 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:32.655843    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:32.714481 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:32.714426    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c" podStartSLOduration=2.233859604 podStartE2EDuration="2.714410363s" totalImagesPullingTime="480.550759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:32.712620085 +0000 UTC m=+912.957448667" watchObservedRunningTime="2026-09-09 20:47:32.714410363 +0000 UTC m=+912.959238987"
Sep 09 20:47:38.666355 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:38.666323    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:47:54.903503 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:54.903466    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"]
Sep 09 20:47:54.907194 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:54.907177    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"
Sep 09 20:47:54.909498 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:54.909473    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tsks9\""
Sep 09 20:47:54.923503 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:54.923470    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"]
Sep 09 20:47:54.968845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:54.968815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a20f55e-d7eb-4c02-8583-f9d0450495d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54\" (UID: \"2a20f55e-d7eb-4c02-8583-f9d0450495d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"
Sep 09 20:47:55.070099 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:55.070062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a20f55e-d7eb-4c02-8583-f9d0450495d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54\" (UID: \"2a20f55e-d7eb-4c02-8583-f9d0450495d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"
Sep 09 20:47:55.070732 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:55.070710    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a20f55e-d7eb-4c02-8583-f9d0450495d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54\" (UID: \"2a20f55e-d7eb-4c02-8583-f9d0450495d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"
Sep 09 20:47:55.216850 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:55.216779    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"
Sep 09 20:47:55.503609 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:55.503587    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"]
Sep 09 20:47:55.506273 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:47:55.506238    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a20f55e_d7eb_4c02_8583_f9d0450495d2.slice/crio-4d5234196e6e53ae577aefd3592445d7c4d42951d754aed7e17d3b6b4f601b88 WatchSource:0}: Error finding container 4d5234196e6e53ae577aefd3592445d7c4d42951d754aed7e17d3b6b4f601b88: Status 404 returned error can't find the container with id 4d5234196e6e53ae577aefd3592445d7c4d42951d754aed7e17d3b6b4f601b88
Sep 09 20:47:55.777269 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:55.777186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54" event={"ID":"2a20f55e-d7eb-4c02-8583-f9d0450495d2","Type":"ContainerStarted","Data":"4d5234196e6e53ae577aefd3592445d7c4d42951d754aed7e17d3b6b4f601b88"}
Sep 09 20:47:58.797743 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:58.797711    2576 generic.go:356] "Generic (PLEG): container finished" podID="2a20f55e-d7eb-4c02-8583-f9d0450495d2" containerID="07f64c8c860826721ccb9badcbe803e38d4b1fb2beeb7958e86e2a17701149d1" exitCode=0
Sep 09 20:47:58.798186 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:58.797792    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54" event={"ID":"2a20f55e-d7eb-4c02-8583-f9d0450495d2","Type":"ContainerDied","Data":"07f64c8c860826721ccb9badcbe803e38d4b1fb2beeb7958e86e2a17701149d1"}
Sep 09 20:47:59.938598 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:47:59.938571    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"
Sep 09 20:48:00.016873 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:00.016834    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a20f55e-d7eb-4c02-8583-f9d0450495d2-maas-api-service-ca\") pod \"2a20f55e-d7eb-4c02-8583-f9d0450495d2\" (UID: \"2a20f55e-d7eb-4c02-8583-f9d0450495d2\") "
Sep 09 20:48:00.017238 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:00.017215    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a20f55e-d7eb-4c02-8583-f9d0450495d2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2a20f55e-d7eb-4c02-8583-f9d0450495d2" (UID: "2a20f55e-d7eb-4c02-8583-f9d0450495d2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:48:00.118670 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:00.118587    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a20f55e-d7eb-4c02-8583-f9d0450495d2-maas-api-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:48:00.809509 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:00.809481    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"
Sep 09 20:48:00.809723 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:00.809519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54" event={"ID":"2a20f55e-d7eb-4c02-8583-f9d0450495d2","Type":"ContainerDied","Data":"4d5234196e6e53ae577aefd3592445d7c4d42951d754aed7e17d3b6b4f601b88"}
Sep 09 20:48:00.809723 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:00.809573    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d5234196e6e53ae577aefd3592445d7c4d42951d754aed7e17d3b6b4f601b88"
Sep 09 20:48:01.655366 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:01.655324    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"]
Sep 09 20:48:01.656239 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:01.656199    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c" podUID="31984860-a645-4ea3-b1f4-2d4327e246d2" containerName="maas-api" containerID="cri-o://0027c70d41caa2a67dade7e73a619fb47a8bb8489886dab57a99689478894817" gracePeriod=30
Sep 09 20:48:01.816686 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:01.816551    2576 generic.go:356] "Generic (PLEG): container finished" podID="31984860-a645-4ea3-b1f4-2d4327e246d2" containerID="0027c70d41caa2a67dade7e73a619fb47a8bb8489886dab57a99689478894817" exitCode=0
Sep 09 20:48:01.817036 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:01.816673    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c" event={"ID":"31984860-a645-4ea3-b1f4-2d4327e246d2","Type":"ContainerDied","Data":"0027c70d41caa2a67dade7e73a619fb47a8bb8489886dab57a99689478894817"}
Sep 09 20:48:01.888427 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:01.888396    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"]
Sep 09 20:48:01.893163 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:01.893139    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5333ad9e-fjb54"]
Sep 09 20:48:01.916558 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:01.916508    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:48:02.035776 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.035748    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqbdm\" (UniqueName: \"kubernetes.io/projected/31984860-a645-4ea3-b1f4-2d4327e246d2-kube-api-access-pqbdm\") pod \"31984860-a645-4ea3-b1f4-2d4327e246d2\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") "
Sep 09 20:48:02.035954 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.035811    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31984860-a645-4ea3-b1f4-2d4327e246d2-openshift-service-ca\") pod \"31984860-a645-4ea3-b1f4-2d4327e246d2\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") "
Sep 09 20:48:02.035954 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.035838    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-maas-api-tls\") pod \"31984860-a645-4ea3-b1f4-2d4327e246d2\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") "
Sep 09 20:48:02.035954 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.035865    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-metrics-certs\") pod \"31984860-a645-4ea3-b1f4-2d4327e246d2\" (UID: \"31984860-a645-4ea3-b1f4-2d4327e246d2\") "
Sep 09 20:48:02.036284 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.036251    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31984860-a645-4ea3-b1f4-2d4327e246d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31984860-a645-4ea3-b1f4-2d4327e246d2" (UID: "31984860-a645-4ea3-b1f4-2d4327e246d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:48:02.037839 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.037814    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31984860-a645-4ea3-b1f4-2d4327e246d2-kube-api-access-pqbdm" (OuterVolumeSpecName: "kube-api-access-pqbdm") pod "31984860-a645-4ea3-b1f4-2d4327e246d2" (UID: "31984860-a645-4ea3-b1f4-2d4327e246d2"). InnerVolumeSpecName "kube-api-access-pqbdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:48:02.038346 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.038320    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "31984860-a645-4ea3-b1f4-2d4327e246d2" (UID: "31984860-a645-4ea3-b1f4-2d4327e246d2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:48:02.038435 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.038356    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31984860-a645-4ea3-b1f4-2d4327e246d2" (UID: "31984860-a645-4ea3-b1f4-2d4327e246d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:48:02.136827 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.136797    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqbdm\" (UniqueName: \"kubernetes.io/projected/31984860-a645-4ea3-b1f4-2d4327e246d2-kube-api-access-pqbdm\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:48:02.136827 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.136824    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31984860-a645-4ea3-b1f4-2d4327e246d2-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:48:02.136827 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.136834    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:48:02.137040 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.136842    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31984860-a645-4ea3-b1f4-2d4327e246d2-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:48:02.284064 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.283972    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a20f55e-d7eb-4c02-8583-f9d0450495d2" path="/var/lib/kubelet/pods/2a20f55e-d7eb-4c02-8583-f9d0450495d2/volumes"
Sep 09 20:48:02.825521 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.825489    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"
Sep 09 20:48:02.825521 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.825512    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c" event={"ID":"31984860-a645-4ea3-b1f4-2d4327e246d2","Type":"ContainerDied","Data":"eaa723de928024fc568078e89f25353ab723b07e781f1d7cd402ab844462be9e"}
Sep 09 20:48:02.826075 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.825587    2576 scope.go:117] "RemoveContainer" containerID="0027c70d41caa2a67dade7e73a619fb47a8bb8489886dab57a99689478894817"
Sep 09 20:48:02.854221 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.854191    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"]
Sep 09 20:48:02.859428 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:02.859409    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5333ad9e-5b77dbf88d-wx98c"]
Sep 09 20:48:04.284127 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:04.284094    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31984860-a645-4ea3-b1f4-2d4327e246d2" path="/var/lib/kubelet/pods/31984860-a645-4ea3-b1f4-2d4327e246d2/volumes"
Sep 09 20:48:06.167980 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.167937    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"]
Sep 09 20:48:06.168593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.168573    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a20f55e-d7eb-4c02-8583-f9d0450495d2" containerName="revoke-keys"
Sep 09 20:48:06.168593 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.168594    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a20f55e-d7eb-4c02-8583-f9d0450495d2" containerName="revoke-keys"
Sep 09 20:48:06.168762 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.168618    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31984860-a645-4ea3-b1f4-2d4327e246d2" containerName="maas-api"
Sep 09 20:48:06.168762 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.168627    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="31984860-a645-4ea3-b1f4-2d4327e246d2" containerName="maas-api"
Sep 09 20:48:06.168762 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.168742    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a20f55e-d7eb-4c02-8583-f9d0450495d2" containerName="revoke-keys"
Sep 09 20:48:06.168762 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.168762    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="31984860-a645-4ea3-b1f4-2d4327e246d2" containerName="maas-api"
Sep 09 20:48:06.173391 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.173370    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.175535 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.175513    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fd5982ad-serving-cert\""
Sep 09 20:48:06.185542 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.185503    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"]
Sep 09 20:48:06.278490 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.278466    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-maas-api-tls\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.278653 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.278501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-metrics-certs\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.278653 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.278530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs4vj\" (UniqueName: \"kubernetes.io/projected/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-kube-api-access-vs4vj\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.278653 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.278584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-openshift-service-ca\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.379199 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.379167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs4vj\" (UniqueName: \"kubernetes.io/projected/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-kube-api-access-vs4vj\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.379378 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.379207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-openshift-service-ca\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.379378 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.379326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-maas-api-tls\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.379378 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.379369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-metrics-certs\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.379562 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:48:06.379460    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-serving-cert: secret "maas-api-e2e-ait-fd5982ad-serving-cert" not found
Sep 09 20:48:06.379562 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:48:06.379535    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-maas-api-tls podName:9e2b2bfb-8915-452f-8dd6-6deab3f7de34 nodeName:}" failed. No retries permitted until 2026-09-09 20:48:06.879519127 +0000 UTC m=+947.124347690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-maas-api-tls") pod "maas-api-e2e-ait-fd5982ad-69cb799955-44tkb" (UID: "9e2b2bfb-8915-452f-8dd6-6deab3f7de34") : secret "maas-api-e2e-ait-fd5982ad-serving-cert" not found
Sep 09 20:48:06.379901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.379877    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-openshift-service-ca\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.381723 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.381707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-metrics-certs\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.389883 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.389858    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs4vj\" (UniqueName: \"kubernetes.io/projected/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-kube-api-access-vs4vj\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.883977 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.883940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-maas-api-tls\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:06.886298 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:06.886237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-maas-api-tls\") pod \"maas-api-e2e-ait-fd5982ad-69cb799955-44tkb\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:07.086042 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:07.086011    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:07.361930 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:07.361906    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"]
Sep 09 20:48:07.363471 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:48:07.363445    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2b2bfb_8915_452f_8dd6_6deab3f7de34.slice/crio-79e026eb7c09423fdc9d11a9b95694e8516251d320da71733083c1e1a34a5d0a WatchSource:0}: Error finding container 79e026eb7c09423fdc9d11a9b95694e8516251d320da71733083c1e1a34a5d0a: Status 404 returned error can't find the container with id 79e026eb7c09423fdc9d11a9b95694e8516251d320da71733083c1e1a34a5d0a
Sep 09 20:48:07.854524 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:07.854481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb" event={"ID":"9e2b2bfb-8915-452f-8dd6-6deab3f7de34","Type":"ContainerStarted","Data":"79e026eb7c09423fdc9d11a9b95694e8516251d320da71733083c1e1a34a5d0a"}
Sep 09 20:48:08.861347 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:08.861309    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb" event={"ID":"9e2b2bfb-8915-452f-8dd6-6deab3f7de34","Type":"ContainerStarted","Data":"7e8ba6e85846e9a81b2f60e7611d007291149e929d802462d3239665f14ac5c1"}
Sep 09 20:48:08.861720 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:08.861370    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:08.883718 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:08.883670    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb" podStartSLOduration=2.366570979 podStartE2EDuration="2.883656687s" totalImagesPullingTime="517.085708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:48:08.881640782 +0000 UTC m=+949.126469364" watchObservedRunningTime="2026-09-09 20:48:08.883656687 +0000 UTC m=+949.128485266"
Sep 09 20:48:14.872576 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:14.872548    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:30.716497 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:30.716461    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"]
Sep 09 20:48:30.721792 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:30.721770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"
Sep 09 20:48:30.724176 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:30.724155    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tsks9\""
Sep 09 20:48:30.728254 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:30.728202    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"]
Sep 09 20:48:30.796431 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:30.796405    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed6ddc13-bf3d-426a-95c4-e05f48703258-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj\" (UID: \"ed6ddc13-bf3d-426a-95c4-e05f48703258\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"
Sep 09 20:48:30.897926 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:30.897893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed6ddc13-bf3d-426a-95c4-e05f48703258-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj\" (UID: \"ed6ddc13-bf3d-426a-95c4-e05f48703258\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"
Sep 09 20:48:30.898545 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:30.898522    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed6ddc13-bf3d-426a-95c4-e05f48703258-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj\" (UID: \"ed6ddc13-bf3d-426a-95c4-e05f48703258\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"
Sep 09 20:48:31.033391 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:31.033297    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"
Sep 09 20:48:31.308721 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:31.308693    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"]
Sep 09 20:48:31.310837 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:48:31.310810    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded6ddc13_bf3d_426a_95c4_e05f48703258.slice/crio-9ca23986fd080bda2d0d85a2fb99c275f885a67be682566115a8c4bb39bf4992 WatchSource:0}: Error finding container 9ca23986fd080bda2d0d85a2fb99c275f885a67be682566115a8c4bb39bf4992: Status 404 returned error can't find the container with id 9ca23986fd080bda2d0d85a2fb99c275f885a67be682566115a8c4bb39bf4992
Sep 09 20:48:31.987541 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:31.987507    2576 generic.go:356] "Generic (PLEG): container finished" podID="ed6ddc13-bf3d-426a-95c4-e05f48703258" containerID="72047220137b2309e691958a8b005d1d3bfea3aa5b3967d3687c8842c489f82b" exitCode=0
Sep 09 20:48:31.987828 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:31.987556    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj" event={"ID":"ed6ddc13-bf3d-426a-95c4-e05f48703258","Type":"ContainerDied","Data":"72047220137b2309e691958a8b005d1d3bfea3aa5b3967d3687c8842c489f82b"}
Sep 09 20:48:31.987828 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:31.987607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj" event={"ID":"ed6ddc13-bf3d-426a-95c4-e05f48703258","Type":"ContainerStarted","Data":"9ca23986fd080bda2d0d85a2fb99c275f885a67be682566115a8c4bb39bf4992"}
Sep 09 20:48:33.129851 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:33.129821    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"
Sep 09 20:48:33.218678 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:33.218650    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed6ddc13-bf3d-426a-95c4-e05f48703258-maas-api-service-ca\") pod \"ed6ddc13-bf3d-426a-95c4-e05f48703258\" (UID: \"ed6ddc13-bf3d-426a-95c4-e05f48703258\") "
Sep 09 20:48:33.218986 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:33.218962    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed6ddc13-bf3d-426a-95c4-e05f48703258-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ed6ddc13-bf3d-426a-95c4-e05f48703258" (UID: "ed6ddc13-bf3d-426a-95c4-e05f48703258"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:48:33.319682 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:33.319648    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed6ddc13-bf3d-426a-95c4-e05f48703258-maas-api-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:48:33.999983 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:33.999954    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"
Sep 09 20:48:34.000158 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:33.999989    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj" event={"ID":"ed6ddc13-bf3d-426a-95c4-e05f48703258","Type":"ContainerDied","Data":"9ca23986fd080bda2d0d85a2fb99c275f885a67be682566115a8c4bb39bf4992"}
Sep 09 20:48:34.000158 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:34.000039    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ca23986fd080bda2d0d85a2fb99c275f885a67be682566115a8c4bb39bf4992"
Sep 09 20:48:36.835072 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:36.834978    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"]
Sep 09 20:48:36.835521 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:36.835326    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb" podUID="9e2b2bfb-8915-452f-8dd6-6deab3f7de34" containerName="maas-api" containerID="cri-o://7e8ba6e85846e9a81b2f60e7611d007291149e929d802462d3239665f14ac5c1" gracePeriod=30
Sep 09 20:48:37.020760 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.020696    2576 generic.go:356] "Generic (PLEG): container finished" podID="9e2b2bfb-8915-452f-8dd6-6deab3f7de34" containerID="7e8ba6e85846e9a81b2f60e7611d007291149e929d802462d3239665f14ac5c1" exitCode=0
Sep 09 20:48:37.020910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.020783    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb" event={"ID":"9e2b2bfb-8915-452f-8dd6-6deab3f7de34","Type":"ContainerDied","Data":"7e8ba6e85846e9a81b2f60e7611d007291149e929d802462d3239665f14ac5c1"}
Sep 09 20:48:37.089386 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.089328    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:37.105104 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.105079    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"]
Sep 09 20:48:37.110798 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.110776    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd5982ad-rspjj"]
Sep 09 20:48:37.155787 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.155760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs4vj\" (UniqueName: \"kubernetes.io/projected/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-kube-api-access-vs4vj\") pod \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") "
Sep 09 20:48:37.155787 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.155792    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-metrics-certs\") pod \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") "
Sep 09 20:48:37.155995 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.155814    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-openshift-service-ca\") pod \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") "
Sep 09 20:48:37.155995 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.155878    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-maas-api-tls\") pod \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\" (UID: \"9e2b2bfb-8915-452f-8dd6-6deab3f7de34\") "
Sep 09 20:48:37.156258 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.156235    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e2b2bfb-8915-452f-8dd6-6deab3f7de34" (UID: "9e2b2bfb-8915-452f-8dd6-6deab3f7de34"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:48:37.158087 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.158037    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e2b2bfb-8915-452f-8dd6-6deab3f7de34" (UID: "9e2b2bfb-8915-452f-8dd6-6deab3f7de34"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:48:37.158087 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.158075    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9e2b2bfb-8915-452f-8dd6-6deab3f7de34" (UID: "9e2b2bfb-8915-452f-8dd6-6deab3f7de34"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:48:37.158212 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.158068    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-kube-api-access-vs4vj" (OuterVolumeSpecName: "kube-api-access-vs4vj") pod "9e2b2bfb-8915-452f-8dd6-6deab3f7de34" (UID: "9e2b2bfb-8915-452f-8dd6-6deab3f7de34"). InnerVolumeSpecName "kube-api-access-vs4vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:48:37.257224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.257188    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs4vj\" (UniqueName: \"kubernetes.io/projected/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-kube-api-access-vs4vj\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:48:37.257224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.257217    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:48:37.257224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.257226    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:48:37.257224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:37.257235    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2b2bfb-8915-452f-8dd6-6deab3f7de34-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:48:38.028320 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:38.028291    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"
Sep 09 20:48:38.028737 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:38.028329    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb" event={"ID":"9e2b2bfb-8915-452f-8dd6-6deab3f7de34","Type":"ContainerDied","Data":"79e026eb7c09423fdc9d11a9b95694e8516251d320da71733083c1e1a34a5d0a"}
Sep 09 20:48:38.028737 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:38.028395    2576 scope.go:117] "RemoveContainer" containerID="7e8ba6e85846e9a81b2f60e7611d007291149e929d802462d3239665f14ac5c1"
Sep 09 20:48:38.049374 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:38.049347    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"]
Sep 09 20:48:38.053205 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:38.053182    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd5982ad-69cb799955-44tkb"]
Sep 09 20:48:38.283720 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:38.283648    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e2b2bfb-8915-452f-8dd6-6deab3f7de34" path="/var/lib/kubelet/pods/9e2b2bfb-8915-452f-8dd6-6deab3f7de34/volumes"
Sep 09 20:48:38.283969 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:38.283956    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed6ddc13-bf3d-426a-95c4-e05f48703258" path="/var/lib/kubelet/pods/ed6ddc13-bf3d-426a-95c4-e05f48703258/volumes"
Sep 09 20:48:43.010489 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.010403    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"]
Sep 09 20:48:43.010863 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.010847    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e2b2bfb-8915-452f-8dd6-6deab3f7de34" containerName="maas-api"
Sep 09 20:48:43.010907 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.010865    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e2b2bfb-8915-452f-8dd6-6deab3f7de34" containerName="maas-api"
Sep 09 20:48:43.010907 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.010887    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed6ddc13-bf3d-426a-95c4-e05f48703258" containerName="revoke-keys"
Sep 09 20:48:43.010907 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.010893    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed6ddc13-bf3d-426a-95c4-e05f48703258" containerName="revoke-keys"
Sep 09 20:48:43.011003 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.010956    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e2b2bfb-8915-452f-8dd6-6deab3f7de34" containerName="maas-api"
Sep 09 20:48:43.011003 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.010970    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed6ddc13-bf3d-426a-95c4-e05f48703258" containerName="revoke-keys"
Sep 09 20:48:43.014591 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.014410    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.016752 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.016732    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-3d3c9036-serving-cert\""
Sep 09 20:48:43.030857 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.030833    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"]
Sep 09 20:48:43.109907 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.109875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-maas-api-tls\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.110036 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.109972    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n227\" (UniqueName: \"kubernetes.io/projected/f4add7da-e977-42d0-b721-39528906f207-kube-api-access-8n227\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.110036 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.110021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4add7da-e977-42d0-b721-39528906f207-openshift-service-ca\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.110188 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.110046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-metrics-certs\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.210865 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.210833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n227\" (UniqueName: \"kubernetes.io/projected/f4add7da-e977-42d0-b721-39528906f207-kube-api-access-8n227\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.211068 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.210880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4add7da-e977-42d0-b721-39528906f207-openshift-service-ca\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.211068 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.210909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-metrics-certs\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.211068 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.210967    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-maas-api-tls\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.211651 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.211621    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4add7da-e977-42d0-b721-39528906f207-openshift-service-ca\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.213436 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.213413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-metrics-certs\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.213560 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.213539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-maas-api-tls\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.219134 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.219109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n227\" (UniqueName: \"kubernetes.io/projected/f4add7da-e977-42d0-b721-39528906f207-kube-api-access-8n227\") pod \"maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.325349 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.325320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:43.608009 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:43.607982    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"]
Sep 09 20:48:43.610157 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:48:43.610132    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4add7da_e977_42d0_b721_39528906f207.slice/crio-3e394fb5f797074c69d2faf332ad5f6a624199c89617a7f3e6b310dbf71ab934 WatchSource:0}: Error finding container 3e394fb5f797074c69d2faf332ad5f6a624199c89617a7f3e6b310dbf71ab934: Status 404 returned error can't find the container with id 3e394fb5f797074c69d2faf332ad5f6a624199c89617a7f3e6b310dbf71ab934
Sep 09 20:48:44.061972 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:44.061937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6" event={"ID":"f4add7da-e977-42d0-b721-39528906f207","Type":"ContainerStarted","Data":"3e394fb5f797074c69d2faf332ad5f6a624199c89617a7f3e6b310dbf71ab934"}
Sep 09 20:48:45.068862 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:45.068824    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6" event={"ID":"f4add7da-e977-42d0-b721-39528906f207","Type":"ContainerStarted","Data":"da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e"}
Sep 09 20:48:45.069242 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:45.068911    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:45.095076 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:45.089826    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6" podStartSLOduration=2.61946818 podStartE2EDuration="3.089806346s" totalImagesPullingTime="470.338166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:48:45.087560516 +0000 UTC m=+985.332389097" watchObservedRunningTime="2026-09-09 20:48:45.089806346 +0000 UTC m=+985.334634926"
Sep 09 20:48:51.079715 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:51.079685    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:48:59.217893 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:59.217860    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"]
Sep 09 20:48:59.220535 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:59.220514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"
Sep 09 20:48:59.222915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:59.222892    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tsks9\""
Sep 09 20:48:59.232682 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:59.232658    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"]
Sep 09 20:48:59.362278 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:59.362239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e433c2c-2774-4724-b3c1-f66857d00c07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-2beba0-8sc7s\" (UID: \"1e433c2c-2774-4724-b3c1-f66857d00c07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"
Sep 09 20:48:59.462965 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:59.462932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e433c2c-2774-4724-b3c1-f66857d00c07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-2beba0-8sc7s\" (UID: \"1e433c2c-2774-4724-b3c1-f66857d00c07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"
Sep 09 20:48:59.463539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:59.463521    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e433c2c-2774-4724-b3c1-f66857d00c07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-2beba0-8sc7s\" (UID: \"1e433c2c-2774-4724-b3c1-f66857d00c07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"
Sep 09 20:48:59.531419 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:59.531349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"
Sep 09 20:48:59.805448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:48:59.805347    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"]
Sep 09 20:48:59.808186 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:48:59.808159    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e433c2c_2774_4724_b3c1_f66857d00c07.slice/crio-826229d0b6fdaebbea6955a922425ac6bb053ffa0812cc478465575617333a03 WatchSource:0}: Error finding container 826229d0b6fdaebbea6955a922425ac6bb053ffa0812cc478465575617333a03: Status 404 returned error can't find the container with id 826229d0b6fdaebbea6955a922425ac6bb053ffa0812cc478465575617333a03
Sep 09 20:49:00.153338 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:00.153305    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s" event={"ID":"1e433c2c-2774-4724-b3c1-f66857d00c07","Type":"ContainerStarted","Data":"826229d0b6fdaebbea6955a922425ac6bb053ffa0812cc478465575617333a03"}
Sep 09 20:49:01.161484 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:01.161450    2576 generic.go:356] "Generic (PLEG): container finished" podID="1e433c2c-2774-4724-b3c1-f66857d00c07" containerID="e35bac056f6e83d00f498856b99ca178c58c9ae45fb4fd3860d809af2155423e" exitCode=0
Sep 09 20:49:01.161899 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:01.161536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s" event={"ID":"1e433c2c-2774-4724-b3c1-f66857d00c07","Type":"ContainerDied","Data":"e35bac056f6e83d00f498856b99ca178c58c9ae45fb4fd3860d809af2155423e"}
Sep 09 20:49:02.299567 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:02.299543    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"
Sep 09 20:49:02.490231 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:02.490154    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e433c2c-2774-4724-b3c1-f66857d00c07-maas-api-service-ca\") pod \"1e433c2c-2774-4724-b3c1-f66857d00c07\" (UID: \"1e433c2c-2774-4724-b3c1-f66857d00c07\") "
Sep 09 20:49:02.490522 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:02.490499    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e433c2c-2774-4724-b3c1-f66857d00c07-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e433c2c-2774-4724-b3c1-f66857d00c07" (UID: "1e433c2c-2774-4724-b3c1-f66857d00c07"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:49:02.591514 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:02.591482    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e433c2c-2774-4724-b3c1-f66857d00c07-maas-api-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:03.180495 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:03.180464    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"
Sep 09 20:49:03.180665 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:03.180463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s" event={"ID":"1e433c2c-2774-4724-b3c1-f66857d00c07","Type":"ContainerDied","Data":"826229d0b6fdaebbea6955a922425ac6bb053ffa0812cc478465575617333a03"}
Sep 09 20:49:03.180665 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:03.180606    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="826229d0b6fdaebbea6955a922425ac6bb053ffa0812cc478465575617333a03"
Sep 09 20:49:06.614832 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:06.614801    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"]
Sep 09 20:49:06.615265 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:06.615253    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e433c2c-2774-4724-b3c1-f66857d00c07" containerName="revoke-keys"
Sep 09 20:49:06.615265 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:06.615266    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e433c2c-2774-4724-b3c1-f66857d00c07" containerName="revoke-keys"
Sep 09 20:49:06.615344 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:06.615329    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e433c2c-2774-4724-b3c1-f66857d00c07" containerName="revoke-keys"
Sep 09 20:49:06.617669 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:06.617648    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"
Sep 09 20:49:06.619925 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:06.619903    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tsks9\""
Sep 09 20:49:06.624943 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:06.624913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a304f9e0-0e3b-4787-9098-b863fb14cd15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g\" (UID: \"a304f9e0-0e3b-4787-9098-b863fb14cd15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"
Sep 09 20:49:06.627434 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:06.627407    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"]
Sep 09 20:49:06.725607 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:06.725579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a304f9e0-0e3b-4787-9098-b863fb14cd15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g\" (UID: \"a304f9e0-0e3b-4787-9098-b863fb14cd15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"
Sep 09 20:49:06.726220 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:06.726201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a304f9e0-0e3b-4787-9098-b863fb14cd15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g\" (UID: \"a304f9e0-0e3b-4787-9098-b863fb14cd15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"
Sep 09 20:49:06.928594 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:06.928518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"
Sep 09 20:49:07.199044 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:07.199013    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"]
Sep 09 20:49:07.200638 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:49:07.200607    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda304f9e0_0e3b_4787_9098_b863fb14cd15.slice/crio-2254eabeddd06aa690059465cc39b7e881a00e7ff36a770fa2d62a463bdba547 WatchSource:0}: Error finding container 2254eabeddd06aa690059465cc39b7e881a00e7ff36a770fa2d62a463bdba547: Status 404 returned error can't find the container with id 2254eabeddd06aa690059465cc39b7e881a00e7ff36a770fa2d62a463bdba547
Sep 09 20:49:08.210033 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:08.209947    2576 generic.go:356] "Generic (PLEG): container finished" podID="a304f9e0-0e3b-4787-9098-b863fb14cd15" containerID="a5fe7e8d25def5401bc0ee88b2f2ca20de773c3aac47f8010ee2eb58ac64bdfb" exitCode=0
Sep 09 20:49:08.210033 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:08.210000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g" event={"ID":"a304f9e0-0e3b-4787-9098-b863fb14cd15","Type":"ContainerDied","Data":"a5fe7e8d25def5401bc0ee88b2f2ca20de773c3aac47f8010ee2eb58ac64bdfb"}
Sep 09 20:49:08.210438 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:08.210087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g" event={"ID":"a304f9e0-0e3b-4787-9098-b863fb14cd15","Type":"ContainerStarted","Data":"2254eabeddd06aa690059465cc39b7e881a00e7ff36a770fa2d62a463bdba547"}
Sep 09 20:49:09.353492 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:09.353470    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"
Sep 09 20:49:09.446466 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:09.446438    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a304f9e0-0e3b-4787-9098-b863fb14cd15-maas-api-service-ca\") pod \"a304f9e0-0e3b-4787-9098-b863fb14cd15\" (UID: \"a304f9e0-0e3b-4787-9098-b863fb14cd15\") "
Sep 09 20:49:09.446763 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:09.446741    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a304f9e0-0e3b-4787-9098-b863fb14cd15-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a304f9e0-0e3b-4787-9098-b863fb14cd15" (UID: "a304f9e0-0e3b-4787-9098-b863fb14cd15"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:49:09.547358 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:09.547336    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a304f9e0-0e3b-4787-9098-b863fb14cd15-maas-api-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:10.020206 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.020111    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"]
Sep 09 20:49:10.020388 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.020355    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996" podUID="b0251002-8a6b-45fd-9449-39ea5bef7149" containerName="maas-api" containerID="cri-o://972a03d3facc991abcafeb64571eba4939e97e567f414350117f75dd75b7680a" gracePeriod=30
Sep 09 20:49:10.087942 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.087909    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"]
Sep 09 20:49:10.088184 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.088155    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5" podUID="23688693-b23e-4bc6-bc31-96bef0371b70" containerName="payload-processing" containerID="cri-o://acc24b8ea236599fbecbdaf598b4e6a867ddbc1566c6ca16ace69e42dc34e931" gracePeriod=30
Sep 09 20:49:10.223519 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.223348    2576 generic.go:356] "Generic (PLEG): container finished" podID="23688693-b23e-4bc6-bc31-96bef0371b70" containerID="acc24b8ea236599fbecbdaf598b4e6a867ddbc1566c6ca16ace69e42dc34e931" exitCode=0
Sep 09 20:49:10.223519 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.223442    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5" event={"ID":"23688693-b23e-4bc6-bc31-96bef0371b70","Type":"ContainerDied","Data":"acc24b8ea236599fbecbdaf598b4e6a867ddbc1566c6ca16ace69e42dc34e931"}
Sep 09 20:49:10.225808 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.225773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g" event={"ID":"a304f9e0-0e3b-4787-9098-b863fb14cd15","Type":"ContainerDied","Data":"2254eabeddd06aa690059465cc39b7e881a00e7ff36a770fa2d62a463bdba547"}
Sep 09 20:49:10.225937 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.225824    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2254eabeddd06aa690059465cc39b7e881a00e7ff36a770fa2d62a463bdba547"
Sep 09 20:49:10.225937 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.225883    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"
Sep 09 20:49:10.227944 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.227907    2576 generic.go:356] "Generic (PLEG): container finished" podID="b0251002-8a6b-45fd-9449-39ea5bef7149" containerID="972a03d3facc991abcafeb64571eba4939e97e567f414350117f75dd75b7680a" exitCode=0
Sep 09 20:49:10.228037 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.227955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996" event={"ID":"b0251002-8a6b-45fd-9449-39ea5bef7149","Type":"ContainerDied","Data":"972a03d3facc991abcafeb64571eba4939e97e567f414350117f75dd75b7680a"}
Sep 09 20:49:10.287947 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.287921    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"]
Sep 09 20:49:10.288061 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.287957    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2beba0-8sc7s"]
Sep 09 20:49:10.334779 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.334750    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:49:10.354756 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.354725    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0251002-8a6b-45fd-9449-39ea5bef7149-openshift-service-ca\") pod \"b0251002-8a6b-45fd-9449-39ea5bef7149\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") "
Sep 09 20:49:10.355220 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.354777    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzzb9\" (UniqueName: \"kubernetes.io/projected/b0251002-8a6b-45fd-9449-39ea5bef7149-kube-api-access-nzzb9\") pod \"b0251002-8a6b-45fd-9449-39ea5bef7149\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") "
Sep 09 20:49:10.355220 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.354866    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-metrics-certs\") pod \"b0251002-8a6b-45fd-9449-39ea5bef7149\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") "
Sep 09 20:49:10.355220 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.354904    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls\") pod \"b0251002-8a6b-45fd-9449-39ea5bef7149\" (UID: \"b0251002-8a6b-45fd-9449-39ea5bef7149\") "
Sep 09 20:49:10.356022 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.355981    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0251002-8a6b-45fd-9449-39ea5bef7149-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b0251002-8a6b-45fd-9449-39ea5bef7149" (UID: "b0251002-8a6b-45fd-9449-39ea5bef7149"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:49:10.357396 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.357362    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b0251002-8a6b-45fd-9449-39ea5bef7149" (UID: "b0251002-8a6b-45fd-9449-39ea5bef7149"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:49:10.357512 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.357437    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0251002-8a6b-45fd-9449-39ea5bef7149-kube-api-access-nzzb9" (OuterVolumeSpecName: "kube-api-access-nzzb9") pod "b0251002-8a6b-45fd-9449-39ea5bef7149" (UID: "b0251002-8a6b-45fd-9449-39ea5bef7149"). InnerVolumeSpecName "kube-api-access-nzzb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:49:10.357879 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.357861    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b0251002-8a6b-45fd-9449-39ea5bef7149" (UID: "b0251002-8a6b-45fd-9449-39ea5bef7149"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:49:10.381418 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.381387    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:49:10.455882 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.455845    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23688693-b23e-4bc6-bc31-96bef0371b70-plugins-config-volume\") pod \"23688693-b23e-4bc6-bc31-96bef0371b70\" (UID: \"23688693-b23e-4bc6-bc31-96bef0371b70\") "
Sep 09 20:49:10.456209 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.456188    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23688693-b23e-4bc6-bc31-96bef0371b70-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23688693-b23e-4bc6-bc31-96bef0371b70" (UID: "23688693-b23e-4bc6-bc31-96bef0371b70"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:49:10.456262 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.456194    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzzb9\" (UniqueName: \"kubernetes.io/projected/b0251002-8a6b-45fd-9449-39ea5bef7149-kube-api-access-nzzb9\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:10.456262 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.456251    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:10.456332 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.456262    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0251002-8a6b-45fd-9449-39ea5bef7149-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:10.456332 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.456271    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0251002-8a6b-45fd-9449-39ea5bef7149-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:10.556896 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.556864    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm4pq\" (UniqueName: \"kubernetes.io/projected/23688693-b23e-4bc6-bc31-96bef0371b70-kube-api-access-xm4pq\") pod \"23688693-b23e-4bc6-bc31-96bef0371b70\" (UID: \"23688693-b23e-4bc6-bc31-96bef0371b70\") "
Sep 09 20:49:10.557127 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.557113    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23688693-b23e-4bc6-bc31-96bef0371b70-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:10.559103 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.559081    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23688693-b23e-4bc6-bc31-96bef0371b70-kube-api-access-xm4pq" (OuterVolumeSpecName: "kube-api-access-xm4pq") pod "23688693-b23e-4bc6-bc31-96bef0371b70" (UID: "23688693-b23e-4bc6-bc31-96bef0371b70"). InnerVolumeSpecName "kube-api-access-xm4pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:49:10.657492 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:10.657466    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm4pq\" (UniqueName: \"kubernetes.io/projected/23688693-b23e-4bc6-bc31-96bef0371b70-kube-api-access-xm4pq\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:11.236069 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:11.236033    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"
Sep 09 20:49:11.236266 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:11.236033    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5" event={"ID":"23688693-b23e-4bc6-bc31-96bef0371b70","Type":"ContainerDied","Data":"ac47d711298904d47a545ea5ece34ac7539f1a509aba271dab8370f29c9b04cb"}
Sep 09 20:49:11.236266 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:11.236196    2576 scope.go:117] "RemoveContainer" containerID="acc24b8ea236599fbecbdaf598b4e6a867ddbc1566c6ca16ace69e42dc34e931"
Sep 09 20:49:11.237612 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:11.237580    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"
Sep 09 20:49:11.237786 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:11.237627    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996" event={"ID":"b0251002-8a6b-45fd-9449-39ea5bef7149","Type":"ContainerDied","Data":"82e277a96bcf9b20f967c8c2f43112deec2425177b1d9be050d6486a6ea16463"}
Sep 09 20:49:11.247003 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:11.246987    2576 scope.go:117] "RemoveContainer" containerID="972a03d3facc991abcafeb64571eba4939e97e567f414350117f75dd75b7680a"
Sep 09 20:49:11.260379 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:11.260358    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"]
Sep 09 20:49:11.267831 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:11.267799    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5"]
Sep 09 20:49:11.276614 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:11.276591    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"]
Sep 09 20:49:11.280500 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:11.280480    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-2beba0-86884b4cb5-hp996"]
Sep 09 20:49:12.283985 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:12.283948    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e433c2c-2774-4724-b3c1-f66857d00c07" path="/var/lib/kubelet/pods/1e433c2c-2774-4724-b3c1-f66857d00c07/volumes"
Sep 09 20:49:12.284392 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:12.284336    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23688693-b23e-4bc6-bc31-96bef0371b70" path="/var/lib/kubelet/pods/23688693-b23e-4bc6-bc31-96bef0371b70/volumes"
Sep 09 20:49:12.284674 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:12.284661    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0251002-8a6b-45fd-9449-39ea5bef7149" path="/var/lib/kubelet/pods/b0251002-8a6b-45fd-9449-39ea5bef7149/volumes"
Sep 09 20:49:13.706154 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.706107    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"]
Sep 09 20:49:13.706619 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.706407    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6" podUID="f4add7da-e977-42d0-b721-39528906f207" containerName="maas-api" containerID="cri-o://da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e" gracePeriod=30
Sep 09 20:49:13.956491 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.956435    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:49:13.959000 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.958952    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"]
Sep 09 20:49:13.961465 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.961443    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3d3c9036-5gw5g"]
Sep 09 20:49:13.983965 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.983944    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-maas-api-tls\") pod \"f4add7da-e977-42d0-b721-39528906f207\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") "
Sep 09 20:49:13.984071 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.984010    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4add7da-e977-42d0-b721-39528906f207-openshift-service-ca\") pod \"f4add7da-e977-42d0-b721-39528906f207\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") "
Sep 09 20:49:13.984071 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.984032    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n227\" (UniqueName: \"kubernetes.io/projected/f4add7da-e977-42d0-b721-39528906f207-kube-api-access-8n227\") pod \"f4add7da-e977-42d0-b721-39528906f207\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") "
Sep 09 20:49:13.984160 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.984084    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-metrics-certs\") pod \"f4add7da-e977-42d0-b721-39528906f207\" (UID: \"f4add7da-e977-42d0-b721-39528906f207\") "
Sep 09 20:49:13.984400 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.984373    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4add7da-e977-42d0-b721-39528906f207-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4add7da-e977-42d0-b721-39528906f207" (UID: "f4add7da-e977-42d0-b721-39528906f207"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:49:13.986172 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.986143    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4add7da-e977-42d0-b721-39528906f207" (UID: "f4add7da-e977-42d0-b721-39528906f207"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:49:13.986172 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.986168    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f4add7da-e977-42d0-b721-39528906f207" (UID: "f4add7da-e977-42d0-b721-39528906f207"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:49:13.986286 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:13.986252    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4add7da-e977-42d0-b721-39528906f207-kube-api-access-8n227" (OuterVolumeSpecName: "kube-api-access-8n227") pod "f4add7da-e977-42d0-b721-39528906f207" (UID: "f4add7da-e977-42d0-b721-39528906f207"). InnerVolumeSpecName "kube-api-access-8n227". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:49:14.085645 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.085618    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:14.085645 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.085643    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4add7da-e977-42d0-b721-39528906f207-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:14.085645 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.085653    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4add7da-e977-42d0-b721-39528906f207-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:14.085871 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.085662    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n227\" (UniqueName: \"kubernetes.io/projected/f4add7da-e977-42d0-b721-39528906f207-kube-api-access-8n227\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:49:14.257437 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.257349    2576 generic.go:356] "Generic (PLEG): container finished" podID="f4add7da-e977-42d0-b721-39528906f207" containerID="da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e" exitCode=0
Sep 09 20:49:14.257437 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.257393    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"
Sep 09 20:49:14.257631 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.257436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6" event={"ID":"f4add7da-e977-42d0-b721-39528906f207","Type":"ContainerDied","Data":"da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e"}
Sep 09 20:49:14.257631 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.257490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6" event={"ID":"f4add7da-e977-42d0-b721-39528906f207","Type":"ContainerDied","Data":"3e394fb5f797074c69d2faf332ad5f6a624199c89617a7f3e6b310dbf71ab934"}
Sep 09 20:49:14.257631 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.257513    2576 scope.go:117] "RemoveContainer" containerID="da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e"
Sep 09 20:49:14.267653 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.267635    2576 scope.go:117] "RemoveContainer" containerID="da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e"
Sep 09 20:49:14.267926 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:49:14.267905    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e\": container with ID starting with da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e not found: ID does not exist" containerID="da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e"
Sep 09 20:49:14.268003 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.267934    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e"} err="failed to get container status \"da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e\": rpc error: code = NotFound desc = could not find container \"da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e\": container with ID starting with da439fd9ee107eb698606788fcea13e4dc0b5a2864b9a75461b729b12a4abf6e not found: ID does not exist"
Sep 09 20:49:14.285862 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.285828    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a304f9e0-0e3b-4787-9098-b863fb14cd15" path="/var/lib/kubelet/pods/a304f9e0-0e3b-4787-9098-b863fb14cd15/volumes"
Sep 09 20:49:14.286165 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.286148    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"]
Sep 09 20:49:14.286246 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:14.286180    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3d3c9036-6bc4df9f58-6zck6"]
Sep 09 20:49:16.283454 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:16.283418    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4add7da-e977-42d0-b721-39528906f207" path="/var/lib/kubelet/pods/f4add7da-e977-42d0-b721-39528906f207/volumes"
Sep 09 20:49:57.913508 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.913475    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"]
Sep 09 20:49:57.913928 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.913904    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23688693-b23e-4bc6-bc31-96bef0371b70" containerName="payload-processing"
Sep 09 20:49:57.913928 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.913920    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="23688693-b23e-4bc6-bc31-96bef0371b70" containerName="payload-processing"
Sep 09 20:49:57.913928 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.913929    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0251002-8a6b-45fd-9449-39ea5bef7149" containerName="maas-api"
Sep 09 20:49:57.914073 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.913935    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0251002-8a6b-45fd-9449-39ea5bef7149" containerName="maas-api"
Sep 09 20:49:57.914073 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.913947    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a304f9e0-0e3b-4787-9098-b863fb14cd15" containerName="revoke-keys"
Sep 09 20:49:57.914073 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.913955    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a304f9e0-0e3b-4787-9098-b863fb14cd15" containerName="revoke-keys"
Sep 09 20:49:57.914073 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.913974    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4add7da-e977-42d0-b721-39528906f207" containerName="maas-api"
Sep 09 20:49:57.914073 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.913979    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4add7da-e977-42d0-b721-39528906f207" containerName="maas-api"
Sep 09 20:49:57.914241 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.914090    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4add7da-e977-42d0-b721-39528906f207" containerName="maas-api"
Sep 09 20:49:57.914241 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.914102    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0251002-8a6b-45fd-9449-39ea5bef7149" containerName="maas-api"
Sep 09 20:49:57.914241 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.914112    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="23688693-b23e-4bc6-bc31-96bef0371b70" containerName="payload-processing"
Sep 09 20:49:57.914241 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.914121    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a304f9e0-0e3b-4787-9098-b863fb14cd15" containerName="revoke-keys"
Sep 09 20:49:57.916383 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.916364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:57.919305 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.919280    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-2d6f6c-serving-cert\""
Sep 09 20:49:57.919430 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.919304    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pzpjp\""
Sep 09 20:49:57.919430 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.919314    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 20:49:57.929386 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:57.929354    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"]
Sep 09 20:49:58.070278 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.070244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4z44\" (UniqueName: \"kubernetes.io/projected/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-kube-api-access-b4z44\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.070474 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.070294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-openshift-service-ca\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.070474 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.070445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-maas-api-tls\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.070580 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.070497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-metrics-certs\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.171433 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.171353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-maas-api-tls\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.171433 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.171394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-metrics-certs\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.171433 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.171424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4z44\" (UniqueName: \"kubernetes.io/projected/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-kube-api-access-b4z44\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.171712 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.171460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-openshift-service-ca\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.171712 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:49:58.171542    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-serving-cert: secret "maas-api-e2e-explicit-2d6f6c-serving-cert" not found
Sep 09 20:49:58.171712 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:49:58.171655    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-maas-api-tls podName:29f65f8c-bc0f-41db-b3c9-53cad56a7b6a nodeName:}" failed. No retries permitted until 2026-09-09 20:49:58.671632021 +0000 UTC m=+1058.916460581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-maas-api-tls") pod "maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv" (UID: "29f65f8c-bc0f-41db-b3c9-53cad56a7b6a") : secret "maas-api-e2e-explicit-2d6f6c-serving-cert" not found
Sep 09 20:49:58.172149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.172129    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-openshift-service-ca\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.173727 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.173711    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-metrics-certs\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.179854 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.179832    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4z44\" (UniqueName: \"kubernetes.io/projected/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-kube-api-access-b4z44\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.675915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.675878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-maas-api-tls\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.678235 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.678212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-maas-api-tls\") pod \"maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:58.828346 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:58.828313    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:49:59.103451 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:59.103427    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"]
Sep 09 20:49:59.105313 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:49:59.105284    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f65f8c_bc0f_41db_b3c9_53cad56a7b6a.slice/crio-c6b8e1f93958b65dc43cacf41063a2bc70536628131db36b06607ab90ad5ae90 WatchSource:0}: Error finding container c6b8e1f93958b65dc43cacf41063a2bc70536628131db36b06607ab90ad5ae90: Status 404 returned error can't find the container with id c6b8e1f93958b65dc43cacf41063a2bc70536628131db36b06607ab90ad5ae90
Sep 09 20:49:59.106697 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:59.106678    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:49:59.489795 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:49:59.489718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv" event={"ID":"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a","Type":"ContainerStarted","Data":"c6b8e1f93958b65dc43cacf41063a2bc70536628131db36b06607ab90ad5ae90"}
Sep 09 20:50:00.496544 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:00.496499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv" event={"ID":"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a","Type":"ContainerStarted","Data":"a675c0c5a231a8150ee0f997beae7abf5385580adecdfc4e8952a642b768d458"}
Sep 09 20:50:00.496969 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:00.496562    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:50:00.514984 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:00.514927    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv" podStartSLOduration=3.077219748 podStartE2EDuration="3.514907966s" totalImagesPullingTime="437.688218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:49:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:50:00.514332685 +0000 UTC m=+1060.759161267" watchObservedRunningTime="2026-09-09 20:50:00.514907966 +0000 UTC m=+1060.759736546"
Sep 09 20:50:06.508187 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:06.508155    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:50:56.991808 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:56.991776    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"]
Sep 09 20:50:56.995550 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:56.995527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:56.997607 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:56.997588    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-999c8b38-serving-cert\""
Sep 09 20:50:57.008469 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.008443    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"]
Sep 09 20:50:57.181092 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.181035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-metrics-certs\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.181255 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.181157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9dxd\" (UniqueName: \"kubernetes.io/projected/79936167-4b40-45d2-b813-830c556e2ddf-kube-api-access-h9dxd\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.181255 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.181194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79936167-4b40-45d2-b813-830c556e2ddf-openshift-service-ca\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.181255 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.181212    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.281957 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.281926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-metrics-certs\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.282161 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.281985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9dxd\" (UniqueName: \"kubernetes.io/projected/79936167-4b40-45d2-b813-830c556e2ddf-kube-api-access-h9dxd\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.282161 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.282026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79936167-4b40-45d2-b813-830c556e2ddf-openshift-service-ca\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.282161 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.282080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.282291 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:50:57.282180    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-serving-cert: secret "maas-api-e2e-mt-999c8b38-serving-cert" not found
Sep 09 20:50:57.282291 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:50:57.282246    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls podName:79936167-4b40-45d2-b813-830c556e2ddf nodeName:}" failed. No retries permitted until 2026-09-09 20:50:57.782226873 +0000 UTC m=+1118.027055451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls") pod "maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7" (UID: "79936167-4b40-45d2-b813-830c556e2ddf") : secret "maas-api-e2e-mt-999c8b38-serving-cert" not found
Sep 09 20:50:57.282693 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.282668    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79936167-4b40-45d2-b813-830c556e2ddf-openshift-service-ca\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.284481 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.284463    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-metrics-certs\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.290422 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.290401    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9dxd\" (UniqueName: \"kubernetes.io/projected/79936167-4b40-45d2-b813-830c556e2ddf-kube-api-access-h9dxd\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.790071 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:57.787690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:57.790071 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:50:57.787890    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-serving-cert: secret "maas-api-e2e-mt-999c8b38-serving-cert" not found
Sep 09 20:50:57.790071 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:50:57.787952    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls podName:79936167-4b40-45d2-b813-830c556e2ddf nodeName:}" failed. No retries permitted until 2026-09-09 20:50:58.787932881 +0000 UTC m=+1119.032761478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls") pod "maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7" (UID: "79936167-4b40-45d2-b813-830c556e2ddf") : secret "maas-api-e2e-mt-999c8b38-serving-cert" not found
Sep 09 20:50:58.796984 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:58.796955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:58.799559 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:58.799535    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls\") pod \"maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:58.807379 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:58.807354    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:59.081448 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:59.081424    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"]
Sep 09 20:50:59.083422 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:50:59.083395    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79936167_4b40_45d2_b813_830c556e2ddf.slice/crio-077cb541605da6edd3f66c15f03975b53bb72a69bdaf6d5be72707ddbc68c266 WatchSource:0}: Error finding container 077cb541605da6edd3f66c15f03975b53bb72a69bdaf6d5be72707ddbc68c266: Status 404 returned error can't find the container with id 077cb541605da6edd3f66c15f03975b53bb72a69bdaf6d5be72707ddbc68c266
Sep 09 20:50:59.805997 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:59.805964    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7" event={"ID":"79936167-4b40-45d2-b813-830c556e2ddf","Type":"ContainerStarted","Data":"40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004"}
Sep 09 20:50:59.806416 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:59.806014    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7" event={"ID":"79936167-4b40-45d2-b813-830c556e2ddf","Type":"ContainerStarted","Data":"077cb541605da6edd3f66c15f03975b53bb72a69bdaf6d5be72707ddbc68c266"}
Sep 09 20:50:59.806416 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:59.806117    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:50:59.824720 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:50:59.824670    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7" podStartSLOduration=3.461777247 podStartE2EDuration="3.824652752s" totalImagesPullingTime="362.875505ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:50:59.822241723 +0000 UTC m=+1120.067070304" watchObservedRunningTime="2026-09-09 20:50:59.824652752 +0000 UTC m=+1120.069481334"
Sep 09 20:51:05.816857 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:05.816826    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:51:27.977812 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:27.977775    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"]
Sep 09 20:51:27.981354 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:27.981338    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"
Sep 09 20:51:27.983456 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:27.983433    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tsks9\""
Sep 09 20:51:27.992547 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:27.992525    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"]
Sep 09 20:51:28.040060 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:28.040029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6edcbd02-7950-4210-afc7-b9a8cf615750-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc\" (UID: \"6edcbd02-7950-4210-afc7-b9a8cf615750\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"
Sep 09 20:51:28.141173 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:28.141136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6edcbd02-7950-4210-afc7-b9a8cf615750-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc\" (UID: \"6edcbd02-7950-4210-afc7-b9a8cf615750\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"
Sep 09 20:51:28.141728 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:28.141709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6edcbd02-7950-4210-afc7-b9a8cf615750-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc\" (UID: \"6edcbd02-7950-4210-afc7-b9a8cf615750\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"
Sep 09 20:51:28.293018 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:28.292994    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"
Sep 09 20:51:28.564155 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:28.564046    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"]
Sep 09 20:51:28.567343 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:51:28.567313    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6edcbd02_7950_4210_afc7_b9a8cf615750.slice/crio-165cedd41373765333469e58e332ca36540a50a287fb2c0d88c2dbbc964e89f7 WatchSource:0}: Error finding container 165cedd41373765333469e58e332ca36540a50a287fb2c0d88c2dbbc964e89f7: Status 404 returned error can't find the container with id 165cedd41373765333469e58e332ca36540a50a287fb2c0d88c2dbbc964e89f7
Sep 09 20:51:28.966238 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:28.966210    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc" event={"ID":"6edcbd02-7950-4210-afc7-b9a8cf615750","Type":"ContainerStarted","Data":"9ca36c8e73f4cda09fd8aabbbcc72282d948d4166180c63f9f15b360329a6c71"}
Sep 09 20:51:28.966397 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:28.966256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc" event={"ID":"6edcbd02-7950-4210-afc7-b9a8cf615750","Type":"ContainerStarted","Data":"165cedd41373765333469e58e332ca36540a50a287fb2c0d88c2dbbc964e89f7"}
Sep 09 20:51:28.982187 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:28.982131    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc" podStartSLOduration=1.982117307 podStartE2EDuration="1.982117307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:28.981180716 +0000 UTC m=+1149.226009297" watchObservedRunningTime="2026-09-09 20:51:28.982117307 +0000 UTC m=+1149.226945888"
Sep 09 20:51:29.972968 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:29.972928    2576 generic.go:356] "Generic (PLEG): container finished" podID="6edcbd02-7950-4210-afc7-b9a8cf615750" containerID="9ca36c8e73f4cda09fd8aabbbcc72282d948d4166180c63f9f15b360329a6c71" exitCode=0
Sep 09 20:51:29.973155 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:29.972985    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc" event={"ID":"6edcbd02-7950-4210-afc7-b9a8cf615750","Type":"ContainerDied","Data":"9ca36c8e73f4cda09fd8aabbbcc72282d948d4166180c63f9f15b360329a6c71"}
Sep 09 20:51:31.099572 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:31.099545    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"
Sep 09 20:51:31.168699 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:31.168670    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6edcbd02-7950-4210-afc7-b9a8cf615750-maas-api-service-ca\") pod \"6edcbd02-7950-4210-afc7-b9a8cf615750\" (UID: \"6edcbd02-7950-4210-afc7-b9a8cf615750\") "
Sep 09 20:51:31.169029 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:31.169006    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6edcbd02-7950-4210-afc7-b9a8cf615750-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6edcbd02-7950-4210-afc7-b9a8cf615750" (UID: "6edcbd02-7950-4210-afc7-b9a8cf615750"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:51:31.270078 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:31.269990    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6edcbd02-7950-4210-afc7-b9a8cf615750-maas-api-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:51:31.984864 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:31.984835    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"
Sep 09 20:51:31.985036 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:31.984841    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc" event={"ID":"6edcbd02-7950-4210-afc7-b9a8cf615750","Type":"ContainerDied","Data":"165cedd41373765333469e58e332ca36540a50a287fb2c0d88c2dbbc964e89f7"}
Sep 09 20:51:31.985036 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:31.984963    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="165cedd41373765333469e58e332ca36540a50a287fb2c0d88c2dbbc964e89f7"
Sep 09 20:51:38.443910 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.443874    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"]
Sep 09 20:51:38.444403 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.444111    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7" podUID="79936167-4b40-45d2-b813-830c556e2ddf" containerName="maas-api" containerID="cri-o://40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004" gracePeriod=30
Sep 09 20:51:38.692041 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.692013    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:51:38.695660 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.695606    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"]
Sep 09 20:51:38.699160 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.699138    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-999c8b38-pg8dc"]
Sep 09 20:51:38.832867 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.832784    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79936167-4b40-45d2-b813-830c556e2ddf-openshift-service-ca\") pod \"79936167-4b40-45d2-b813-830c556e2ddf\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") "
Sep 09 20:51:38.832867 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.832834    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9dxd\" (UniqueName: \"kubernetes.io/projected/79936167-4b40-45d2-b813-830c556e2ddf-kube-api-access-h9dxd\") pod \"79936167-4b40-45d2-b813-830c556e2ddf\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") "
Sep 09 20:51:38.833160 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.832918    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-metrics-certs\") pod \"79936167-4b40-45d2-b813-830c556e2ddf\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") "
Sep 09 20:51:38.833160 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.833021    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls\") pod \"79936167-4b40-45d2-b813-830c556e2ddf\" (UID: \"79936167-4b40-45d2-b813-830c556e2ddf\") "
Sep 09 20:51:38.833604 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.833312    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79936167-4b40-45d2-b813-830c556e2ddf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "79936167-4b40-45d2-b813-830c556e2ddf" (UID: "79936167-4b40-45d2-b813-830c556e2ddf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:51:38.835909 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.835885    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79936167-4b40-45d2-b813-830c556e2ddf-kube-api-access-h9dxd" (OuterVolumeSpecName: "kube-api-access-h9dxd") pod "79936167-4b40-45d2-b813-830c556e2ddf" (UID: "79936167-4b40-45d2-b813-830c556e2ddf"). InnerVolumeSpecName "kube-api-access-h9dxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:51:38.835909 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.835885    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "79936167-4b40-45d2-b813-830c556e2ddf" (UID: "79936167-4b40-45d2-b813-830c556e2ddf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:51:38.836203 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.836182    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "79936167-4b40-45d2-b813-830c556e2ddf" (UID: "79936167-4b40-45d2-b813-830c556e2ddf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:51:38.933952 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.933924    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:51:38.933952 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.933947    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79936167-4b40-45d2-b813-830c556e2ddf-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:51:38.933952 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.933956    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79936167-4b40-45d2-b813-830c556e2ddf-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:51:38.934169 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:38.933965    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9dxd\" (UniqueName: \"kubernetes.io/projected/79936167-4b40-45d2-b813-830c556e2ddf-kube-api-access-h9dxd\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:51:39.023076 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:39.022976    2576 generic.go:356] "Generic (PLEG): container finished" podID="79936167-4b40-45d2-b813-830c556e2ddf" containerID="40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004" exitCode=0
Sep 09 20:51:39.023076 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:39.023021    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"
Sep 09 20:51:39.023261 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:39.023080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7" event={"ID":"79936167-4b40-45d2-b813-830c556e2ddf","Type":"ContainerDied","Data":"40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004"}
Sep 09 20:51:39.023261 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:39.023129    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7" event={"ID":"79936167-4b40-45d2-b813-830c556e2ddf","Type":"ContainerDied","Data":"077cb541605da6edd3f66c15f03975b53bb72a69bdaf6d5be72707ddbc68c266"}
Sep 09 20:51:39.023261 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:39.023151    2576 scope.go:117] "RemoveContainer" containerID="40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004"
Sep 09 20:51:39.033486 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:39.033471    2576 scope.go:117] "RemoveContainer" containerID="40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004"
Sep 09 20:51:39.033751 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:51:39.033731    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004\": container with ID starting with 40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004 not found: ID does not exist" containerID="40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004"
Sep 09 20:51:39.033826 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:39.033760    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004"} err="failed to get container status \"40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004\": rpc error: code = NotFound desc = could not find container \"40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004\": container with ID starting with 40a33a2b5f85b44314970dd85f098d345b55e8096151f565a9665cf658998004 not found: ID does not exist"
Sep 09 20:51:39.057915 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:39.057895    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"]
Sep 09 20:51:39.064709 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:39.064688    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-999c8b38-dbb65cb9d-8tmj7"]
Sep 09 20:51:40.285317 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:40.285286    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6edcbd02-7950-4210-afc7-b9a8cf615750" path="/var/lib/kubelet/pods/6edcbd02-7950-4210-afc7-b9a8cf615750/volumes"
Sep 09 20:51:40.285674 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:51:40.285660    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79936167-4b40-45d2-b813-830c556e2ddf" path="/var/lib/kubelet/pods/79936167-4b40-45d2-b813-830c556e2ddf/volumes"
Sep 09 20:52:03.315763 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.315729    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"]
Sep 09 20:52:03.317029 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.316877    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79936167-4b40-45d2-b813-830c556e2ddf" containerName="maas-api"
Sep 09 20:52:03.317029 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.316901    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="79936167-4b40-45d2-b813-830c556e2ddf" containerName="maas-api"
Sep 09 20:52:03.317029 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.316918    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6edcbd02-7950-4210-afc7-b9a8cf615750" containerName="revoke-keys"
Sep 09 20:52:03.317029 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.316927    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6edcbd02-7950-4210-afc7-b9a8cf615750" containerName="revoke-keys"
Sep 09 20:52:03.317297 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.317081    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6edcbd02-7950-4210-afc7-b9a8cf615750" containerName="revoke-keys"
Sep 09 20:52:03.317297 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.317098    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="79936167-4b40-45d2-b813-830c556e2ddf" containerName="maas-api"
Sep 09 20:52:03.320652 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.320626    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.322975 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.322956    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-78a7d5-serving-cert\""
Sep 09 20:52:03.334335 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.334297    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"]
Sep 09 20:52:03.352309 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.352286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.352429 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.352338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.352537 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.352515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.352615 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.352601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw7hj\" (UniqueName: \"kubernetes.io/projected/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-kube-api-access-mw7hj\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.453297 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.453263    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.453449 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.453334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw7hj\" (UniqueName: \"kubernetes.io/projected/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-kube-api-access-mw7hj\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.453449 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.453370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.453449 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.453428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.453598 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:52:03.453549    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-serving-cert: secret "maas-api-e2e-shared-a-w2-78a7d5-serving-cert" not found
Sep 09 20:52:03.453651 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:52:03.453618    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-maas-api-tls podName:b29f7c0c-1edb-40ff-808f-0ea18cf74c72 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:03.953597339 +0000 UTC m=+1184.198425896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-maas-api-tls") pod "maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp" (UID: "b29f7c0c-1edb-40ff-808f-0ea18cf74c72") : secret "maas-api-e2e-shared-a-w2-78a7d5-serving-cert" not found
Sep 09 20:52:03.454044 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.454024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.455978 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.455954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.464193 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.464173    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw7hj\" (UniqueName: \"kubernetes.io/projected/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-kube-api-access-mw7hj\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.957859 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.957821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:03.960484 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:03.960458    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:04.231769 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:04.231691    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:04.522188 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:04.522163    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"]
Sep 09 20:52:04.524619 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:52:04.524590    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29f7c0c_1edb_40ff_808f_0ea18cf74c72.slice/crio-821fd9bea64581afd430c96946a14004bde93a5fd1604dad9d7db57fa5ae6ee9 WatchSource:0}: Error finding container 821fd9bea64581afd430c96946a14004bde93a5fd1604dad9d7db57fa5ae6ee9: Status 404 returned error can't find the container with id 821fd9bea64581afd430c96946a14004bde93a5fd1604dad9d7db57fa5ae6ee9
Sep 09 20:52:05.168206 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:05.168170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp" event={"ID":"b29f7c0c-1edb-40ff-808f-0ea18cf74c72","Type":"ContainerStarted","Data":"821fd9bea64581afd430c96946a14004bde93a5fd1604dad9d7db57fa5ae6ee9"}
Sep 09 20:52:06.180716 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:06.180677    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp" event={"ID":"b29f7c0c-1edb-40ff-808f-0ea18cf74c72","Type":"ContainerStarted","Data":"d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0"}
Sep 09 20:52:06.181103 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:06.180808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:06.200856 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:06.200807    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp" podStartSLOduration=2.335016734 podStartE2EDuration="3.200793401s" totalImagesPullingTime="865.776667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:06.198696706 +0000 UTC m=+1186.443525285" watchObservedRunningTime="2026-09-09 20:52:06.200793401 +0000 UTC m=+1186.445621981"
Sep 09 20:52:12.192202 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:12.192173    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 20:52:14.515642 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:14.515610    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"]
Sep 09 20:52:14.519311 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:14.519293    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"
Sep 09 20:52:14.521488 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:14.521468    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tsks9\""
Sep 09 20:52:14.528067 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:14.528028    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"]
Sep 09 20:52:14.644939 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:14.644905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77be3265-6c52-4eed-8b68-00e9425b8317-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r\" (UID: \"77be3265-6c52-4eed-8b68-00e9425b8317\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"
Sep 09 20:52:14.745532 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:14.745502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77be3265-6c52-4eed-8b68-00e9425b8317-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r\" (UID: \"77be3265-6c52-4eed-8b68-00e9425b8317\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"
Sep 09 20:52:14.746151 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:14.746135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77be3265-6c52-4eed-8b68-00e9425b8317-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r\" (UID: \"77be3265-6c52-4eed-8b68-00e9425b8317\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"
Sep 09 20:52:14.830627 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:14.830595    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"
Sep 09 20:52:15.099937 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:15.099911    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"]
Sep 09 20:52:15.102281 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:52:15.102242    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77be3265_6c52_4eed_8b68_00e9425b8317.slice/crio-55a085b60fd118f4c0e6b54e36c15ecee648f1080e4b4f7dc3aef7ba05fb1996 WatchSource:0}: Error finding container 55a085b60fd118f4c0e6b54e36c15ecee648f1080e4b4f7dc3aef7ba05fb1996: Status 404 returned error can't find the container with id 55a085b60fd118f4c0e6b54e36c15ecee648f1080e4b4f7dc3aef7ba05fb1996
Sep 09 20:52:15.230411 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:15.230376    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r" event={"ID":"77be3265-6c52-4eed-8b68-00e9425b8317","Type":"ContainerStarted","Data":"55a085b60fd118f4c0e6b54e36c15ecee648f1080e4b4f7dc3aef7ba05fb1996"}
Sep 09 20:52:16.237589 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:16.237557    2576 generic.go:356] "Generic (PLEG): container finished" podID="77be3265-6c52-4eed-8b68-00e9425b8317" containerID="d92b10ac979867046fd16c41ad5105880ca298758ac7703b5120e06e3d0a9241" exitCode=0
Sep 09 20:52:16.237951 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:16.237637    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r" event={"ID":"77be3265-6c52-4eed-8b68-00e9425b8317","Type":"ContainerDied","Data":"d92b10ac979867046fd16c41ad5105880ca298758ac7703b5120e06e3d0a9241"}
Sep 09 20:52:17.377960 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:17.377937    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"
Sep 09 20:52:17.470170 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:17.470143    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77be3265-6c52-4eed-8b68-00e9425b8317-maas-api-service-ca\") pod \"77be3265-6c52-4eed-8b68-00e9425b8317\" (UID: \"77be3265-6c52-4eed-8b68-00e9425b8317\") "
Sep 09 20:52:17.470501 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:17.470480    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77be3265-6c52-4eed-8b68-00e9425b8317-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "77be3265-6c52-4eed-8b68-00e9425b8317" (UID: "77be3265-6c52-4eed-8b68-00e9425b8317"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:52:17.571246 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:17.571221    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77be3265-6c52-4eed-8b68-00e9425b8317-maas-api-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:52:18.249380 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:18.249347    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"
Sep 09 20:52:18.249380 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:18.249355    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r" event={"ID":"77be3265-6c52-4eed-8b68-00e9425b8317","Type":"ContainerDied","Data":"55a085b60fd118f4c0e6b54e36c15ecee648f1080e4b4f7dc3aef7ba05fb1996"}
Sep 09 20:52:18.249634 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:18.249428    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55a085b60fd118f4c0e6b54e36c15ecee648f1080e4b4f7dc3aef7ba05fb1996"
Sep 09 20:52:20.290602 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:20.290572    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:52:20.292603 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:20.292577    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:52:20.298114 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:20.298095    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:52:20.300381 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:20.300343    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:52:25.104263 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.104232    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"]
Sep 09 20:52:25.104658 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.104443    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv" podUID="29f65f8c-bc0f-41db-b3c9-53cad56a7b6a" containerName="maas-api" containerID="cri-o://a675c0c5a231a8150ee0f997beae7abf5385580adecdfc4e8952a642b768d458" gracePeriod=30
Sep 09 20:52:25.290371 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.290339    2576 generic.go:356] "Generic (PLEG): container finished" podID="29f65f8c-bc0f-41db-b3c9-53cad56a7b6a" containerID="a675c0c5a231a8150ee0f997beae7abf5385580adecdfc4e8952a642b768d458" exitCode=0
Sep 09 20:52:25.290563 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.290426    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv" event={"ID":"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a","Type":"ContainerDied","Data":"a675c0c5a231a8150ee0f997beae7abf5385580adecdfc4e8952a642b768d458"}
Sep 09 20:52:25.351758 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.351723    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:52:25.439960 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.439879    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-openshift-service-ca\") pod \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") "
Sep 09 20:52:25.439960 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.439934    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-metrics-certs\") pod \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") "
Sep 09 20:52:25.440174 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.439981    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4z44\" (UniqueName: \"kubernetes.io/projected/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-kube-api-access-b4z44\") pod \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") "
Sep 09 20:52:25.440174 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.440109    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-maas-api-tls\") pod \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\" (UID: \"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a\") "
Sep 09 20:52:25.440418 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.440391    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "29f65f8c-bc0f-41db-b3c9-53cad56a7b6a" (UID: "29f65f8c-bc0f-41db-b3c9-53cad56a7b6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:52:25.442563 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.442535    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "29f65f8c-bc0f-41db-b3c9-53cad56a7b6a" (UID: "29f65f8c-bc0f-41db-b3c9-53cad56a7b6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:52:25.442767 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.442746    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-kube-api-access-b4z44" (OuterVolumeSpecName: "kube-api-access-b4z44") pod "29f65f8c-bc0f-41db-b3c9-53cad56a7b6a" (UID: "29f65f8c-bc0f-41db-b3c9-53cad56a7b6a"). InnerVolumeSpecName "kube-api-access-b4z44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:52:25.442913 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.442897    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "29f65f8c-bc0f-41db-b3c9-53cad56a7b6a" (UID: "29f65f8c-bc0f-41db-b3c9-53cad56a7b6a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:52:25.445273 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.445248    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"]
Sep 09 20:52:25.447200 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.447176    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-2d6f6c-68w2r"]
Sep 09 20:52:25.540828 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.540792    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:52:25.540828 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.540818    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4z44\" (UniqueName: \"kubernetes.io/projected/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-kube-api-access-b4z44\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:52:25.540828 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.540828    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:52:25.540828 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:25.540838    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:52:26.284293 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:26.284260    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77be3265-6c52-4eed-8b68-00e9425b8317" path="/var/lib/kubelet/pods/77be3265-6c52-4eed-8b68-00e9425b8317/volumes"
Sep 09 20:52:26.297090 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:26.297038    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"
Sep 09 20:52:26.297222 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:26.297095    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv" event={"ID":"29f65f8c-bc0f-41db-b3c9-53cad56a7b6a","Type":"ContainerDied","Data":"c6b8e1f93958b65dc43cacf41063a2bc70536628131db36b06607ab90ad5ae90"}
Sep 09 20:52:26.297222 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:26.297152    2576 scope.go:117] "RemoveContainer" containerID="a675c0c5a231a8150ee0f997beae7abf5385580adecdfc4e8952a642b768d458"
Sep 09 20:52:26.314660 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:26.314636    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"]
Sep 09 20:52:26.321360 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:26.321332    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d6f6c-667dbd6489-fvmkv"]
Sep 09 20:52:28.283938 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:28.283905    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f65f8c-bc0f-41db-b3c9-53cad56a7b6a" path="/var/lib/kubelet/pods/29f65f8c-bc0f-41db-b3c9-53cad56a7b6a/volumes"
Sep 09 20:52:31.804111 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.804080    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"]
Sep 09 20:52:31.804576 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.804457    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77be3265-6c52-4eed-8b68-00e9425b8317" containerName="revoke-keys"
Sep 09 20:52:31.804576 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.804469    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="77be3265-6c52-4eed-8b68-00e9425b8317" containerName="revoke-keys"
Sep 09 20:52:31.804576 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.804499    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f65f8c-bc0f-41db-b3c9-53cad56a7b6a" containerName="maas-api"
Sep 09 20:52:31.804576 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.804506    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f65f8c-bc0f-41db-b3c9-53cad56a7b6a" containerName="maas-api"
Sep 09 20:52:31.804576 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.804564    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f65f8c-bc0f-41db-b3c9-53cad56a7b6a" containerName="maas-api"
Sep 09 20:52:31.804576 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.804571    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="77be3265-6c52-4eed-8b68-00e9425b8317" containerName="revoke-keys"
Sep 09 20:52:31.809064 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.809027    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:31.811081 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.811037    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-3fa05f-serving-cert\""
Sep 09 20:52:31.820982 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.820961    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"]
Sep 09 20:52:31.897502 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.897466    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:31.897601 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.897512    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/115f2657-df14-4c85-95b9-acdac8c58bb5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:31.897654 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.897618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:31.897692 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.897670    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t59pf\" (UniqueName: \"kubernetes.io/projected/115f2657-df14-4c85-95b9-acdac8c58bb5-kube-api-access-t59pf\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:31.999233 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.999202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:31.999468 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.999367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t59pf\" (UniqueName: \"kubernetes.io/projected/115f2657-df14-4c85-95b9-acdac8c58bb5-kube-api-access-t59pf\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:31.999468 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.999408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:31.999468 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:31.999441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/115f2657-df14-4c85-95b9-acdac8c58bb5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:32.000409 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.000377    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/115f2657-df14-4c85-95b9-acdac8c58bb5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:32.002213 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.002191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:32.002686 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.002664    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:32.013211 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.013186    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t59pf\" (UniqueName: \"kubernetes.io/projected/115f2657-df14-4c85-95b9-acdac8c58bb5-kube-api-access-t59pf\") pod \"maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:32.121789 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.121712    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:32.402981 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.402952    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"]
Sep 09 20:52:32.404736 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:52:32.404713    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115f2657_df14_4c85_95b9_acdac8c58bb5.slice/crio-7d22c81a428281eb3b0b14419de502d1144641e6e4b9e5e5d9937be8e94da8a3 WatchSource:0}: Error finding container 7d22c81a428281eb3b0b14419de502d1144641e6e4b9e5e5d9937be8e94da8a3: Status 404 returned error can't find the container with id 7d22c81a428281eb3b0b14419de502d1144641e6e4b9e5e5d9937be8e94da8a3
Sep 09 20:52:32.544455 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.544422    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"]
Sep 09 20:52:32.549202 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.549187    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 20:52:32.551635 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.551612    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-3fa05f-dockercfg-c9tb4\""
Sep 09 20:52:32.551743 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.551669    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-3fa05f\""
Sep 09 20:52:32.556610 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.556589    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"]
Sep 09 20:52:32.707397 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.707324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnn78\" (UniqueName: \"kubernetes.io/projected/9a402cd4-e6e9-452a-84e6-1400c138cf5d-kube-api-access-dnn78\") pod \"payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs\" (UID: \"9a402cd4-e6e9-452a-84e6-1400c138cf5d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 20:52:32.707397 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.707378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a402cd4-e6e9-452a-84e6-1400c138cf5d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs\" (UID: \"9a402cd4-e6e9-452a-84e6-1400c138cf5d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 20:52:32.808830 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.808795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnn78\" (UniqueName: \"kubernetes.io/projected/9a402cd4-e6e9-452a-84e6-1400c138cf5d-kube-api-access-dnn78\") pod \"payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs\" (UID: \"9a402cd4-e6e9-452a-84e6-1400c138cf5d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 20:52:32.809186 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.808836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a402cd4-e6e9-452a-84e6-1400c138cf5d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs\" (UID: \"9a402cd4-e6e9-452a-84e6-1400c138cf5d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 20:52:32.809536 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.809515    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a402cd4-e6e9-452a-84e6-1400c138cf5d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs\" (UID: \"9a402cd4-e6e9-452a-84e6-1400c138cf5d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 20:52:32.819575 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.819548    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnn78\" (UniqueName: \"kubernetes.io/projected/9a402cd4-e6e9-452a-84e6-1400c138cf5d-kube-api-access-dnn78\") pod \"payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs\" (UID: \"9a402cd4-e6e9-452a-84e6-1400c138cf5d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 20:52:32.861365 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:32.861340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 20:52:33.137966 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:33.137940    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"]
Sep 09 20:52:33.142097 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:52:33.142043    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a402cd4_e6e9_452a_84e6_1400c138cf5d.slice/crio-d63d86c312dc112f551951cdc98b0af12964319988db50ee5c09449742993f50 WatchSource:0}: Error finding container d63d86c312dc112f551951cdc98b0af12964319988db50ee5c09449742993f50: Status 404 returned error can't find the container with id d63d86c312dc112f551951cdc98b0af12964319988db50ee5c09449742993f50
Sep 09 20:52:33.339838 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:33.339802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs" event={"ID":"9a402cd4-e6e9-452a-84e6-1400c138cf5d","Type":"ContainerStarted","Data":"a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f"}
Sep 09 20:52:33.340018 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:33.339967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 20:52:33.340111 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:33.340021    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs" event={"ID":"9a402cd4-e6e9-452a-84e6-1400c138cf5d","Type":"ContainerStarted","Data":"d63d86c312dc112f551951cdc98b0af12964319988db50ee5c09449742993f50"}
Sep 09 20:52:33.341527 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:33.341462    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98" event={"ID":"115f2657-df14-4c85-95b9-acdac8c58bb5","Type":"ContainerStarted","Data":"2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f"}
Sep 09 20:52:33.341527 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:33.341525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98" event={"ID":"115f2657-df14-4c85-95b9-acdac8c58bb5","Type":"ContainerStarted","Data":"7d22c81a428281eb3b0b14419de502d1144641e6e4b9e5e5d9937be8e94da8a3"}
Sep 09 20:52:33.341712 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:33.341547    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:33.358278 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:33.358238    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs" podStartSLOduration=1.358224839 podStartE2EDuration="1.358224839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:33.356041166 +0000 UTC m=+1213.600869748" watchObservedRunningTime="2026-09-09 20:52:33.358224839 +0000 UTC m=+1213.603053486"
Sep 09 20:52:33.378362 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:33.378317    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98" podStartSLOduration=1.693078836 podStartE2EDuration="2.378297567s" totalImagesPullingTime="685.218731ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:33.376512793 +0000 UTC m=+1213.621341374" watchObservedRunningTime="2026-09-09 20:52:33.378297567 +0000 UTC m=+1213.623126147"
Sep 09 20:52:39.353069 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:39.353031    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 20:52:44.349264 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:44.349222    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 20:52:56.167817 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:56.167781    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7672-140501690140400"]
Sep 09 20:52:56.171493 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:56.171476    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:52:56.173892 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:56.173866    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-744w4\""
Sep 09 20:52:56.175999 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:56.175972    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7672-140501690140400"]
Sep 09 20:52:56.208866 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:56.208844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6srxx\" (UniqueName: \"kubernetes.io/projected/1dfa9761-3648-4b95-89b3-a4ced9f846ec-kube-api-access-6srxx\") pod \"test-curl-7672-140501690140400\" (UID: \"1dfa9761-3648-4b95-89b3-a4ced9f846ec\") " pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:52:56.309546 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:56.309497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6srxx\" (UniqueName: \"kubernetes.io/projected/1dfa9761-3648-4b95-89b3-a4ced9f846ec-kube-api-access-6srxx\") pod \"test-curl-7672-140501690140400\" (UID: \"1dfa9761-3648-4b95-89b3-a4ced9f846ec\") " pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:52:56.320478 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:56.320452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6srxx\" (UniqueName: \"kubernetes.io/projected/1dfa9761-3648-4b95-89b3-a4ced9f846ec-kube-api-access-6srxx\") pod \"test-curl-7672-140501690140400\" (UID: \"1dfa9761-3648-4b95-89b3-a4ced9f846ec\") " pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:52:56.481613 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:56.481551    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:52:56.752203 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:56.752175    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7672-140501690140400"]
Sep 09 20:52:56.754184 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:52:56.754160    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dfa9761_3648_4b95_89b3_a4ced9f846ec.slice/crio-f737d384f6718744eeab71a6582e4d5bfc5da9c1cdaab8c82ddf68bacfe0a544 WatchSource:0}: Error finding container f737d384f6718744eeab71a6582e4d5bfc5da9c1cdaab8c82ddf68bacfe0a544: Status 404 returned error can't find the container with id f737d384f6718744eeab71a6582e4d5bfc5da9c1cdaab8c82ddf68bacfe0a544
Sep 09 20:52:57.472238 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:57.472205    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7672-140501690140400" event={"ID":"1dfa9761-3648-4b95-89b3-a4ced9f846ec","Type":"ContainerStarted","Data":"f737d384f6718744eeab71a6582e4d5bfc5da9c1cdaab8c82ddf68bacfe0a544"}
Sep 09 20:52:58.479612 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:58.479577    2576 generic.go:356] "Generic (PLEG): container finished" podID="1dfa9761-3648-4b95-89b3-a4ced9f846ec" containerID="c663ced61f0608376ae4a26f57378ab9dcb406554564a038710781cc8846557d" exitCode=0
Sep 09 20:52:58.479993 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:58.479669    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7672-140501690140400" event={"ID":"1dfa9761-3648-4b95-89b3-a4ced9f846ec","Type":"ContainerDied","Data":"c663ced61f0608376ae4a26f57378ab9dcb406554564a038710781cc8846557d"}
Sep 09 20:52:59.617738 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.617717    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:52:59.652219 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.652197    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7672-140501690140400_1dfa9761-3648-4b95-89b3-a4ced9f846ec/test-curl-7672-140501690140400/0.log"
Sep 09 20:52:59.675184 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.675160    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7672-140501690140400"]
Sep 09 20:52:59.680831 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.680811    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7672-140501690140400"]
Sep 09 20:52:59.739077 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.739005    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6srxx\" (UniqueName: \"kubernetes.io/projected/1dfa9761-3648-4b95-89b3-a4ced9f846ec-kube-api-access-6srxx\") pod \"1dfa9761-3648-4b95-89b3-a4ced9f846ec\" (UID: \"1dfa9761-3648-4b95-89b3-a4ced9f846ec\") "
Sep 09 20:52:59.741149 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.741120    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dfa9761-3648-4b95-89b3-a4ced9f846ec-kube-api-access-6srxx" (OuterVolumeSpecName: "kube-api-access-6srxx") pod "1dfa9761-3648-4b95-89b3-a4ced9f846ec" (UID: "1dfa9761-3648-4b95-89b3-a4ced9f846ec"). InnerVolumeSpecName "kube-api-access-6srxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:52:59.811580 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.811560    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7672-140501690140400"]
Sep 09 20:52:59.811969 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.811957    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dfa9761-3648-4b95-89b3-a4ced9f846ec" containerName="test-curl-7672-140501690140400"
Sep 09 20:52:59.812013 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.811971    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dfa9761-3648-4b95-89b3-a4ced9f846ec" containerName="test-curl-7672-140501690140400"
Sep 09 20:52:59.812075 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.812044    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dfa9761-3648-4b95-89b3-a4ced9f846ec" containerName="test-curl-7672-140501690140400"
Sep 09 20:52:59.815045 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.815031    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:52:59.822466 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.822339    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7672-140501690140400"]
Sep 09 20:52:59.839992 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.839972    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szn2w\" (UniqueName: \"kubernetes.io/projected/b487fdd0-7b57-4b18-b487-7379830619c3-kube-api-access-szn2w\") pod \"test-curl-7672-140501690140400\" (UID: \"b487fdd0-7b57-4b18-b487-7379830619c3\") " pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:52:59.840100 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.840084    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6srxx\" (UniqueName: \"kubernetes.io/projected/1dfa9761-3648-4b95-89b3-a4ced9f846ec-kube-api-access-6srxx\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:52:59.940628 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.940595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szn2w\" (UniqueName: \"kubernetes.io/projected/b487fdd0-7b57-4b18-b487-7379830619c3-kube-api-access-szn2w\") pod \"test-curl-7672-140501690140400\" (UID: \"b487fdd0-7b57-4b18-b487-7379830619c3\") " pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:52:59.948730 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:52:59.948689    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szn2w\" (UniqueName: \"kubernetes.io/projected/b487fdd0-7b57-4b18-b487-7379830619c3-kube-api-access-szn2w\") pod \"test-curl-7672-140501690140400\" (UID: \"b487fdd0-7b57-4b18-b487-7379830619c3\") " pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:53:00.125478 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:00.125443    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:53:00.284660 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:00.284627    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dfa9761-3648-4b95-89b3-a4ced9f846ec" path="/var/lib/kubelet/pods/1dfa9761-3648-4b95-89b3-a4ced9f846ec/volumes"
Sep 09 20:53:00.393490 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:00.393468    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7672-140501690140400"]
Sep 09 20:53:00.395604 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:53:00.395576    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb487fdd0_7b57_4b18_b487_7379830619c3.slice/crio-4718650fb7b8f759607f77c0c04632ddd5ee2835db574b2fbf6924b60ba71fd8 WatchSource:0}: Error finding container 4718650fb7b8f759607f77c0c04632ddd5ee2835db574b2fbf6924b60ba71fd8: Status 404 returned error can't find the container with id 4718650fb7b8f759607f77c0c04632ddd5ee2835db574b2fbf6924b60ba71fd8
Sep 09 20:53:00.490714 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:00.490689    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:53:00.490714 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:00.490715    2576 scope.go:117] "RemoveContainer" containerID="c663ced61f0608376ae4a26f57378ab9dcb406554564a038710781cc8846557d"
Sep 09 20:53:00.492078 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:00.492031    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7672-140501690140400" event={"ID":"b487fdd0-7b57-4b18-b487-7379830619c3","Type":"ContainerStarted","Data":"4718650fb7b8f759607f77c0c04632ddd5ee2835db574b2fbf6924b60ba71fd8"}
Sep 09 20:53:01.499585 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:01.499494    2576 generic.go:356] "Generic (PLEG): container finished" podID="b487fdd0-7b57-4b18-b487-7379830619c3" containerID="2012c82abe0047e4081881f574445e57f2636336b763882130c8e8d7303a4fb8" exitCode=0
Sep 09 20:53:01.499920 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:01.499586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7672-140501690140400" event={"ID":"b487fdd0-7b57-4b18-b487-7379830619c3","Type":"ContainerDied","Data":"2012c82abe0047e4081881f574445e57f2636336b763882130c8e8d7303a4fb8"}
Sep 09 20:53:02.639471 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.639446    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:53:02.659501 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.659460    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7672-140501690140400_b487fdd0-7b57-4b18-b487-7379830619c3/test-curl-7672-140501690140400/0.log"
Sep 09 20:53:02.682345 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.682311    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7672-140501690140400"]
Sep 09 20:53:02.686232 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.686209    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7672-140501690140400"]
Sep 09 20:53:02.765718 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.765663    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szn2w\" (UniqueName: \"kubernetes.io/projected/b487fdd0-7b57-4b18-b487-7379830619c3-kube-api-access-szn2w\") pod \"b487fdd0-7b57-4b18-b487-7379830619c3\" (UID: \"b487fdd0-7b57-4b18-b487-7379830619c3\") "
Sep 09 20:53:02.767796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.767769    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b487fdd0-7b57-4b18-b487-7379830619c3-kube-api-access-szn2w" (OuterVolumeSpecName: "kube-api-access-szn2w") pod "b487fdd0-7b57-4b18-b487-7379830619c3" (UID: "b487fdd0-7b57-4b18-b487-7379830619c3"). InnerVolumeSpecName "kube-api-access-szn2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:53:02.802072 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.802020    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7672-140501690140976"]
Sep 09 20:53:02.803005 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.802980    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b487fdd0-7b57-4b18-b487-7379830619c3" containerName="test-curl-7672-140501690140400"
Sep 09 20:53:02.803134 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.803009    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b487fdd0-7b57-4b18-b487-7379830619c3" containerName="test-curl-7672-140501690140400"
Sep 09 20:53:02.803234 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.803220    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b487fdd0-7b57-4b18-b487-7379830619c3" containerName="test-curl-7672-140501690140400"
Sep 09 20:53:02.807404 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.807384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:02.809246 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.809221    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7672-140501690140976"]
Sep 09 20:53:02.866516 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.866493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zznqf\" (UniqueName: \"kubernetes.io/projected/6510aa56-45a4-482a-9aa5-204c09227a61-kube-api-access-zznqf\") pod \"test-curl-7672-140501690140976\" (UID: \"6510aa56-45a4-482a-9aa5-204c09227a61\") " pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:02.866611 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.866552    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szn2w\" (UniqueName: \"kubernetes.io/projected/b487fdd0-7b57-4b18-b487-7379830619c3-kube-api-access-szn2w\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:53:02.967318 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.967289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zznqf\" (UniqueName: \"kubernetes.io/projected/6510aa56-45a4-482a-9aa5-204c09227a61-kube-api-access-zznqf\") pod \"test-curl-7672-140501690140976\" (UID: \"6510aa56-45a4-482a-9aa5-204c09227a61\") " pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:02.975911 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:02.975880    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zznqf\" (UniqueName: \"kubernetes.io/projected/6510aa56-45a4-482a-9aa5-204c09227a61-kube-api-access-zznqf\") pod \"test-curl-7672-140501690140976\" (UID: \"6510aa56-45a4-482a-9aa5-204c09227a61\") " pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:03.117973 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:03.117933    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:03.389394 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:03.389365    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7672-140501690140976"]
Sep 09 20:53:03.390637 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:53:03.390612    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6510aa56_45a4_482a_9aa5_204c09227a61.slice/crio-7028f675843966853cdf9f254a586ea3b3be6596a66cf60b09e52c2b6474a042 WatchSource:0}: Error finding container 7028f675843966853cdf9f254a586ea3b3be6596a66cf60b09e52c2b6474a042: Status 404 returned error can't find the container with id 7028f675843966853cdf9f254a586ea3b3be6596a66cf60b09e52c2b6474a042
Sep 09 20:53:03.511970 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:03.511947    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:53:03.512110 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:03.511985    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4718650fb7b8f759607f77c0c04632ddd5ee2835db574b2fbf6924b60ba71fd8"
Sep 09 20:53:03.513224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:03.513204    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7672-140501690140976" event={"ID":"6510aa56-45a4-482a-9aa5-204c09227a61","Type":"ContainerStarted","Data":"7028f675843966853cdf9f254a586ea3b3be6596a66cf60b09e52c2b6474a042"}
Sep 09 20:53:03.522312 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:53:03.522289    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7672-140501690140400\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="b487fdd0-7b57-4b18-b487-7379830619c3" pod="opendatahub/test-curl-7672-140501690140400"
Sep 09 20:53:04.283998 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:04.283967    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b487fdd0-7b57-4b18-b487-7379830619c3" path="/var/lib/kubelet/pods/b487fdd0-7b57-4b18-b487-7379830619c3/volumes"
Sep 09 20:53:05.524895 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:05.524853    2576 generic.go:356] "Generic (PLEG): container finished" podID="6510aa56-45a4-482a-9aa5-204c09227a61" containerID="659bdb173b8e8d91fed5f2a75df7c5b13a067de4e692005e89b27cc522df4f80" exitCode=0
Sep 09 20:53:05.525298 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:05.524932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7672-140501690140976" event={"ID":"6510aa56-45a4-482a-9aa5-204c09227a61","Type":"ContainerDied","Data":"659bdb173b8e8d91fed5f2a75df7c5b13a067de4e692005e89b27cc522df4f80"}
Sep 09 20:53:06.665712 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.665683    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:06.684445 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.684403    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7672-140501690140976_6510aa56-45a4-482a-9aa5-204c09227a61/test-curl-7672-140501690140976/0.log"
Sep 09 20:53:06.706011 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.705985    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7672-140501690140976"]
Sep 09 20:53:06.710168 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.710147    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7672-140501690140976"]
Sep 09 20:53:06.800960 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.800934    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zznqf\" (UniqueName: \"kubernetes.io/projected/6510aa56-45a4-482a-9aa5-204c09227a61-kube-api-access-zznqf\") pod \"6510aa56-45a4-482a-9aa5-204c09227a61\" (UID: \"6510aa56-45a4-482a-9aa5-204c09227a61\") "
Sep 09 20:53:06.802989 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.802965    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6510aa56-45a4-482a-9aa5-204c09227a61-kube-api-access-zznqf" (OuterVolumeSpecName: "kube-api-access-zznqf") pod "6510aa56-45a4-482a-9aa5-204c09227a61" (UID: "6510aa56-45a4-482a-9aa5-204c09227a61"). InnerVolumeSpecName "kube-api-access-zznqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:53:06.826921 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.826894    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7672-140501690140976"]
Sep 09 20:53:06.827333 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.827319    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6510aa56-45a4-482a-9aa5-204c09227a61" containerName="test-curl-7672-140501690140976"
Sep 09 20:53:06.827388 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.827334    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6510aa56-45a4-482a-9aa5-204c09227a61" containerName="test-curl-7672-140501690140976"
Sep 09 20:53:06.827424 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.827414    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6510aa56-45a4-482a-9aa5-204c09227a61" containerName="test-curl-7672-140501690140976"
Sep 09 20:53:06.830349 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.830333    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:06.834866 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.834842    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7672-140501690140976"]
Sep 09 20:53:06.902113 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.902087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm4r8\" (UniqueName: \"kubernetes.io/projected/de18398d-cdb1-47b1-81be-f827ab1a0cd4-kube-api-access-pm4r8\") pod \"test-curl-7672-140501690140976\" (UID: \"de18398d-cdb1-47b1-81be-f827ab1a0cd4\") " pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:06.902239 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:06.902219    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zznqf\" (UniqueName: \"kubernetes.io/projected/6510aa56-45a4-482a-9aa5-204c09227a61-kube-api-access-zznqf\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:53:07.003525 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:07.003492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm4r8\" (UniqueName: \"kubernetes.io/projected/de18398d-cdb1-47b1-81be-f827ab1a0cd4-kube-api-access-pm4r8\") pod \"test-curl-7672-140501690140976\" (UID: \"de18398d-cdb1-47b1-81be-f827ab1a0cd4\") " pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:07.011592 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:07.011567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm4r8\" (UniqueName: \"kubernetes.io/projected/de18398d-cdb1-47b1-81be-f827ab1a0cd4-kube-api-access-pm4r8\") pod \"test-curl-7672-140501690140976\" (UID: \"de18398d-cdb1-47b1-81be-f827ab1a0cd4\") " pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:07.140753 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:07.140693    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:07.412176 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:07.412152    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7672-140501690140976"]
Sep 09 20:53:07.414124 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:53:07.414100    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde18398d_cdb1_47b1_81be_f827ab1a0cd4.slice/crio-558d94ca238c025cc50005ef4a5127f2b4aa1160f56ec186a114f8b3fee22856 WatchSource:0}: Error finding container 558d94ca238c025cc50005ef4a5127f2b4aa1160f56ec186a114f8b3fee22856: Status 404 returned error can't find the container with id 558d94ca238c025cc50005ef4a5127f2b4aa1160f56ec186a114f8b3fee22856
Sep 09 20:53:07.545237 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:07.545210    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:07.545395 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:07.545247    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7028f675843966853cdf9f254a586ea3b3be6596a66cf60b09e52c2b6474a042"
Sep 09 20:53:07.546552 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:07.546524    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7672-140501690140976" event={"ID":"de18398d-cdb1-47b1-81be-f827ab1a0cd4","Type":"ContainerStarted","Data":"558d94ca238c025cc50005ef4a5127f2b4aa1160f56ec186a114f8b3fee22856"}
Sep 09 20:53:07.557177 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:07.557152    2576 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7672-140501690140976" oldPodUID="6510aa56-45a4-482a-9aa5-204c09227a61" podUID="de18398d-cdb1-47b1-81be-f827ab1a0cd4"
Sep 09 20:53:08.283662 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:08.283636    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6510aa56-45a4-482a-9aa5-204c09227a61" path="/var/lib/kubelet/pods/6510aa56-45a4-482a-9aa5-204c09227a61/volumes"
Sep 09 20:53:08.556567 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:08.556533    2576 generic.go:356] "Generic (PLEG): container finished" podID="de18398d-cdb1-47b1-81be-f827ab1a0cd4" containerID="c3773cb9b3629ffba0447effe403da63e579ccec6a710d55680d1c1d27d2b927" exitCode=0
Sep 09 20:53:08.556757 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:08.556625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7672-140501690140976" event={"ID":"de18398d-cdb1-47b1-81be-f827ab1a0cd4","Type":"ContainerDied","Data":"c3773cb9b3629ffba0447effe403da63e579ccec6a710d55680d1c1d27d2b927"}
Sep 09 20:53:09.697366 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:09.697036    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:09.722959 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:09.722933    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7672-140501690140976_de18398d-cdb1-47b1-81be-f827ab1a0cd4/test-curl-7672-140501690140976/0.log"
Sep 09 20:53:09.751863 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:09.751838    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7672-140501690140976"]
Sep 09 20:53:09.753929 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:09.753905    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7672-140501690140976"]
Sep 09 20:53:09.830093 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:09.829994    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm4r8\" (UniqueName: \"kubernetes.io/projected/de18398d-cdb1-47b1-81be-f827ab1a0cd4-kube-api-access-pm4r8\") pod \"de18398d-cdb1-47b1-81be-f827ab1a0cd4\" (UID: \"de18398d-cdb1-47b1-81be-f827ab1a0cd4\") "
Sep 09 20:53:09.832250 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:09.832219    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de18398d-cdb1-47b1-81be-f827ab1a0cd4-kube-api-access-pm4r8" (OuterVolumeSpecName: "kube-api-access-pm4r8") pod "de18398d-cdb1-47b1-81be-f827ab1a0cd4" (UID: "de18398d-cdb1-47b1-81be-f827ab1a0cd4"). InnerVolumeSpecName "kube-api-access-pm4r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:53:09.931160 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:09.931116    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm4r8\" (UniqueName: \"kubernetes.io/projected/de18398d-cdb1-47b1-81be-f827ab1a0cd4-kube-api-access-pm4r8\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:53:10.284427 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:10.284354    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de18398d-cdb1-47b1-81be-f827ab1a0cd4" path="/var/lib/kubelet/pods/de18398d-cdb1-47b1-81be-f827ab1a0cd4/volumes"
Sep 09 20:53:10.569231 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:10.569201    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7672-140501690140976"
Sep 09 20:53:10.569401 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:10.569208    2576 scope.go:117] "RemoveContainer" containerID="c3773cb9b3629ffba0447effe403da63e579ccec6a710d55680d1c1d27d2b927"
Sep 09 20:53:14.817923 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:14.817850    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"]
Sep 09 20:53:14.818370 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:14.818353    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de18398d-cdb1-47b1-81be-f827ab1a0cd4" containerName="test-curl-7672-140501690140976"
Sep 09 20:53:14.818421 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:14.818371    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de18398d-cdb1-47b1-81be-f827ab1a0cd4" containerName="test-curl-7672-140501690140976"
Sep 09 20:53:14.818465 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:14.818455    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="de18398d-cdb1-47b1-81be-f827ab1a0cd4" containerName="test-curl-7672-140501690140976"
Sep 09 20:53:14.822754 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:14.822730    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:14.825129 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:14.825107    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-fbe7be47-serving-cert\""
Sep 09 20:53:14.833681 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:14.833554    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"]
Sep 09 20:53:14.980313 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:14.980275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-maas-api-tls\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:14.980460 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:14.980394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-metrics-certs\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:14.980460 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:14.980418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhf7p\" (UniqueName: \"kubernetes.io/projected/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-kube-api-access-qhf7p\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:14.980547 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:14.980488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-openshift-service-ca\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:15.081493 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:15.081417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-maas-api-tls\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:15.081493 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:15.081476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-metrics-certs\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:15.081715 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:15.081494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhf7p\" (UniqueName: \"kubernetes.io/projected/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-kube-api-access-qhf7p\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:15.081715 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:15.081543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-openshift-service-ca\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:15.081715 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:53:15.081561    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-serving-cert: secret "maas-api-e2e-mt-fbe7be47-serving-cert" not found
Sep 09 20:53:15.081715 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:53:15.081621    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-maas-api-tls podName:1e808ad4-d2fd-4efb-80e5-b8820a0e15e9 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:15.581603556 +0000 UTC m=+1255.826432119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-maas-api-tls") pod "maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs" (UID: "1e808ad4-d2fd-4efb-80e5-b8820a0e15e9") : secret "maas-api-e2e-mt-fbe7be47-serving-cert" not found
Sep 09 20:53:15.082185 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:15.082168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-openshift-service-ca\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:15.083933 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:15.083914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-metrics-certs\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:15.092410 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:15.092389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhf7p\" (UniqueName: \"kubernetes.io/projected/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-kube-api-access-qhf7p\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:15.585516 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:15.585484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-maas-api-tls\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:15.587875 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:15.587851    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-maas-api-tls\") pod \"maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:15.735246 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:15.735207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:16.016805 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:16.016781    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"]
Sep 09 20:53:16.018853 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:53:16.018827    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e808ad4_d2fd_4efb_80e5_b8820a0e15e9.slice/crio-5a651f4332f969c9d972f0ab265e956ab88214be824632294b492d92e3977792 WatchSource:0}: Error finding container 5a651f4332f969c9d972f0ab265e956ab88214be824632294b492d92e3977792: Status 404 returned error can't find the container with id 5a651f4332f969c9d972f0ab265e956ab88214be824632294b492d92e3977792
Sep 09 20:53:16.608848 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:16.608815    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs" event={"ID":"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9","Type":"ContainerStarted","Data":"bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab"}
Sep 09 20:53:16.608983 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:16.608881    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:53:16.608983 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:16.608905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs" event={"ID":"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9","Type":"ContainerStarted","Data":"5a651f4332f969c9d972f0ab265e956ab88214be824632294b492d92e3977792"}
Sep 09 20:53:16.629232 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:16.629178    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs" podStartSLOduration=2.107062788 podStartE2EDuration="2.629159018s" totalImagesPullingTime="522.09623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:16.628496206 +0000 UTC m=+1256.873324778" watchObservedRunningTime="2026-09-09 20:53:16.629159018 +0000 UTC m=+1256.873987600"
Sep 09 20:53:22.619773 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:53:22.619739    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:54:13.666109 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.666073    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"]
Sep 09 20:54:13.666612 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.666335    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999" podUID="8e480df6-4fd2-40a5-9316-3d9c2f9c82c9" containerName="payload-processing" containerID="cri-o://c382d3110341404575e57fb24ac2124b9364cb00cfe277b4accba65a009350ba" gracePeriod=30
Sep 09 20:54:13.676503 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.676476    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"]
Sep 09 20:54:13.676730 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.676704    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2" podUID="ec60401c-6bec-40d9-a3a3-213f833c96bc" containerName="payload-pre-processing" containerID="cri-o://858438f562abbca614f21550d0dfb433588b5bf9a782a07de8e60c595f2f3f4f" gracePeriod=30
Sep 09 20:54:13.934148 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.934070    2576 generic.go:356] "Generic (PLEG): container finished" podID="ec60401c-6bec-40d9-a3a3-213f833c96bc" containerID="858438f562abbca614f21550d0dfb433588b5bf9a782a07de8e60c595f2f3f4f" exitCode=0
Sep 09 20:54:13.934148 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.934089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2" event={"ID":"ec60401c-6bec-40d9-a3a3-213f833c96bc","Type":"ContainerDied","Data":"858438f562abbca614f21550d0dfb433588b5bf9a782a07de8e60c595f2f3f4f"}
Sep 09 20:54:13.935722 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.935700    2576 generic.go:356] "Generic (PLEG): container finished" podID="8e480df6-4fd2-40a5-9316-3d9c2f9c82c9" containerID="c382d3110341404575e57fb24ac2124b9364cb00cfe277b4accba65a009350ba" exitCode=0
Sep 09 20:54:13.935865 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.935778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999" event={"ID":"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9","Type":"ContainerDied","Data":"c382d3110341404575e57fb24ac2124b9364cb00cfe277b4accba65a009350ba"}
Sep 09 20:54:13.935865 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.935815    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999" event={"ID":"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9","Type":"ContainerDied","Data":"8d26b8e90442993c6d70a8f316437c08c4b55f586991f1c60e9ed443315d63a8"}
Sep 09 20:54:13.935865 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.935833    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d26b8e90442993c6d70a8f316437c08c4b55f586991f1c60e9ed443315d63a8"
Sep 09 20:54:13.936174 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.936159    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:54:13.959869 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:13.959845    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:54:14.121329 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.121297    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-plugins-config-volume\") pod \"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9\" (UID: \"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9\") "
Sep 09 20:54:14.121498 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.121381    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpqln\" (UniqueName: \"kubernetes.io/projected/ec60401c-6bec-40d9-a3a3-213f833c96bc-kube-api-access-gpqln\") pod \"ec60401c-6bec-40d9-a3a3-213f833c96bc\" (UID: \"ec60401c-6bec-40d9-a3a3-213f833c96bc\") "
Sep 09 20:54:14.121498 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.121401    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khh7j\" (UniqueName: \"kubernetes.io/projected/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-kube-api-access-khh7j\") pod \"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9\" (UID: \"8e480df6-4fd2-40a5-9316-3d9c2f9c82c9\") "
Sep 09 20:54:14.121498 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.121439    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec60401c-6bec-40d9-a3a3-213f833c96bc-plugins-config-volume\") pod \"ec60401c-6bec-40d9-a3a3-213f833c96bc\" (UID: \"ec60401c-6bec-40d9-a3a3-213f833c96bc\") "
Sep 09 20:54:14.121843 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.121816    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8e480df6-4fd2-40a5-9316-3d9c2f9c82c9" (UID: "8e480df6-4fd2-40a5-9316-3d9c2f9c82c9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:54:14.121922 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.121843    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec60401c-6bec-40d9-a3a3-213f833c96bc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ec60401c-6bec-40d9-a3a3-213f833c96bc" (UID: "ec60401c-6bec-40d9-a3a3-213f833c96bc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:54:14.123526 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.123506    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-kube-api-access-khh7j" (OuterVolumeSpecName: "kube-api-access-khh7j") pod "8e480df6-4fd2-40a5-9316-3d9c2f9c82c9" (UID: "8e480df6-4fd2-40a5-9316-3d9c2f9c82c9"). InnerVolumeSpecName "kube-api-access-khh7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:54:14.123598 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.123532    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec60401c-6bec-40d9-a3a3-213f833c96bc-kube-api-access-gpqln" (OuterVolumeSpecName: "kube-api-access-gpqln") pod "ec60401c-6bec-40d9-a3a3-213f833c96bc" (UID: "ec60401c-6bec-40d9-a3a3-213f833c96bc"). InnerVolumeSpecName "kube-api-access-gpqln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:54:14.223143 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.223077    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:54:14.223143 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.223101    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpqln\" (UniqueName: \"kubernetes.io/projected/ec60401c-6bec-40d9-a3a3-213f833c96bc-kube-api-access-gpqln\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:54:14.223143 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.223112    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khh7j\" (UniqueName: \"kubernetes.io/projected/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9-kube-api-access-khh7j\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:54:14.223143 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.223122    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec60401c-6bec-40d9-a3a3-213f833c96bc-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:54:14.942141 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.942033    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"
Sep 09 20:54:14.942141 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.942081    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"
Sep 09 20:54:14.942141 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.942070    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2" event={"ID":"ec60401c-6bec-40d9-a3a3-213f833c96bc","Type":"ContainerDied","Data":"57a7b42fb5b790258e03e594ab510a208a220d9101de865aea30e3499aa32fe6"}
Sep 09 20:54:14.942700 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.942171    2576 scope.go:117] "RemoveContainer" containerID="858438f562abbca614f21550d0dfb433588b5bf9a782a07de8e60c595f2f3f4f"
Sep 09 20:54:14.961194 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.961167    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"]
Sep 09 20:54:14.963388 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.963368    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2"]
Sep 09 20:54:14.972821 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.972798    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"]
Sep 09 20:54:14.977340 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:14.977322    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999"]
Sep 09 20:54:16.284150 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:16.284116    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e480df6-4fd2-40a5-9316-3d9c2f9c82c9" path="/var/lib/kubelet/pods/8e480df6-4fd2-40a5-9316-3d9c2f9c82c9/volumes"
Sep 09 20:54:16.284500 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:16.284453    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec60401c-6bec-40d9-a3a3-213f833c96bc" path="/var/lib/kubelet/pods/ec60401c-6bec-40d9-a3a3-213f833c96bc/volumes"
Sep 09 20:54:17.374972 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.374941    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"]
Sep 09 20:54:17.375475 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.375366    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e480df6-4fd2-40a5-9316-3d9c2f9c82c9" containerName="payload-processing"
Sep 09 20:54:17.375475 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.375379    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e480df6-4fd2-40a5-9316-3d9c2f9c82c9" containerName="payload-processing"
Sep 09 20:54:17.375475 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.375392    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec60401c-6bec-40d9-a3a3-213f833c96bc" containerName="payload-pre-processing"
Sep 09 20:54:17.375475 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.375397    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec60401c-6bec-40d9-a3a3-213f833c96bc" containerName="payload-pre-processing"
Sep 09 20:54:17.375714 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.375481    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e480df6-4fd2-40a5-9316-3d9c2f9c82c9" containerName="payload-processing"
Sep 09 20:54:17.375714 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.375489    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec60401c-6bec-40d9-a3a3-213f833c96bc" containerName="payload-pre-processing"
Sep 09 20:54:17.379893 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.379870    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.382877 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.382854    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-2b2343\"/\"openshift-service-ca.crt\""
Sep 09 20:54:17.382877 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.382870    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-2b2343\"/\"kube-root-ca.crt\""
Sep 09 20:54:17.383024 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.382884    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2b2343\"/\"default-dockercfg-v4nrn\""
Sep 09 20:54:17.383024 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.382854    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2b2343\"/\"distinct-2-w0-2b2343-kserve-self-signed-certs\""
Sep 09 20:54:17.386307 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.386283    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"]
Sep 09 20:54:17.446752 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.446727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tls-certs\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.446914 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.446770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-model-cache\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.446914 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.446794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tmp-dir\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.446914 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.446872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65sq4\" (UniqueName: \"kubernetes.io/projected/283ea3b5-70b9-47f2-8790-85e0ceda8b62-kube-api-access-65sq4\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.447069 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.446933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-dshm\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.447069 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.447006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-home\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.547609 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.547579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tls-certs\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.547776 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.547624    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-model-cache\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.547776 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.547741    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tmp-dir\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.547901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.547796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65sq4\" (UniqueName: \"kubernetes.io/projected/283ea3b5-70b9-47f2-8790-85e0ceda8b62-kube-api-access-65sq4\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.547901 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.547861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-dshm\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.547995 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.547898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-home\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.548043 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.547992    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-model-cache\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.548043 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.548018    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tmp-dir\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.548297 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.548278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-home\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.549980 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.549960    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-dshm\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.550247 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.550230    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tls-certs\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.557202 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.557179    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65sq4\" (UniqueName: \"kubernetes.io/projected/283ea3b5-70b9-47f2-8790-85e0ceda8b62-kube-api-access-65sq4\") pod \"distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") " pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.690486 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.690407    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:17.961437 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:17.961411    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"]
Sep 09 20:54:17.963225 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:54:17.963190    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod283ea3b5_70b9_47f2_8790_85e0ceda8b62.slice/crio-e0691ae13add41f1147274202eede022d315bde6e318052c03dc871d761d6167 WatchSource:0}: Error finding container e0691ae13add41f1147274202eede022d315bde6e318052c03dc871d761d6167: Status 404 returned error can't find the container with id e0691ae13add41f1147274202eede022d315bde6e318052c03dc871d761d6167
Sep 09 20:54:18.968482 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:18.968448    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg" event={"ID":"283ea3b5-70b9-47f2-8790-85e0ceda8b62","Type":"ContainerStarted","Data":"f738753a9c32a49a236f003fbccb6e90107a50cb20b2f943517e76988bd31410"}
Sep 09 20:54:18.968898 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:18.968492    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg" event={"ID":"283ea3b5-70b9-47f2-8790-85e0ceda8b62","Type":"ContainerStarted","Data":"e0691ae13add41f1147274202eede022d315bde6e318052c03dc871d761d6167"}
Sep 09 20:54:18.987022 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:18.986973    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg" podStartSLOduration=1.9869593060000001 podStartE2EDuration="1.986959306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:18.985718255 +0000 UTC m=+1319.230546836" watchObservedRunningTime="2026-09-09 20:54:18.986959306 +0000 UTC m=+1319.231787886"
Sep 09 20:54:20.395720 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:20.395690    2576 scope.go:117] "RemoveContainer" containerID="07f64c8c860826721ccb9badcbe803e38d4b1fb2beeb7958e86e2a17701149d1"
Sep 09 20:54:20.404453 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:20.404426    2576 scope.go:117] "RemoveContainer" containerID="c382d3110341404575e57fb24ac2124b9364cb00cfe277b4accba65a009350ba"
Sep 09 20:54:27.691142 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:27.691112    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:27.691546 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:27.691163    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:27.703579 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:27.703550    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:28.027725 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:28.027647    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:54:49.064689 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.064601    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"]
Sep 09 20:54:49.070477 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.070454    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.072817 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.072791    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-cb82f2-serving-cert\""
Sep 09 20:54:49.086716 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.086694    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"]
Sep 09 20:54:49.241811 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.241777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.241966 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.241842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4llg\" (UniqueName: \"kubernetes.io/projected/cfc213dc-68df-428b-b530-66ab441cdae7-kube-api-access-q4llg\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.241966 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.241873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.241966 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.241928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc213dc-68df-428b-b530-66ab441cdae7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.342800 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.342729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc213dc-68df-428b-b530-66ab441cdae7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.342800 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.342781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.342981 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.342824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4llg\" (UniqueName: \"kubernetes.io/projected/cfc213dc-68df-428b-b530-66ab441cdae7-kube-api-access-q4llg\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.342981 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.342842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.342981 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:54:49.342953    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-serving-cert: secret "maas-api-e2e-shared-a-w3-cb82f2-serving-cert" not found
Sep 09 20:54:49.343116 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:54:49.343019    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-maas-api-tls podName:cfc213dc-68df-428b-b530-66ab441cdae7 nodeName:}" failed. No retries permitted until 2026-09-09 20:54:49.843004298 +0000 UTC m=+1350.087832872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-maas-api-tls") pod "maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd" (UID: "cfc213dc-68df-428b-b530-66ab441cdae7") : secret "maas-api-e2e-shared-a-w3-cb82f2-serving-cert" not found
Sep 09 20:54:49.343525 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.343502    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc213dc-68df-428b-b530-66ab441cdae7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.345276 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.345255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.355185 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.355160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4llg\" (UniqueName: \"kubernetes.io/projected/cfc213dc-68df-428b-b530-66ab441cdae7-kube-api-access-q4llg\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.847779 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.847744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.850101 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.850077    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:49.980786 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:49.980748    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:50.266076 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:50.266030    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"]
Sep 09 20:54:50.268295 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:54:50.268270    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc213dc_68df_428b_b530_66ab441cdae7.slice/crio-93a4933761e4a4dadec3a1af31b6d18c0995d7697497dd991f524df9b89d39d2 WatchSource:0}: Error finding container 93a4933761e4a4dadec3a1af31b6d18c0995d7697497dd991f524df9b89d39d2: Status 404 returned error can't find the container with id 93a4933761e4a4dadec3a1af31b6d18c0995d7697497dd991f524df9b89d39d2
Sep 09 20:54:51.143980 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:51.143945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd" event={"ID":"cfc213dc-68df-428b-b530-66ab441cdae7","Type":"ContainerStarted","Data":"687f60adf3ee9f7c4839d4d8b3a22689e1417a98b60dbfefb73208b7c7c0717c"}
Sep 09 20:54:51.144180 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:51.144031    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd" event={"ID":"cfc213dc-68df-428b-b530-66ab441cdae7","Type":"ContainerStarted","Data":"93a4933761e4a4dadec3a1af31b6d18c0995d7697497dd991f524df9b89d39d2"}
Sep 09 20:54:51.144180 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:51.144091    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:54:51.164100 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:51.164036    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd" podStartSLOduration=1.667735247 podStartE2EDuration="2.16401989s" totalImagesPullingTime="496.284643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:51.162353111 +0000 UTC m=+1351.407181693" watchObservedRunningTime="2026-09-09 20:54:51.16401989 +0000 UTC m=+1351.408848469"
Sep 09 20:54:57.155724 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:54:57.155693    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 20:55:17.864527 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:17.864495    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"]
Sep 09 20:55:17.868362 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:17.868341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:17.870704 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:17.870682    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-a2fb5a-serving-cert\""
Sep 09 20:55:17.881284 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:17.881259    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"]
Sep 09 20:55:18.005093 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.005062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.005250 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.005135    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca79ea13-1e17-4978-b09b-138979991cf7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.005250 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.005196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.005356 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.005336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-978tz\" (UniqueName: \"kubernetes.io/projected/ca79ea13-1e17-4978-b09b-138979991cf7-kube-api-access-978tz\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.106384 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.106345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978tz\" (UniqueName: \"kubernetes.io/projected/ca79ea13-1e17-4978-b09b-138979991cf7-kube-api-access-978tz\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.106569 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.106404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.106569 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.106428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca79ea13-1e17-4978-b09b-138979991cf7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.106569 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.106459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.107213 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.107187    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca79ea13-1e17-4978-b09b-138979991cf7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.109080 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.109031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.109182 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.109031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.114157 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.114134    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-978tz\" (UniqueName: \"kubernetes.io/projected/ca79ea13-1e17-4978-b09b-138979991cf7-kube-api-access-978tz\") pod \"maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.179609 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.179542    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:18.453418 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.453363    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"]
Sep 09 20:55:18.455794 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:55:18.455762    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca79ea13_1e17_4978_b09b_138979991cf7.slice/crio-c20783473149b3a46962f1e57a9f6fc499a9a8982a81c0bb1d4e2a8a8aee463e WatchSource:0}: Error finding container c20783473149b3a46962f1e57a9f6fc499a9a8982a81c0bb1d4e2a8a8aee463e: Status 404 returned error can't find the container with id c20783473149b3a46962f1e57a9f6fc499a9a8982a81c0bb1d4e2a8a8aee463e
Sep 09 20:55:18.457283 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:18.457261    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:55:19.302632 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:19.302600    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc" event={"ID":"ca79ea13-1e17-4978-b09b-138979991cf7","Type":"ContainerStarted","Data":"c20783473149b3a46962f1e57a9f6fc499a9a8982a81c0bb1d4e2a8a8aee463e"}
Sep 09 20:55:20.309111 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:20.309075    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc" event={"ID":"ca79ea13-1e17-4978-b09b-138979991cf7","Type":"ContainerStarted","Data":"f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f"}
Sep 09 20:55:20.309473 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:20.309134    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:55:20.328488 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:20.328440    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc" podStartSLOduration=2.027824963 podStartE2EDuration="3.328425626s" totalImagesPullingTime="1.300600663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:55:20.32675063 +0000 UTC m=+1380.571579209" watchObservedRunningTime="2026-09-09 20:55:20.328425626 +0000 UTC m=+1380.573254253"
Sep 09 20:55:20.431747 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:20.431715    2576 scope.go:117] "RemoveContainer" containerID="72047220137b2309e691958a8b005d1d3bfea3aa5b3967d3687c8842c489f82b"
Sep 09 20:55:20.445776 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:20.445743    2576 scope.go:117] "RemoveContainer" containerID="e35bac056f6e83d00f498856b99ca178c58c9ae45fb4fd3860d809af2155423e"
Sep 09 20:55:20.458649 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:20.458629    2576 scope.go:117] "RemoveContainer" containerID="a5fe7e8d25def5401bc0ee88b2f2ca20de773c3aac47f8010ee2eb58ac64bdfb"
Sep 09 20:55:26.319989 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:55:26.319959    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 20:56:16.667850 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:16.667767    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"]
Sep 09 20:56:16.668411 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:16.667997    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs" podUID="1e808ad4-d2fd-4efb-80e5-b8820a0e15e9" containerName="maas-api" containerID="cri-o://bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab" gracePeriod=30
Sep 09 20:56:16.926872 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:16.926810    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:56:17.042429 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.042401    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhf7p\" (UniqueName: \"kubernetes.io/projected/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-kube-api-access-qhf7p\") pod \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") "
Sep 09 20:56:17.042595 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.042445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-openshift-service-ca\") pod \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") "
Sep 09 20:56:17.042595 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.042490    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-maas-api-tls\") pod \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") "
Sep 09 20:56:17.042595 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.042556    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-metrics-certs\") pod \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\" (UID: \"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9\") "
Sep 09 20:56:17.042896 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.042871    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e808ad4-d2fd-4efb-80e5-b8820a0e15e9" (UID: "1e808ad4-d2fd-4efb-80e5-b8820a0e15e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:56:17.044567 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.044535    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-kube-api-access-qhf7p" (OuterVolumeSpecName: "kube-api-access-qhf7p") pod "1e808ad4-d2fd-4efb-80e5-b8820a0e15e9" (UID: "1e808ad4-d2fd-4efb-80e5-b8820a0e15e9"). InnerVolumeSpecName "kube-api-access-qhf7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:56:17.044666 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.044648    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e808ad4-d2fd-4efb-80e5-b8820a0e15e9" (UID: "1e808ad4-d2fd-4efb-80e5-b8820a0e15e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:56:17.044744 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.044711    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1e808ad4-d2fd-4efb-80e5-b8820a0e15e9" (UID: "1e808ad4-d2fd-4efb-80e5-b8820a0e15e9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:56:17.143769 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.143737    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhf7p\" (UniqueName: \"kubernetes.io/projected/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-kube-api-access-qhf7p\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:56:17.143769 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.143768    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:56:17.143961 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.143780    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:56:17.143961 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.143792    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:56:17.616762 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.616728    2576 generic.go:356] "Generic (PLEG): container finished" podID="1e808ad4-d2fd-4efb-80e5-b8820a0e15e9" containerID="bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab" exitCode=0
Sep 09 20:56:17.616927 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.616770    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs" event={"ID":"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9","Type":"ContainerDied","Data":"bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab"}
Sep 09 20:56:17.616927 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.616782    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"
Sep 09 20:56:17.616927 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.616811    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs" event={"ID":"1e808ad4-d2fd-4efb-80e5-b8820a0e15e9","Type":"ContainerDied","Data":"5a651f4332f969c9d972f0ab265e956ab88214be824632294b492d92e3977792"}
Sep 09 20:56:17.616927 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.616836    2576 scope.go:117] "RemoveContainer" containerID="bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab"
Sep 09 20:56:17.627209 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.627188    2576 scope.go:117] "RemoveContainer" containerID="bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab"
Sep 09 20:56:17.627475 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:56:17.627456    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab\": container with ID starting with bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab not found: ID does not exist" containerID="bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab"
Sep 09 20:56:17.627544 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.627486    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab"} err="failed to get container status \"bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab\": rpc error: code = NotFound desc = could not find container \"bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab\": container with ID starting with bb1bd17ecd574859aeae74cf53f4cabc7ac92bd8c8e92b29baa32f930be30aab not found: ID does not exist"
Sep 09 20:56:17.640796 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.640776    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"]
Sep 09 20:56:17.644340 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:17.644317    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fbe7be47-8585b599dc-ngdjs"]
Sep 09 20:56:18.284022 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:56:18.283990    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e808ad4-d2fd-4efb-80e5-b8820a0e15e9" path="/var/lib/kubelet/pods/1e808ad4-d2fd-4efb-80e5-b8820a0e15e9/volumes"
Sep 09 20:57:20.324212 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:57:20.324182    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:57:20.328239 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:57:20.328220    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 20:57:20.332134 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:57:20.332112    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:57:20.336121 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:57:20.336102    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 20:58:12.929206 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:12.929169    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"]
Sep 09 20:58:12.931662 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:12.929653    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e808ad4-d2fd-4efb-80e5-b8820a0e15e9" containerName="maas-api"
Sep 09 20:58:12.931662 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:12.929667    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e808ad4-d2fd-4efb-80e5-b8820a0e15e9" containerName="maas-api"
Sep 09 20:58:12.931662 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:12.929738    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e808ad4-d2fd-4efb-80e5-b8820a0e15e9" containerName="maas-api"
Sep 09 20:58:12.932592 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:12.932577    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:12.934656 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:12.934637    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-ada93f-serving-cert\""
Sep 09 20:58:12.944612 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:12.944587    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"]
Sep 09 20:58:13.021207 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.021175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vtgg\" (UniqueName: \"kubernetes.io/projected/c091141e-54c4-4049-9687-d951ab3fdf96-kube-api-access-9vtgg\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.021369 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.021229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-maas-api-tls\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.021369 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.021332    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-metrics-certs\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.021460 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.021367    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c091141e-54c4-4049-9687-d951ab3fdf96-openshift-service-ca\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.122782 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.122749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-metrics-certs\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.122782 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.122788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c091141e-54c4-4049-9687-d951ab3fdf96-openshift-service-ca\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.122984 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.122831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vtgg\" (UniqueName: \"kubernetes.io/projected/c091141e-54c4-4049-9687-d951ab3fdf96-kube-api-access-9vtgg\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.122984 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.122857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-maas-api-tls\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.122984 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:58:13.122958    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-serving-cert: secret "maas-api-e2e-api-a-ada93f-serving-cert" not found
Sep 09 20:58:13.123121 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:58:13.123017    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-maas-api-tls podName:c091141e-54c4-4049-9687-d951ab3fdf96 nodeName:}" failed. No retries permitted until 2026-09-09 20:58:13.622998242 +0000 UTC m=+1553.867826801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-maas-api-tls") pod "maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5" (UID: "c091141e-54c4-4049-9687-d951ab3fdf96") : secret "maas-api-e2e-api-a-ada93f-serving-cert" not found
Sep 09 20:58:13.123566 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.123534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c091141e-54c4-4049-9687-d951ab3fdf96-openshift-service-ca\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.125190 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.125172    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-metrics-certs\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.132477 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.132454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vtgg\" (UniqueName: \"kubernetes.io/projected/c091141e-54c4-4049-9687-d951ab3fdf96-kube-api-access-9vtgg\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.628208 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.628177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-maas-api-tls\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.630486 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.630467    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-maas-api-tls\") pod \"maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.783654 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.783621    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"]
Sep 09 20:58:13.788165 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.788136    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:58:13.790693 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.790674    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-ada93f-dockercfg-ktt98\""
Sep 09 20:58:13.790769 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.790718    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-ada93f\""
Sep 09 20:58:13.799125 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.799103    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"]
Sep 09 20:58:13.844194 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.844169    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:13.931678 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.931639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp7fs\" (UniqueName: \"kubernetes.io/projected/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-kube-api-access-wp7fs\") pod \"payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x\" (UID: \"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7\") " pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:58:13.931998 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:13.931696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x\" (UID: \"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7\") " pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:58:14.032265 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:14.032231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp7fs\" (UniqueName: \"kubernetes.io/projected/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-kube-api-access-wp7fs\") pod \"payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x\" (UID: \"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7\") " pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:58:14.032416 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:14.032280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x\" (UID: \"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7\") " pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:58:14.032964 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:14.032945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x\" (UID: \"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7\") " pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:58:14.041821 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:14.041795    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp7fs\" (UniqueName: \"kubernetes.io/projected/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-kube-api-access-wp7fs\") pod \"payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x\" (UID: \"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7\") " pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:58:14.099916 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:14.099887    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:58:14.132940 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:14.132908    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"]
Sep 09 20:58:14.136480 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:58:14.136450    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc091141e_54c4_4049_9687_d951ab3fdf96.slice/crio-95dc5110c295d4061056f79eb3a3e0615fa14f1069ec6a0bbc947211a5a9e592 WatchSource:0}: Error finding container 95dc5110c295d4061056f79eb3a3e0615fa14f1069ec6a0bbc947211a5a9e592: Status 404 returned error can't find the container with id 95dc5110c295d4061056f79eb3a3e0615fa14f1069ec6a0bbc947211a5a9e592
Sep 09 20:58:14.264158 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:14.264127    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5" event={"ID":"c091141e-54c4-4049-9687-d951ab3fdf96","Type":"ContainerStarted","Data":"95dc5110c295d4061056f79eb3a3e0615fa14f1069ec6a0bbc947211a5a9e592"}
Sep 09 20:58:14.379070 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:14.379024    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"]
Sep 09 20:58:14.381370 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:58:14.381343    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df26dfa_4d53_4ba9_908a_0c3e3a192ae7.slice/crio-9dc6e62a4d730b4437cc4b7fbfc4cfe6d7544673090ea394eb16c497492d6801 WatchSource:0}: Error finding container 9dc6e62a4d730b4437cc4b7fbfc4cfe6d7544673090ea394eb16c497492d6801: Status 404 returned error can't find the container with id 9dc6e62a4d730b4437cc4b7fbfc4cfe6d7544673090ea394eb16c497492d6801
Sep 09 20:58:15.272304 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:15.272268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5" event={"ID":"c091141e-54c4-4049-9687-d951ab3fdf96","Type":"ContainerStarted","Data":"7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f"}
Sep 09 20:58:15.272756 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:15.272430    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:15.273955 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:15.273931    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x" event={"ID":"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7","Type":"ContainerStarted","Data":"b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00"}
Sep 09 20:58:15.274092 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:15.273975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x" event={"ID":"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7","Type":"ContainerStarted","Data":"9dc6e62a4d730b4437cc4b7fbfc4cfe6d7544673090ea394eb16c497492d6801"}
Sep 09 20:58:15.274092 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:15.274017    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:58:15.293764 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:15.293719    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5" podStartSLOduration=2.9071054419999998 podStartE2EDuration="3.293704629s" totalImagesPullingTime="386.599187ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:58:15.291489943 +0000 UTC m=+1555.536318523" watchObservedRunningTime="2026-09-09 20:58:15.293704629 +0000 UTC m=+1555.538533209"
Sep 09 20:58:15.309726 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:15.309685    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x" podStartSLOduration=2.309671925 podStartE2EDuration="2.309671925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:58:15.307199861 +0000 UTC m=+1555.552028445" watchObservedRunningTime="2026-09-09 20:58:15.309671925 +0000 UTC m=+1555.554500505"
Sep 09 20:58:20.507551 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:20.507521    2576 scope.go:117] "RemoveContainer" containerID="9ca36c8e73f4cda09fd8aabbbcc72282d948d4166180c63f9f15b360329a6c71"
Sep 09 20:58:20.516146 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:20.516125    2576 scope.go:117] "RemoveContainer" containerID="d92b10ac979867046fd16c41ad5105880ca298758ac7703b5120e06e3d0a9241"
Sep 09 20:58:21.286335 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:21.286303    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:58:26.284357 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:26.284326    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:58:41.715039 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.714997    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"]
Sep 09 20:58:41.718472 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.718456    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:41.720980 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.720957    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-4e2f93-serving-cert\""
Sep 09 20:58:41.730892 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.730869    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"]
Sep 09 20:58:41.784042 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.784016    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:41.784224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.784062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-metrics-certs\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:41.784224 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.784123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gj42\" (UniqueName: \"kubernetes.io/projected/a80153f8-d071-4405-ba9c-c4e831e8ccc1-kube-api-access-8gj42\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:41.784348 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.784227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80153f8-d071-4405-ba9c-c4e831e8ccc1-openshift-service-ca\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:41.885351 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.885315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:41.885351 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.885352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-metrics-certs\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:41.885555 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.885385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gj42\" (UniqueName: \"kubernetes.io/projected/a80153f8-d071-4405-ba9c-c4e831e8ccc1-kube-api-access-8gj42\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:41.885555 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.885426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80153f8-d071-4405-ba9c-c4e831e8ccc1-openshift-service-ca\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:41.885555 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:58:41.885490    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-serving-cert: secret "maas-api-e2e-api-b-4e2f93-serving-cert" not found
Sep 09 20:58:41.885666 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:58:41.885585    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls podName:a80153f8-d071-4405-ba9c-c4e831e8ccc1 nodeName:}" failed. No retries permitted until 2026-09-09 20:58:42.385563629 +0000 UTC m=+1582.630392193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls") pod "maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr" (UID: "a80153f8-d071-4405-ba9c-c4e831e8ccc1") : secret "maas-api-e2e-api-b-4e2f93-serving-cert" not found
Sep 09 20:58:41.886146 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.886123    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80153f8-d071-4405-ba9c-c4e831e8ccc1-openshift-service-ca\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:41.887806 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.887780    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-metrics-certs\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:41.897331 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:41.897308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gj42\" (UniqueName: \"kubernetes.io/projected/a80153f8-d071-4405-ba9c-c4e831e8ccc1-kube-api-access-8gj42\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:42.390502 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:42.390467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:42.390672 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:58:42.390630    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-serving-cert: secret "maas-api-e2e-api-b-4e2f93-serving-cert" not found
Sep 09 20:58:42.390723 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:58:42.390711    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls podName:a80153f8-d071-4405-ba9c-c4e831e8ccc1 nodeName:}" failed. No retries permitted until 2026-09-09 20:58:43.390688103 +0000 UTC m=+1583.635516665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls") pod "maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr" (UID: "a80153f8-d071-4405-ba9c-c4e831e8ccc1") : secret "maas-api-e2e-api-b-4e2f93-serving-cert" not found
Sep 09 20:58:43.401108 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:43.401071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:43.403445 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:43.403416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls\") pod \"maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:43.529949 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:43.529912    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:43.804037 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:43.804002    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"]
Sep 09 20:58:43.807411 ip-10-0-137-148 kubenswrapper[2576]: W0909 20:58:43.807388    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80153f8_d071_4405_ba9c_c4e831e8ccc1.slice/crio-49912b0abd4aa84cd03049cb5f8b353355a416ad1c20e2325d9a5e214ec007a7 WatchSource:0}: Error finding container 49912b0abd4aa84cd03049cb5f8b353355a416ad1c20e2325d9a5e214ec007a7: Status 404 returned error can't find the container with id 49912b0abd4aa84cd03049cb5f8b353355a416ad1c20e2325d9a5e214ec007a7
Sep 09 20:58:44.430105 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:44.429993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr" event={"ID":"a80153f8-d071-4405-ba9c-c4e831e8ccc1","Type":"ContainerStarted","Data":"7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1"}
Sep 09 20:58:44.430105 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:44.430074    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:58:44.430105 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:44.430101    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr" event={"ID":"a80153f8-d071-4405-ba9c-c4e831e8ccc1","Type":"ContainerStarted","Data":"49912b0abd4aa84cd03049cb5f8b353355a416ad1c20e2325d9a5e214ec007a7"}
Sep 09 20:58:44.449829 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:44.449776    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr" podStartSLOduration=3.125983701 podStartE2EDuration="3.449761867s" totalImagesPullingTime="323.778166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:58:44.44718614 +0000 UTC m=+1584.692014940" watchObservedRunningTime="2026-09-09 20:58:44.449761867 +0000 UTC m=+1584.694590447"
Sep 09 20:58:50.441549 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:58:50.441517    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:59:20.540510 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:20.540427    2576 scope.go:117] "RemoveContainer" containerID="659bdb173b8e8d91fed5f2a75df7c5b13a067de4e692005e89b27cc522df4f80"
Sep 09 20:59:20.549217 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:20.549197    2576 scope.go:117] "RemoveContainer" containerID="2012c82abe0047e4081881f574445e57f2636336b763882130c8e8d7303a4fb8"
Sep 09 20:59:23.903391 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:23.903357    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"]
Sep 09 20:59:23.904195 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:23.904141    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5" podUID="c091141e-54c4-4049-9687-d951ab3fdf96" containerName="maas-api" containerID="cri-o://7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f" gracePeriod=30
Sep 09 20:59:23.963683 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:23.963651    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"]
Sep 09 20:59:23.963952 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:23.963920    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x" podUID="5df26dfa-4d53-4ba9-908a-0c3e3a192ae7" containerName="payload-processing" containerID="cri-o://b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00" gracePeriod=30
Sep 09 20:59:24.225664 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.225636    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:59:24.257421 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.257380    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:59:24.274230 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.274207    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-maas-api-tls\") pod \"c091141e-54c4-4049-9687-d951ab3fdf96\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") "
Sep 09 20:59:24.274357 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.274251    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-plugins-config-volume\") pod \"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7\" (UID: \"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7\") "
Sep 09 20:59:24.274357 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.274277    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c091141e-54c4-4049-9687-d951ab3fdf96-openshift-service-ca\") pod \"c091141e-54c4-4049-9687-d951ab3fdf96\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") "
Sep 09 20:59:24.274492 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.274385    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vtgg\" (UniqueName: \"kubernetes.io/projected/c091141e-54c4-4049-9687-d951ab3fdf96-kube-api-access-9vtgg\") pod \"c091141e-54c4-4049-9687-d951ab3fdf96\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") "
Sep 09 20:59:24.274550 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.274502    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-metrics-certs\") pod \"c091141e-54c4-4049-9687-d951ab3fdf96\" (UID: \"c091141e-54c4-4049-9687-d951ab3fdf96\") "
Sep 09 20:59:24.274612 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.274572    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp7fs\" (UniqueName: \"kubernetes.io/projected/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-kube-api-access-wp7fs\") pod \"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7\" (UID: \"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7\") "
Sep 09 20:59:24.274675 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.274612    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c091141e-54c4-4049-9687-d951ab3fdf96-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c091141e-54c4-4049-9687-d951ab3fdf96" (UID: "c091141e-54c4-4049-9687-d951ab3fdf96"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:59:24.274675 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.274631    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5df26dfa-4d53-4ba9-908a-0c3e3a192ae7" (UID: "5df26dfa-4d53-4ba9-908a-0c3e3a192ae7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:59:24.274931 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.274909    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:24.275003 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.274938    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c091141e-54c4-4049-9687-d951ab3fdf96-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:24.276457 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.276430    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c091141e-54c4-4049-9687-d951ab3fdf96" (UID: "c091141e-54c4-4049-9687-d951ab3fdf96"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:59:24.276604 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.276583    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c091141e-54c4-4049-9687-d951ab3fdf96-kube-api-access-9vtgg" (OuterVolumeSpecName: "kube-api-access-9vtgg") pod "c091141e-54c4-4049-9687-d951ab3fdf96" (UID: "c091141e-54c4-4049-9687-d951ab3fdf96"). InnerVolumeSpecName "kube-api-access-9vtgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:59:24.276663 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.276650    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-kube-api-access-wp7fs" (OuterVolumeSpecName: "kube-api-access-wp7fs") pod "5df26dfa-4d53-4ba9-908a-0c3e3a192ae7" (UID: "5df26dfa-4d53-4ba9-908a-0c3e3a192ae7"). InnerVolumeSpecName "kube-api-access-wp7fs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:59:24.276967 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.276946    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c091141e-54c4-4049-9687-d951ab3fdf96" (UID: "c091141e-54c4-4049-9687-d951ab3fdf96"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:59:24.376372 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.376339    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:24.376372 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.376365    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vtgg\" (UniqueName: \"kubernetes.io/projected/c091141e-54c4-4049-9687-d951ab3fdf96-kube-api-access-9vtgg\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:24.376372 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.376375    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c091141e-54c4-4049-9687-d951ab3fdf96-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:24.376372 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.376383    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp7fs\" (UniqueName: \"kubernetes.io/projected/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7-kube-api-access-wp7fs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:24.644958 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.644921    2576 generic.go:356] "Generic (PLEG): container finished" podID="c091141e-54c4-4049-9687-d951ab3fdf96" containerID="7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f" exitCode=0
Sep 09 20:59:24.645124 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.644964    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"
Sep 09 20:59:24.645124 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.644998    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5" event={"ID":"c091141e-54c4-4049-9687-d951ab3fdf96","Type":"ContainerDied","Data":"7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f"}
Sep 09 20:59:24.645124 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.645067    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5" event={"ID":"c091141e-54c4-4049-9687-d951ab3fdf96","Type":"ContainerDied","Data":"95dc5110c295d4061056f79eb3a3e0615fa14f1069ec6a0bbc947211a5a9e592"}
Sep 09 20:59:24.645124 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.645099    2576 scope.go:117] "RemoveContainer" containerID="7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f"
Sep 09 20:59:24.646514 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.646493    2576 generic.go:356] "Generic (PLEG): container finished" podID="5df26dfa-4d53-4ba9-908a-0c3e3a192ae7" containerID="b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00" exitCode=0
Sep 09 20:59:24.646623 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.646525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x" event={"ID":"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7","Type":"ContainerDied","Data":"b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00"}
Sep 09 20:59:24.646623 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.646548    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"
Sep 09 20:59:24.646623 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.646575    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x" event={"ID":"5df26dfa-4d53-4ba9-908a-0c3e3a192ae7","Type":"ContainerDied","Data":"9dc6e62a4d730b4437cc4b7fbfc4cfe6d7544673090ea394eb16c497492d6801"}
Sep 09 20:59:24.654587 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.654566    2576 scope.go:117] "RemoveContainer" containerID="7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f"
Sep 09 20:59:24.654884 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:59:24.654865    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f\": container with ID starting with 7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f not found: ID does not exist" containerID="7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f"
Sep 09 20:59:24.654933 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.654892    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f"} err="failed to get container status \"7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f\": rpc error: code = NotFound desc = could not find container \"7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f\": container with ID starting with 7eaf2506f0497713d69cf58dc8ed00aa94c43a1dc16b5c7634893de79bb2315f not found: ID does not exist"
Sep 09 20:59:24.654933 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.654907    2576 scope.go:117] "RemoveContainer" containerID="b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00"
Sep 09 20:59:24.663313 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.663285    2576 scope.go:117] "RemoveContainer" containerID="b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00"
Sep 09 20:59:24.663637 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:59:24.663619    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00\": container with ID starting with b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00 not found: ID does not exist" containerID="b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00"
Sep 09 20:59:24.663710 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.663643    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00"} err="failed to get container status \"b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00\": rpc error: code = NotFound desc = could not find container \"b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00\": container with ID starting with b462205ee4574b4b750b73d4b66112fccb4683c9f2bca839f5cdf721f1041d00 not found: ID does not exist"
Sep 09 20:59:24.665440 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.665421    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"]
Sep 09 20:59:24.669033 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.669007    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ada93f-7b5b498dd8-mn8s5"]
Sep 09 20:59:24.678982 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.678963    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"]
Sep 09 20:59:24.683171 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:24.683151    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x"]
Sep 09 20:59:26.284020 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:26.283991    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5df26dfa-4d53-4ba9-908a-0c3e3a192ae7" path="/var/lib/kubelet/pods/5df26dfa-4d53-4ba9-908a-0c3e3a192ae7/volumes"
Sep 09 20:59:26.284427 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:26.284413    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c091141e-54c4-4049-9687-d951ab3fdf96" path="/var/lib/kubelet/pods/c091141e-54c4-4049-9687-d951ab3fdf96/volumes"
Sep 09 20:59:43.602900 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:43.602858    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"]
Sep 09 20:59:46.792249 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:46.791995    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"]
Sep 09 20:59:46.792785 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:46.792364    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr" podUID="a80153f8-d071-4405-ba9c-c4e831e8ccc1" containerName="maas-api" containerID="cri-o://7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1" gracePeriod=30
Sep 09 20:59:47.046226 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.046168    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:59:47.200329 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.200295    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls\") pod \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") "
Sep 09 20:59:47.200492 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.200377    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gj42\" (UniqueName: \"kubernetes.io/projected/a80153f8-d071-4405-ba9c-c4e831e8ccc1-kube-api-access-8gj42\") pod \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") "
Sep 09 20:59:47.200492 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.200482    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80153f8-d071-4405-ba9c-c4e831e8ccc1-openshift-service-ca\") pod \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") "
Sep 09 20:59:47.200567 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.200525    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-metrics-certs\") pod \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\" (UID: \"a80153f8-d071-4405-ba9c-c4e831e8ccc1\") "
Sep 09 20:59:47.200841 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.200812    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a80153f8-d071-4405-ba9c-c4e831e8ccc1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a80153f8-d071-4405-ba9c-c4e831e8ccc1" (UID: "a80153f8-d071-4405-ba9c-c4e831e8ccc1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:59:47.202524 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.202496    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a80153f8-d071-4405-ba9c-c4e831e8ccc1" (UID: "a80153f8-d071-4405-ba9c-c4e831e8ccc1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:59:47.202633 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.202559    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a80153f8-d071-4405-ba9c-c4e831e8ccc1-kube-api-access-8gj42" (OuterVolumeSpecName: "kube-api-access-8gj42") pod "a80153f8-d071-4405-ba9c-c4e831e8ccc1" (UID: "a80153f8-d071-4405-ba9c-c4e831e8ccc1"). InnerVolumeSpecName "kube-api-access-8gj42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:59:47.202633 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.202562    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a80153f8-d071-4405-ba9c-c4e831e8ccc1" (UID: "a80153f8-d071-4405-ba9c-c4e831e8ccc1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:59:47.302223 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.302157    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80153f8-d071-4405-ba9c-c4e831e8ccc1-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:47.302223 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.302182    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:47.302223 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.302191    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a80153f8-d071-4405-ba9c-c4e831e8ccc1-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:47.302223 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.302198    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gj42\" (UniqueName: \"kubernetes.io/projected/a80153f8-d071-4405-ba9c-c4e831e8ccc1-kube-api-access-8gj42\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:47.781988 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.781904    2576 generic.go:356] "Generic (PLEG): container finished" podID="a80153f8-d071-4405-ba9c-c4e831e8ccc1" containerID="7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1" exitCode=0
Sep 09 20:59:47.781988 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.781952    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"
Sep 09 20:59:47.781988 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.781972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr" event={"ID":"a80153f8-d071-4405-ba9c-c4e831e8ccc1","Type":"ContainerDied","Data":"7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1"}
Sep 09 20:59:47.782217 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.782024    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr" event={"ID":"a80153f8-d071-4405-ba9c-c4e831e8ccc1","Type":"ContainerDied","Data":"49912b0abd4aa84cd03049cb5f8b353355a416ad1c20e2325d9a5e214ec007a7"}
Sep 09 20:59:47.782217 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.782077    2576 scope.go:117] "RemoveContainer" containerID="7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1"
Sep 09 20:59:47.791662 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.791642    2576 scope.go:117] "RemoveContainer" containerID="7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1"
Sep 09 20:59:47.791906 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:59:47.791884    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1\": container with ID starting with 7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1 not found: ID does not exist" containerID="7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1"
Sep 09 20:59:47.791950 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.791915    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1"} err="failed to get container status \"7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1\": rpc error: code = NotFound desc = could not find container \"7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1\": container with ID starting with 7f0cdad1c906434bcda8e4a9a7d01ade3799e8913dad704c576e060cd69170a1 not found: ID does not exist"
Sep 09 20:59:47.805393 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.805368    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"]
Sep 09 20:59:47.811284 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:47.811264    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2f93-5bd88fb56b-xfpvr"]
Sep 09 20:59:48.284535 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:48.284497    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a80153f8-d071-4405-ba9c-c4e831e8ccc1" path="/var/lib/kubelet/pods/a80153f8-d071-4405-ba9c-c4e831e8ccc1/volumes"
Sep 09 20:59:55.544684 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.544642    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"]
Sep 09 20:59:55.545279 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.544902    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z" podUID="44e0a480-cfab-47c4-9dde-44f6b16896e9" containerName="payload-pre-processing" containerID="cri-o://279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3" gracePeriod=30
Sep 09 20:59:55.806411 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.806352    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:59:55.832333 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.832277    2576 generic.go:356] "Generic (PLEG): container finished" podID="44e0a480-cfab-47c4-9dde-44f6b16896e9" containerID="279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3" exitCode=0
Sep 09 20:59:55.832539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.832340    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"
Sep 09 20:59:55.832539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.832361    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z" event={"ID":"44e0a480-cfab-47c4-9dde-44f6b16896e9","Type":"ContainerDied","Data":"279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3"}
Sep 09 20:59:55.832539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.832435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z" event={"ID":"44e0a480-cfab-47c4-9dde-44f6b16896e9","Type":"ContainerDied","Data":"a9a9ad2adeb87f34060c4bf123382d7a4a1c554b4e2f825aec26e10aab8d8cad"}
Sep 09 20:59:55.832539 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.832467    2576 scope.go:117] "RemoveContainer" containerID="279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3"
Sep 09 20:59:55.845815 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.845796    2576 scope.go:117] "RemoveContainer" containerID="279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3"
Sep 09 20:59:55.846159 ip-10-0-137-148 kubenswrapper[2576]: E0909 20:59:55.846129    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3\": container with ID starting with 279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3 not found: ID does not exist" containerID="279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3"
Sep 09 20:59:55.846231 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.846167    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3"} err="failed to get container status \"279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3\": rpc error: code = NotFound desc = could not find container \"279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3\": container with ID starting with 279f6436d198406991ece70c2b9701a48c0a6df61aae60f6c79b22644bdce7b3 not found: ID does not exist"
Sep 09 20:59:55.984556 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.984526    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0a480-cfab-47c4-9dde-44f6b16896e9-plugins-config-volume\") pod \"44e0a480-cfab-47c4-9dde-44f6b16896e9\" (UID: \"44e0a480-cfab-47c4-9dde-44f6b16896e9\") "
Sep 09 20:59:55.984698 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.984654    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t2jm\" (UniqueName: \"kubernetes.io/projected/44e0a480-cfab-47c4-9dde-44f6b16896e9-kube-api-access-7t2jm\") pod \"44e0a480-cfab-47c4-9dde-44f6b16896e9\" (UID: \"44e0a480-cfab-47c4-9dde-44f6b16896e9\") "
Sep 09 20:59:55.984881 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.984860    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44e0a480-cfab-47c4-9dde-44f6b16896e9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44e0a480-cfab-47c4-9dde-44f6b16896e9" (UID: "44e0a480-cfab-47c4-9dde-44f6b16896e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:59:55.984978 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.984966    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0a480-cfab-47c4-9dde-44f6b16896e9-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:55.986803 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:55.986785    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44e0a480-cfab-47c4-9dde-44f6b16896e9-kube-api-access-7t2jm" (OuterVolumeSpecName: "kube-api-access-7t2jm") pod "44e0a480-cfab-47c4-9dde-44f6b16896e9" (UID: "44e0a480-cfab-47c4-9dde-44f6b16896e9"). InnerVolumeSpecName "kube-api-access-7t2jm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:59:56.085579 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:56.085521    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t2jm\" (UniqueName: \"kubernetes.io/projected/44e0a480-cfab-47c4-9dde-44f6b16896e9-kube-api-access-7t2jm\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:56.155845 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:56.155822    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"]
Sep 09 20:59:56.159546 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:56.159523    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z"]
Sep 09 20:59:56.283668 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:56.283639    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44e0a480-cfab-47c4-9dde-44f6b16896e9" path="/var/lib/kubelet/pods/44e0a480-cfab-47c4-9dde-44f6b16896e9/volumes"
Sep 09 20:59:58.623116 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:58.623078    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg" podUID="283ea3b5-70b9-47f2-8790-85e0ceda8b62" containerName="main" containerID="cri-o://f738753a9c32a49a236f003fbccb6e90107a50cb20b2f943517e76988bd31410" gracePeriod=45
Sep 09 20:59:58.851328 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:58.851292    2576 generic.go:356] "Generic (PLEG): container finished" podID="283ea3b5-70b9-47f2-8790-85e0ceda8b62" containerID="f738753a9c32a49a236f003fbccb6e90107a50cb20b2f943517e76988bd31410" exitCode=0
Sep 09 20:59:58.851488 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:58.851362    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg" event={"ID":"283ea3b5-70b9-47f2-8790-85e0ceda8b62","Type":"ContainerDied","Data":"f738753a9c32a49a236f003fbccb6e90107a50cb20b2f943517e76988bd31410"}
Sep 09 20:59:58.881472 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:58.881420    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:59:59.010683 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.010655    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-model-cache\") pod \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") "
Sep 09 20:59:59.010908 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.010697    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65sq4\" (UniqueName: \"kubernetes.io/projected/283ea3b5-70b9-47f2-8790-85e0ceda8b62-kube-api-access-65sq4\") pod \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") "
Sep 09 20:59:59.010908 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.010747    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tmp-dir\") pod \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") "
Sep 09 20:59:59.010908 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.010860    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tls-certs\") pod \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") "
Sep 09 20:59:59.010908 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.010889    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-home\") pod \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") "
Sep 09 20:59:59.010908 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.010893    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-model-cache" (OuterVolumeSpecName: "model-cache") pod "283ea3b5-70b9-47f2-8790-85e0ceda8b62" (UID: "283ea3b5-70b9-47f2-8790-85e0ceda8b62"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:59:59.011214 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.010951    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-dshm\") pod \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\" (UID: \"283ea3b5-70b9-47f2-8790-85e0ceda8b62\") "
Sep 09 20:59:59.011214 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.011083    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "283ea3b5-70b9-47f2-8790-85e0ceda8b62" (UID: "283ea3b5-70b9-47f2-8790-85e0ceda8b62"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:59:59.011324 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.011236    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-home" (OuterVolumeSpecName: "home") pod "283ea3b5-70b9-47f2-8790-85e0ceda8b62" (UID: "283ea3b5-70b9-47f2-8790-85e0ceda8b62"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:59:59.011393 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.011350    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-home\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:59.011393 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.011371    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-model-cache\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:59.011393 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.011385    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tmp-dir\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:59.013169 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.013145    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "283ea3b5-70b9-47f2-8790-85e0ceda8b62" (UID: "283ea3b5-70b9-47f2-8790-85e0ceda8b62"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:59:59.013285 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.013147    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/283ea3b5-70b9-47f2-8790-85e0ceda8b62-kube-api-access-65sq4" (OuterVolumeSpecName: "kube-api-access-65sq4") pod "283ea3b5-70b9-47f2-8790-85e0ceda8b62" (UID: "283ea3b5-70b9-47f2-8790-85e0ceda8b62"). InnerVolumeSpecName "kube-api-access-65sq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:59:59.013285 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.013251    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-dshm" (OuterVolumeSpecName: "dshm") pod "283ea3b5-70b9-47f2-8790-85e0ceda8b62" (UID: "283ea3b5-70b9-47f2-8790-85e0ceda8b62"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:59:59.112880 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.112851    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/283ea3b5-70b9-47f2-8790-85e0ceda8b62-dshm\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:59.112880 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.112879    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65sq4\" (UniqueName: \"kubernetes.io/projected/283ea3b5-70b9-47f2-8790-85e0ceda8b62-kube-api-access-65sq4\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:59.112880 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.112889    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/283ea3b5-70b9-47f2-8790-85e0ceda8b62-tls-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 20:59:59.865773 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.865742    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"
Sep 09 20:59:59.866206 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.865777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg" event={"ID":"283ea3b5-70b9-47f2-8790-85e0ceda8b62","Type":"ContainerDied","Data":"e0691ae13add41f1147274202eede022d315bde6e318052c03dc871d761d6167"}
Sep 09 20:59:59.866206 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.865833    2576 scope.go:117] "RemoveContainer" containerID="f738753a9c32a49a236f003fbccb6e90107a50cb20b2f943517e76988bd31410"
Sep 09 20:59:59.886455 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.886432    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"]
Sep 09 20:59:59.890839 ip-10-0-137-148 kubenswrapper[2576]: I0909 20:59:59.890817    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-2b2343/distinct-2-w0-2b2343-kserve-94748f6fd-2qhrg"]
Sep 09 21:00:00.284777 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:00.284748    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="283ea3b5-70b9-47f2-8790-85e0ceda8b62" path="/var/lib/kubelet/pods/283ea3b5-70b9-47f2-8790-85e0ceda8b62/volumes"
Sep 09 21:00:04.625766 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.625734    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"]
Sep 09 21:00:04.626257 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.625940    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp" podUID="b29f7c0c-1edb-40ff-808f-0ea18cf74c72" containerName="maas-api" containerID="cri-o://d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0" gracePeriod=30
Sep 09 21:00:04.880871 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.880807    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 21:00:04.893847 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.893824    2576 generic.go:356] "Generic (PLEG): container finished" podID="b29f7c0c-1edb-40ff-808f-0ea18cf74c72" containerID="d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0" exitCode=0
Sep 09 21:00:04.893980 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.893868    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"
Sep 09 21:00:04.893980 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.893918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp" event={"ID":"b29f7c0c-1edb-40ff-808f-0ea18cf74c72","Type":"ContainerDied","Data":"d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0"}
Sep 09 21:00:04.893980 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.893973    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp" event={"ID":"b29f7c0c-1edb-40ff-808f-0ea18cf74c72","Type":"ContainerDied","Data":"821fd9bea64581afd430c96946a14004bde93a5fd1604dad9d7db57fa5ae6ee9"}
Sep 09 21:00:04.894176 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.894004    2576 scope.go:117] "RemoveContainer" containerID="d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0"
Sep 09 21:00:04.904545 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.904528    2576 scope.go:117] "RemoveContainer" containerID="d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0"
Sep 09 21:00:04.904852 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:00:04.904834    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0\": container with ID starting with d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0 not found: ID does not exist" containerID="d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0"
Sep 09 21:00:04.904912 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.904866    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0"} err="failed to get container status \"d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0\": rpc error: code = NotFound desc = could not find container \"d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0\": container with ID starting with d2e0eaa5ab48e7f3a61860d9d6d03d13e04d7ab25c1aed48982440c2510b92e0 not found: ID does not exist"
Sep 09 21:00:04.963843 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.963808    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-maas-api-tls\") pod \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") "
Sep 09 21:00:04.964032 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.963863    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-metrics-certs\") pod \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") "
Sep 09 21:00:04.964032 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.963907    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-openshift-service-ca\") pod \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") "
Sep 09 21:00:04.964032 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.963936    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw7hj\" (UniqueName: \"kubernetes.io/projected/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-kube-api-access-mw7hj\") pod \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\" (UID: \"b29f7c0c-1edb-40ff-808f-0ea18cf74c72\") "
Sep 09 21:00:04.964369 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.964340    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b29f7c0c-1edb-40ff-808f-0ea18cf74c72" (UID: "b29f7c0c-1edb-40ff-808f-0ea18cf74c72"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:00:04.966023 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.965991    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b29f7c0c-1edb-40ff-808f-0ea18cf74c72" (UID: "b29f7c0c-1edb-40ff-808f-0ea18cf74c72"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:00:04.966023 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.966004    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-kube-api-access-mw7hj" (OuterVolumeSpecName: "kube-api-access-mw7hj") pod "b29f7c0c-1edb-40ff-808f-0ea18cf74c72" (UID: "b29f7c0c-1edb-40ff-808f-0ea18cf74c72"). InnerVolumeSpecName "kube-api-access-mw7hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:00:04.966177 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:04.966077    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b29f7c0c-1edb-40ff-808f-0ea18cf74c72" (UID: "b29f7c0c-1edb-40ff-808f-0ea18cf74c72"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:00:05.065413 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:05.065380    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw7hj\" (UniqueName: \"kubernetes.io/projected/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-kube-api-access-mw7hj\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:00:05.065413 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:05.065410    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:00:05.065413 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:05.065420    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:00:05.065634 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:05.065428    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29f7c0c-1edb-40ff-808f-0ea18cf74c72-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:00:05.219359 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:05.218642    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"]
Sep 09 21:00:05.224367 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:05.224336    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-78a7d5-864db45695-fk8cp"]
Sep 09 21:00:06.284257 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:06.284222    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b29f7c0c-1edb-40ff-808f-0ea18cf74c72" path="/var/lib/kubelet/pods/b29f7c0c-1edb-40ff-808f-0ea18cf74c72/volumes"
Sep 09 21:00:22.362486 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.362451    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"]
Sep 09 21:00:22.363214 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.363175    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98" podUID="115f2657-df14-4c85-95b9-acdac8c58bb5" containerName="maas-api" containerID="cri-o://2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f" gracePeriod=30
Sep 09 21:00:22.443530 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.443497    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"]
Sep 09 21:00:22.443712 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.443690    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs" podUID="9a402cd4-e6e9-452a-84e6-1400c138cf5d" containerName="payload-pre-processing" containerID="cri-o://a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f" gracePeriod=30
Sep 09 21:00:22.690634 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.690611    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 21:00:22.733470 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.733445    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 21:00:22.830029 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.830001    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/115f2657-df14-4c85-95b9-acdac8c58bb5-openshift-service-ca\") pod \"115f2657-df14-4c85-95b9-acdac8c58bb5\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") "
Sep 09 21:00:22.830204 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.830062    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a402cd4-e6e9-452a-84e6-1400c138cf5d-plugins-config-volume\") pod \"9a402cd4-e6e9-452a-84e6-1400c138cf5d\" (UID: \"9a402cd4-e6e9-452a-84e6-1400c138cf5d\") "
Sep 09 21:00:22.830204 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.830111    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t59pf\" (UniqueName: \"kubernetes.io/projected/115f2657-df14-4c85-95b9-acdac8c58bb5-kube-api-access-t59pf\") pod \"115f2657-df14-4c85-95b9-acdac8c58bb5\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") "
Sep 09 21:00:22.830204 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.830164    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-maas-api-tls\") pod \"115f2657-df14-4c85-95b9-acdac8c58bb5\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") "
Sep 09 21:00:22.830204 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.830189    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-metrics-certs\") pod \"115f2657-df14-4c85-95b9-acdac8c58bb5\" (UID: \"115f2657-df14-4c85-95b9-acdac8c58bb5\") "
Sep 09 21:00:22.830395 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.830222    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnn78\" (UniqueName: \"kubernetes.io/projected/9a402cd4-e6e9-452a-84e6-1400c138cf5d-kube-api-access-dnn78\") pod \"9a402cd4-e6e9-452a-84e6-1400c138cf5d\" (UID: \"9a402cd4-e6e9-452a-84e6-1400c138cf5d\") "
Sep 09 21:00:22.830395 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.830370    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/115f2657-df14-4c85-95b9-acdac8c58bb5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "115f2657-df14-4c85-95b9-acdac8c58bb5" (UID: "115f2657-df14-4c85-95b9-acdac8c58bb5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:00:22.830509 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.830488    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a402cd4-e6e9-452a-84e6-1400c138cf5d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a402cd4-e6e9-452a-84e6-1400c138cf5d" (UID: "9a402cd4-e6e9-452a-84e6-1400c138cf5d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:00:22.830584 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.830566    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/115f2657-df14-4c85-95b9-acdac8c58bb5-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.832380 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.832355    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/115f2657-df14-4c85-95b9-acdac8c58bb5-kube-api-access-t59pf" (OuterVolumeSpecName: "kube-api-access-t59pf") pod "115f2657-df14-4c85-95b9-acdac8c58bb5" (UID: "115f2657-df14-4c85-95b9-acdac8c58bb5"). InnerVolumeSpecName "kube-api-access-t59pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:00:22.832494 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.832371    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a402cd4-e6e9-452a-84e6-1400c138cf5d-kube-api-access-dnn78" (OuterVolumeSpecName: "kube-api-access-dnn78") pod "9a402cd4-e6e9-452a-84e6-1400c138cf5d" (UID: "9a402cd4-e6e9-452a-84e6-1400c138cf5d"). InnerVolumeSpecName "kube-api-access-dnn78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:00:22.832494 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.832389    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "115f2657-df14-4c85-95b9-acdac8c58bb5" (UID: "115f2657-df14-4c85-95b9-acdac8c58bb5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:00:22.832494 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.832401    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "115f2657-df14-4c85-95b9-acdac8c58bb5" (UID: "115f2657-df14-4c85-95b9-acdac8c58bb5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:00:22.931725 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.931644    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.931725 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.931672    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/115f2657-df14-4c85-95b9-acdac8c58bb5-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.931725 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.931681    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnn78\" (UniqueName: \"kubernetes.io/projected/9a402cd4-e6e9-452a-84e6-1400c138cf5d-kube-api-access-dnn78\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.931725 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.931693    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a402cd4-e6e9-452a-84e6-1400c138cf5d-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.931725 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.931702    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t59pf\" (UniqueName: \"kubernetes.io/projected/115f2657-df14-4c85-95b9-acdac8c58bb5-kube-api-access-t59pf\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:00:22.991293 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.991261    2576 generic.go:356] "Generic (PLEG): container finished" podID="115f2657-df14-4c85-95b9-acdac8c58bb5" containerID="2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f" exitCode=0
Sep 09 21:00:22.991445 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.991314    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"
Sep 09 21:00:22.991445 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.991343    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98" event={"ID":"115f2657-df14-4c85-95b9-acdac8c58bb5","Type":"ContainerDied","Data":"2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f"}
Sep 09 21:00:22.991445 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.991390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98" event={"ID":"115f2657-df14-4c85-95b9-acdac8c58bb5","Type":"ContainerDied","Data":"7d22c81a428281eb3b0b14419de502d1144641e6e4b9e5e5d9937be8e94da8a3"}
Sep 09 21:00:22.991445 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.991414    2576 scope.go:117] "RemoveContainer" containerID="2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f"
Sep 09 21:00:22.992737 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.992717    2576 generic.go:356] "Generic (PLEG): container finished" podID="9a402cd4-e6e9-452a-84e6-1400c138cf5d" containerID="a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f" exitCode=0
Sep 09 21:00:22.992841 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.992739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs" event={"ID":"9a402cd4-e6e9-452a-84e6-1400c138cf5d","Type":"ContainerDied","Data":"a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f"}
Sep 09 21:00:22.992841 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.992756    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"
Sep 09 21:00:22.992841 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:22.992796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs" event={"ID":"9a402cd4-e6e9-452a-84e6-1400c138cf5d","Type":"ContainerDied","Data":"d63d86c312dc112f551951cdc98b0af12964319988db50ee5c09449742993f50"}
Sep 09 21:00:23.000797 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:23.000775    2576 scope.go:117] "RemoveContainer" containerID="2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f"
Sep 09 21:00:23.001094 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:00:23.001044    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f\": container with ID starting with 2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f not found: ID does not exist" containerID="2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f"
Sep 09 21:00:23.001171 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:23.001096    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f"} err="failed to get container status \"2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f\": rpc error: code = NotFound desc = could not find container \"2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f\": container with ID starting with 2ab90242d2e491b4eed8ecdd69e5e42b029067063949b60a34b7bdacaa9e722f not found: ID does not exist"
Sep 09 21:00:23.001171 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:23.001110    2576 scope.go:117] "RemoveContainer" containerID="a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f"
Sep 09 21:00:23.009074 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:23.009037    2576 scope.go:117] "RemoveContainer" containerID="a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f"
Sep 09 21:00:23.009306 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:00:23.009288    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f\": container with ID starting with a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f not found: ID does not exist" containerID="a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f"
Sep 09 21:00:23.009362 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:23.009312    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f"} err="failed to get container status \"a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f\": rpc error: code = NotFound desc = could not find container \"a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f\": container with ID starting with a6a96ed7dcfe8397727e56550003a53d6cbffa7deb6651e595f4476a0ca50c0f not found: ID does not exist"
Sep 09 21:00:23.016899 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:23.016879    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"]
Sep 09 21:00:23.022490 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:23.022471    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3fa05f-b977598bf-gbd98"]
Sep 09 21:00:23.035435 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:23.035412    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"]
Sep 09 21:00:23.039660 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:23.039635    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs"]
Sep 09 21:00:24.284900 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:24.284869    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="115f2657-df14-4c85-95b9-acdac8c58bb5" path="/var/lib/kubelet/pods/115f2657-df14-4c85-95b9-acdac8c58bb5/volumes"
Sep 09 21:00:24.285271 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:00:24.285256    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a402cd4-e6e9-452a-84e6-1400c138cf5d" path="/var/lib/kubelet/pods/9a402cd4-e6e9-452a-84e6-1400c138cf5d/volumes"
Sep 09 21:02:20.355263 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:20.355236    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 21:02:20.360930 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:20.360906    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 21:02:20.362951 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:20.362931    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 21:02:20.368982 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:20.368966    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 21:02:34.031306 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031267    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7675-fc95b0"]
Sep 09 21:02:34.031707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031636    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44e0a480-cfab-47c4-9dde-44f6b16896e9" containerName="payload-pre-processing"
Sep 09 21:02:34.031707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031649    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44e0a480-cfab-47c4-9dde-44f6b16896e9" containerName="payload-pre-processing"
Sep 09 21:02:34.031707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031656    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="115f2657-df14-4c85-95b9-acdac8c58bb5" containerName="maas-api"
Sep 09 21:02:34.031707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031662    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="115f2657-df14-4c85-95b9-acdac8c58bb5" containerName="maas-api"
Sep 09 21:02:34.031707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031671    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a80153f8-d071-4405-ba9c-c4e831e8ccc1" containerName="maas-api"
Sep 09 21:02:34.031707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031676    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a80153f8-d071-4405-ba9c-c4e831e8ccc1" containerName="maas-api"
Sep 09 21:02:34.031707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031683    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="283ea3b5-70b9-47f2-8790-85e0ceda8b62" containerName="main"
Sep 09 21:02:34.031707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031688    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="283ea3b5-70b9-47f2-8790-85e0ceda8b62" containerName="main"
Sep 09 21:02:34.031707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031699    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df26dfa-4d53-4ba9-908a-0c3e3a192ae7" containerName="payload-processing"
Sep 09 21:02:34.031707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031705    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df26dfa-4d53-4ba9-908a-0c3e3a192ae7" containerName="payload-processing"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031714    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c091141e-54c4-4049-9687-d951ab3fdf96" containerName="maas-api"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031719    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c091141e-54c4-4049-9687-d951ab3fdf96" containerName="maas-api"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031735    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b29f7c0c-1edb-40ff-808f-0ea18cf74c72" containerName="maas-api"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031740    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b29f7c0c-1edb-40ff-808f-0ea18cf74c72" containerName="maas-api"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031745    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a402cd4-e6e9-452a-84e6-1400c138cf5d" containerName="payload-pre-processing"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031751    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a402cd4-e6e9-452a-84e6-1400c138cf5d" containerName="payload-pre-processing"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031809    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df26dfa-4d53-4ba9-908a-0c3e3a192ae7" containerName="payload-processing"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031816    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c091141e-54c4-4049-9687-d951ab3fdf96" containerName="maas-api"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031824    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b29f7c0c-1edb-40ff-808f-0ea18cf74c72" containerName="maas-api"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031830    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a80153f8-d071-4405-ba9c-c4e831e8ccc1" containerName="maas-api"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031836    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="283ea3b5-70b9-47f2-8790-85e0ceda8b62" containerName="main"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031842    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44e0a480-cfab-47c4-9dde-44f6b16896e9" containerName="payload-pre-processing"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031847    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="115f2657-df14-4c85-95b9-acdac8c58bb5" containerName="maas-api"
Sep 09 21:02:34.032017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.031852    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a402cd4-e6e9-452a-84e6-1400c138cf5d" containerName="payload-pre-processing"
Sep 09 21:02:34.034931 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.034912    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7675-fc95b0"
Sep 09 21:02:34.038347 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.038327    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-744w4\""
Sep 09 21:02:34.044509 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.044484    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7675-fc95b0"]
Sep 09 21:02:34.101642 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.101615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnqqp\" (UniqueName: \"kubernetes.io/projected/1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90-kube-api-access-mnqqp\") pod \"mt-curl-7675-fc95b0\" (UID: \"1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90\") " pod="opendatahub/mt-curl-7675-fc95b0"
Sep 09 21:02:34.202874 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.202845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnqqp\" (UniqueName: \"kubernetes.io/projected/1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90-kube-api-access-mnqqp\") pod \"mt-curl-7675-fc95b0\" (UID: \"1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90\") " pod="opendatahub/mt-curl-7675-fc95b0"
Sep 09 21:02:34.212817 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.212799    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnqqp\" (UniqueName: \"kubernetes.io/projected/1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90-kube-api-access-mnqqp\") pod \"mt-curl-7675-fc95b0\" (UID: \"1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90\") " pod="opendatahub/mt-curl-7675-fc95b0"
Sep 09 21:02:34.344798 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.344768    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7675-fc95b0"
Sep 09 21:02:34.618682 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.618655    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7675-fc95b0"]
Sep 09 21:02:34.620956 ip-10-0-137-148 kubenswrapper[2576]: W0909 21:02:34.620924    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c4c889e_21f2_47b1_ac31_e5ef0dcd4a90.slice/crio-ff779c295ce0f6d5f0ec5d632e8d35e5b7d630a25fca964e93b2c84f2625d273 WatchSource:0}: Error finding container ff779c295ce0f6d5f0ec5d632e8d35e5b7d630a25fca964e93b2c84f2625d273: Status 404 returned error can't find the container with id ff779c295ce0f6d5f0ec5d632e8d35e5b7d630a25fca964e93b2c84f2625d273
Sep 09 21:02:34.622376 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.622357    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:02:34.661760 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:34.661735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7675-fc95b0" event={"ID":"1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90","Type":"ContainerStarted","Data":"ff779c295ce0f6d5f0ec5d632e8d35e5b7d630a25fca964e93b2c84f2625d273"}
Sep 09 21:02:35.668132 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:35.668097    2576 generic.go:356] "Generic (PLEG): container finished" podID="1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90" containerID="0a7807318e42d1f60255219df30574ce5239a7359b2a3b431bc1e17f946c5b8b" exitCode=0
Sep 09 21:02:35.668558 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:35.668182    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7675-fc95b0" event={"ID":"1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90","Type":"ContainerDied","Data":"0a7807318e42d1f60255219df30574ce5239a7359b2a3b431bc1e17f946c5b8b"}
Sep 09 21:02:36.816143 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:36.816119    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7675-fc95b0"
Sep 09 21:02:36.866368 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:36.866341    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7675-fc95b0_1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90/mt-curl-7675-fc95b0/0.log"
Sep 09 21:02:36.894805 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:36.894777    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7675-fc95b0"]
Sep 09 21:02:36.904360 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:36.904334    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7675-fc95b0"]
Sep 09 21:02:36.925986 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:36.925933    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnqqp\" (UniqueName: \"kubernetes.io/projected/1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90-kube-api-access-mnqqp\") pod \"1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90\" (UID: \"1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90\") "
Sep 09 21:02:36.927909 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:36.927885    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90-kube-api-access-mnqqp" (OuterVolumeSpecName: "kube-api-access-mnqqp") pod "1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90" (UID: "1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90"). InnerVolumeSpecName "kube-api-access-mnqqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:02:37.027600 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:37.027569    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnqqp\" (UniqueName: \"kubernetes.io/projected/1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90-kube-api-access-mnqqp\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:02:37.680045 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:37.680019    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff779c295ce0f6d5f0ec5d632e8d35e5b7d630a25fca964e93b2c84f2625d273"
Sep 09 21:02:37.680045 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:37.680021    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7675-fc95b0"
Sep 09 21:02:37.690037 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:02:37.690010    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7675-fc95b0\" is forbidden: User \"system:node:ip-10-0-137-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-148.ec2.internal' and this object" podUID="1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90" pod="opendatahub/mt-curl-7675-fc95b0"
Sep 09 21:02:38.285657 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:02:38.285624    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90" path="/var/lib/kubelet/pods/1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90/volumes"
Sep 09 21:03:35.578604 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.578534    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"]
Sep 09 21:03:35.581277 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.578804    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8" podUID="7352d53b-51aa-41e4-bb66-c63217dd6bb8" containerName="payload-pre-processing" containerID="cri-o://7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c" gracePeriod=30
Sep 09 21:03:35.832437 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.832376    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 21:03:35.952319 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.952285    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52c2n\" (UniqueName: \"kubernetes.io/projected/7352d53b-51aa-41e4-bb66-c63217dd6bb8-kube-api-access-52c2n\") pod \"7352d53b-51aa-41e4-bb66-c63217dd6bb8\" (UID: \"7352d53b-51aa-41e4-bb66-c63217dd6bb8\") "
Sep 09 21:03:35.952477 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.952426    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7352d53b-51aa-41e4-bb66-c63217dd6bb8-plugins-config-volume\") pod \"7352d53b-51aa-41e4-bb66-c63217dd6bb8\" (UID: \"7352d53b-51aa-41e4-bb66-c63217dd6bb8\") "
Sep 09 21:03:35.952791 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.952756    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7352d53b-51aa-41e4-bb66-c63217dd6bb8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7352d53b-51aa-41e4-bb66-c63217dd6bb8" (UID: "7352d53b-51aa-41e4-bb66-c63217dd6bb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:03:35.954264 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.954241    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7352d53b-51aa-41e4-bb66-c63217dd6bb8-kube-api-access-52c2n" (OuterVolumeSpecName: "kube-api-access-52c2n") pod "7352d53b-51aa-41e4-bb66-c63217dd6bb8" (UID: "7352d53b-51aa-41e4-bb66-c63217dd6bb8"). InnerVolumeSpecName "kube-api-access-52c2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:03:35.992095 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.992039    2576 generic.go:356] "Generic (PLEG): container finished" podID="7352d53b-51aa-41e4-bb66-c63217dd6bb8" containerID="7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c" exitCode=0
Sep 09 21:03:35.992202 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.992110    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"
Sep 09 21:03:35.992202 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.992127    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8" event={"ID":"7352d53b-51aa-41e4-bb66-c63217dd6bb8","Type":"ContainerDied","Data":"7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c"}
Sep 09 21:03:35.992202 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.992186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8" event={"ID":"7352d53b-51aa-41e4-bb66-c63217dd6bb8","Type":"ContainerDied","Data":"1d1f441cae700c9c521f9a18c07a86e3db11b8e8aac591a4a3b3d0803c54ef4e"}
Sep 09 21:03:35.992311 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:35.992212    2576 scope.go:117] "RemoveContainer" containerID="7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c"
Sep 09 21:03:36.001150 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:36.001126    2576 scope.go:117] "RemoveContainer" containerID="7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c"
Sep 09 21:03:36.001416 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:03:36.001392    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c\": container with ID starting with 7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c not found: ID does not exist" containerID="7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c"
Sep 09 21:03:36.001493 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:36.001422    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c"} err="failed to get container status \"7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c\": rpc error: code = NotFound desc = could not find container \"7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c\": container with ID starting with 7fd97910823e2b75fdf1299c70d24ab5b7a7a218d315ea835fb0ad8fd350637c not found: ID does not exist"
Sep 09 21:03:36.015767 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:36.015746    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"]
Sep 09 21:03:36.022954 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:36.022929    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8"]
Sep 09 21:03:36.054077 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:36.054039    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52c2n\" (UniqueName: \"kubernetes.io/projected/7352d53b-51aa-41e4-bb66-c63217dd6bb8-kube-api-access-52c2n\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:03:36.054077 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:36.054075    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7352d53b-51aa-41e4-bb66-c63217dd6bb8-plugins-config-volume\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:03:36.283488 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:03:36.283404    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7352d53b-51aa-41e4-bb66-c63217dd6bb8" path="/var/lib/kubelet/pods/7352d53b-51aa-41e4-bb66-c63217dd6bb8/volumes"
Sep 09 21:05:50.303173 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.303136    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"]
Sep 09 21:05:50.303678 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.303661    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7352d53b-51aa-41e4-bb66-c63217dd6bb8" containerName="payload-pre-processing"
Sep 09 21:05:50.303740 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.303680    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7352d53b-51aa-41e4-bb66-c63217dd6bb8" containerName="payload-pre-processing"
Sep 09 21:05:50.303740 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.303705    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90" containerName="mt-curl-7675-fc95b0"
Sep 09 21:05:50.303740 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.303711    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90" containerName="mt-curl-7675-fc95b0"
Sep 09 21:05:50.303844 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.303771    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7352d53b-51aa-41e4-bb66-c63217dd6bb8" containerName="payload-pre-processing"
Sep 09 21:05:50.303844 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.303782    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4c889e-21f2-47b1-ac31-e5ef0dcd4a90" containerName="mt-curl-7675-fc95b0"
Sep 09 21:05:50.307007 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.306988    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:50.309112 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.309087    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-35e9ca-serving-cert\""
Sep 09 21:05:50.320011 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.319952    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"]
Sep 09 21:05:50.397153 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.397119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25b6p\" (UniqueName: \"kubernetes.io/projected/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-kube-api-access-25b6p\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:50.397153 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.397165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:50.397351 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.397245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:50.397351 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.397271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-metrics-certs\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:50.498476 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.498447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:50.498653 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.498485    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-metrics-certs\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:50.498653 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.498547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25b6p\" (UniqueName: \"kubernetes.io/projected/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-kube-api-access-25b6p\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:50.498653 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.498571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:50.498653 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:05:50.498608    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-serving-cert: secret "maas-api-e2e-ipp-a-35e9ca-serving-cert" not found
Sep 09 21:05:50.498863 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:05:50.498687    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-maas-api-tls podName:becf50bc-3a61-4ce4-9473-0bf3ae26b7f5 nodeName:}" failed. No retries permitted until 2026-09-09 21:05:50.998665797 +0000 UTC m=+2011.243494358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-maas-api-tls") pod "maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9" (UID: "becf50bc-3a61-4ce4-9473-0bf3ae26b7f5") : secret "maas-api-e2e-ipp-a-35e9ca-serving-cert" not found
Sep 09 21:05:50.499301 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.499276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:50.500806 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.500790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-metrics-certs\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:50.509917 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:50.509896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25b6p\" (UniqueName: \"kubernetes.io/projected/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-kube-api-access-25b6p\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:51.002307 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:51.002274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:51.004697 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:51.004668    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-maas-api-tls\") pod \"maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:51.218707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:51.218663    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:51.489395 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:51.489369    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"]
Sep 09 21:05:51.491564 ip-10-0-137-148 kubenswrapper[2576]: W0909 21:05:51.491536    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbecf50bc_3a61_4ce4_9473_0bf3ae26b7f5.slice/crio-3647a6a3f4ceb0fb43a235312649f2bdbff2a00774934dfcfd0ba4d9729cdbb0 WatchSource:0}: Error finding container 3647a6a3f4ceb0fb43a235312649f2bdbff2a00774934dfcfd0ba4d9729cdbb0: Status 404 returned error can't find the container with id 3647a6a3f4ceb0fb43a235312649f2bdbff2a00774934dfcfd0ba4d9729cdbb0
Sep 09 21:05:51.680099 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:51.680066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9" event={"ID":"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5","Type":"ContainerStarted","Data":"3647a6a3f4ceb0fb43a235312649f2bdbff2a00774934dfcfd0ba4d9729cdbb0"}
Sep 09 21:05:52.686062 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:52.686023    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9" event={"ID":"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5","Type":"ContainerStarted","Data":"d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323"}
Sep 09 21:05:52.686443 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:52.686115    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:05:52.702394 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:52.702345    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9" podStartSLOduration=2.196678862 podStartE2EDuration="2.702333292s" totalImagesPullingTime="505.65443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:05:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:05:52.701160397 +0000 UTC m=+2012.945988978" watchObservedRunningTime="2026-09-09 21:05:52.702333292 +0000 UTC m=+2012.947161873"
Sep 09 21:05:58.697211 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:05:58.697175    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:06:19.600453 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.600422    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"]
Sep 09 21:06:19.604361 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.604341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.606649 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.606630    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-2ff038-serving-cert\""
Sep 09 21:06:19.613479 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.613457    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"]
Sep 09 21:06:19.764088 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.764040    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160a2cb4-c96c-4d3d-be1b-b5264ec19193-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.764267 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.764102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-metrics-certs\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.764267 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.764132    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dng99\" (UniqueName: \"kubernetes.io/projected/160a2cb4-c96c-4d3d-be1b-b5264ec19193-kube-api-access-dng99\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.764267 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.764148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.865215 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.865140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160a2cb4-c96c-4d3d-be1b-b5264ec19193-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.865215 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.865187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-metrics-certs\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.865441 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.865230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dng99\" (UniqueName: \"kubernetes.io/projected/160a2cb4-c96c-4d3d-be1b-b5264ec19193-kube-api-access-dng99\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.865441 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.865251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.865861 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.865831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160a2cb4-c96c-4d3d-be1b-b5264ec19193-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.867557 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.867537    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.867644 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.867615    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-metrics-certs\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.873816 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.873793    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dng99\" (UniqueName: \"kubernetes.io/projected/160a2cb4-c96c-4d3d-be1b-b5264ec19193-kube-api-access-dng99\") pod \"maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:19.915431 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:19.915401    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:20.192476 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:20.192448    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"]
Sep 09 21:06:20.194947 ip-10-0-137-148 kubenswrapper[2576]: W0909 21:06:20.194916    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160a2cb4_c96c_4d3d_be1b_b5264ec19193.slice/crio-c769d1129d02166c0bfe0bd6bb80452806e627df6f10381cad2d579f79e8ca2c WatchSource:0}: Error finding container c769d1129d02166c0bfe0bd6bb80452806e627df6f10381cad2d579f79e8ca2c: Status 404 returned error can't find the container with id c769d1129d02166c0bfe0bd6bb80452806e627df6f10381cad2d579f79e8ca2c
Sep 09 21:06:20.836068 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:20.835952    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k" event={"ID":"160a2cb4-c96c-4d3d-be1b-b5264ec19193","Type":"ContainerStarted","Data":"91fb347fb5ca69b1b34d27748675dbd8475b621b0cdfeab77c1623b085d5b00c"}
Sep 09 21:06:20.836068 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:20.836026    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k" event={"ID":"160a2cb4-c96c-4d3d-be1b-b5264ec19193","Type":"ContainerStarted","Data":"c769d1129d02166c0bfe0bd6bb80452806e627df6f10381cad2d579f79e8ca2c"}
Sep 09 21:06:20.836068 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:20.836065    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:06:20.857245 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:20.857192    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k" podStartSLOduration=1.4726456620000001 podStartE2EDuration="1.857172493s" totalImagesPullingTime="384.526831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:06:20.856607507 +0000 UTC m=+2041.101436080" watchObservedRunningTime="2026-09-09 21:06:20.857172493 +0000 UTC m=+2041.102001080"
Sep 09 21:06:26.846461 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:06:26.846430    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:07:19.980602 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:19.980561    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"]
Sep 09 21:07:19.984603 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:19.984572    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:19.988081 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:19.988040    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-334ee7-serving-cert\""
Sep 09 21:07:19.999346 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:19.999323    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"]
Sep 09 21:07:20.096470 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.096436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e225a6f1-3311-4967-9ce8-4981f0e80eeb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.096470 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.096473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.096668 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.096576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg2p8\" (UniqueName: \"kubernetes.io/projected/e225a6f1-3311-4967-9ce8-4981f0e80eeb-kube-api-access-sg2p8\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.096668 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.096606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.198048 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.198016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg2p8\" (UniqueName: \"kubernetes.io/projected/e225a6f1-3311-4967-9ce8-4981f0e80eeb-kube-api-access-sg2p8\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.198048 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.198071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.198316 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.198132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e225a6f1-3311-4967-9ce8-4981f0e80eeb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.198316 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.198153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.198811 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.198789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e225a6f1-3311-4967-9ce8-4981f0e80eeb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.200232 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.200204    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-334ee7-serving-cert\""
Sep 09 21:07:20.200616 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.200599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.206596 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.206574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg2p8\" (UniqueName: \"kubernetes.io/projected/e225a6f1-3311-4967-9ce8-4981f0e80eeb-kube-api-access-sg2p8\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.208298 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:07:20.208275    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-serving-cert: secret "maas-api-e2e-ipp-cleanup-334ee7-serving-cert" not found
Sep 09 21:07:20.208429 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:07:20.208339    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-maas-api-tls podName:e225a6f1-3311-4967-9ce8-4981f0e80eeb nodeName:}" failed. No retries permitted until 2026-09-09 21:07:20.708320206 +0000 UTC m=+2100.953148768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786" (UID: "e225a6f1-3311-4967-9ce8-4981f0e80eeb") : secret "maas-api-e2e-ipp-cleanup-334ee7-serving-cert" not found
Sep 09 21:07:20.388570 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.388541    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 21:07:20.396134 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.396108    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 21:07:20.396447 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.396429    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 21:07:20.403461 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.403442    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 21:07:20.804469 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.804438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.806730 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.806703    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:20.895847 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:20.895815    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:21.168523 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:21.168498    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"]
Sep 09 21:07:21.170674 ip-10-0-137-148 kubenswrapper[2576]: W0909 21:07:21.170652    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode225a6f1_3311_4967_9ce8_4981f0e80eeb.slice/crio-5233ecc1dd87a402a0498bdc2aaf6d51f5d4f1f8e6f6917afce3e4fd1703a933 WatchSource:0}: Error finding container 5233ecc1dd87a402a0498bdc2aaf6d51f5d4f1f8e6f6917afce3e4fd1703a933: Status 404 returned error can't find the container with id 5233ecc1dd87a402a0498bdc2aaf6d51f5d4f1f8e6f6917afce3e4fd1703a933
Sep 09 21:07:22.155994 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:22.155961    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786" event={"ID":"e225a6f1-3311-4967-9ce8-4981f0e80eeb","Type":"ContainerStarted","Data":"bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3"}
Sep 09 21:07:22.156189 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:22.156015    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786" event={"ID":"e225a6f1-3311-4967-9ce8-4981f0e80eeb","Type":"ContainerStarted","Data":"5233ecc1dd87a402a0498bdc2aaf6d51f5d4f1f8e6f6917afce3e4fd1703a933"}
Sep 09 21:07:22.156189 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:22.156036    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:22.174904 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:22.174859    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786" podStartSLOduration=2.681698151 podStartE2EDuration="3.174842746s" totalImagesPullingTime="493.144595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:07:22.172157089 +0000 UTC m=+2102.416985668" watchObservedRunningTime="2026-09-09 21:07:22.174842746 +0000 UTC m=+2102.419671326"
Sep 09 21:07:28.166507 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:28.166477    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:50.602929 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:50.602884    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"]
Sep 09 21:07:50.603423 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:50.603157    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786" podUID="e225a6f1-3311-4967-9ce8-4981f0e80eeb" containerName="maas-api" containerID="cri-o://bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3" gracePeriod=30
Sep 09 21:07:50.864811 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:50.864757    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:50.962621 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:50.962585    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg2p8\" (UniqueName: \"kubernetes.io/projected/e225a6f1-3311-4967-9ce8-4981f0e80eeb-kube-api-access-sg2p8\") pod \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") "
Sep 09 21:07:50.962760 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:50.962639    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e225a6f1-3311-4967-9ce8-4981f0e80eeb-openshift-service-ca\") pod \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") "
Sep 09 21:07:50.962760 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:50.962665    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-metrics-certs\") pod \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") "
Sep 09 21:07:50.962760 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:50.962723    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-maas-api-tls\") pod \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\" (UID: \"e225a6f1-3311-4967-9ce8-4981f0e80eeb\") "
Sep 09 21:07:50.963087 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:50.963045    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e225a6f1-3311-4967-9ce8-4981f0e80eeb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e225a6f1-3311-4967-9ce8-4981f0e80eeb" (UID: "e225a6f1-3311-4967-9ce8-4981f0e80eeb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:07:50.964959 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:50.964929    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e225a6f1-3311-4967-9ce8-4981f0e80eeb" (UID: "e225a6f1-3311-4967-9ce8-4981f0e80eeb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:07:50.965140 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:50.964934    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e225a6f1-3311-4967-9ce8-4981f0e80eeb-kube-api-access-sg2p8" (OuterVolumeSpecName: "kube-api-access-sg2p8") pod "e225a6f1-3311-4967-9ce8-4981f0e80eeb" (UID: "e225a6f1-3311-4967-9ce8-4981f0e80eeb"). InnerVolumeSpecName "kube-api-access-sg2p8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:07:50.965140 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:50.964940    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e225a6f1-3311-4967-9ce8-4981f0e80eeb" (UID: "e225a6f1-3311-4967-9ce8-4981f0e80eeb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:07:51.063575 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.063545    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:07:51.063575 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.063570    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg2p8\" (UniqueName: \"kubernetes.io/projected/e225a6f1-3311-4967-9ce8-4981f0e80eeb-kube-api-access-sg2p8\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:07:51.063575 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.063581    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e225a6f1-3311-4967-9ce8-4981f0e80eeb-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:07:51.063785 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.063590    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e225a6f1-3311-4967-9ce8-4981f0e80eeb-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:07:51.302954 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.302920    2576 generic.go:356] "Generic (PLEG): container finished" podID="e225a6f1-3311-4967-9ce8-4981f0e80eeb" containerID="bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3" exitCode=0
Sep 09 21:07:51.303134 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.302962    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"
Sep 09 21:07:51.303134 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.303003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786" event={"ID":"e225a6f1-3311-4967-9ce8-4981f0e80eeb","Type":"ContainerDied","Data":"bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3"}
Sep 09 21:07:51.303134 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.303061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786" event={"ID":"e225a6f1-3311-4967-9ce8-4981f0e80eeb","Type":"ContainerDied","Data":"5233ecc1dd87a402a0498bdc2aaf6d51f5d4f1f8e6f6917afce3e4fd1703a933"}
Sep 09 21:07:51.304207 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.303095    2576 scope.go:117] "RemoveContainer" containerID="bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3"
Sep 09 21:07:51.313439 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.313422    2576 scope.go:117] "RemoveContainer" containerID="bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3"
Sep 09 21:07:51.313695 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:07:51.313677    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3\": container with ID starting with bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3 not found: ID does not exist" containerID="bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3"
Sep 09 21:07:51.313741 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.313704    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3"} err="failed to get container status \"bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3\": rpc error: code = NotFound desc = could not find container \"bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3\": container with ID starting with bc9a20d1904894ce1ef3d5bada712ca8747f1a4ed167cc23e03b8e37d381d1b3 not found: ID does not exist"
Sep 09 21:07:51.324734 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.324709    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"]
Sep 09 21:07:51.330686 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:51.330666    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-334ee7-b8944945-4r786"]
Sep 09 21:07:52.286462 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:07:52.286429    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e225a6f1-3311-4967-9ce8-4981f0e80eeb" path="/var/lib/kubelet/pods/e225a6f1-3311-4967-9ce8-4981f0e80eeb/volumes"
Sep 09 21:08:16.671881 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:16.671789    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"]
Sep 09 21:08:16.672511 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:16.672189    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9" podUID="becf50bc-3a61-4ce4-9473-0bf3ae26b7f5" containerName="maas-api" containerID="cri-o://d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323" gracePeriod=30
Sep 09 21:08:16.936157 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:16.936098    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:08:17.094269 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.094240    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-maas-api-tls\") pod \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") "
Sep 09 21:08:17.094453 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.094314    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-metrics-certs\") pod \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") "
Sep 09 21:08:17.094453 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.094385    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-openshift-service-ca\") pod \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") "
Sep 09 21:08:17.094453 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.094428    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25b6p\" (UniqueName: \"kubernetes.io/projected/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-kube-api-access-25b6p\") pod \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\" (UID: \"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5\") "
Sep 09 21:08:17.094779 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.094751    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "becf50bc-3a61-4ce4-9473-0bf3ae26b7f5" (UID: "becf50bc-3a61-4ce4-9473-0bf3ae26b7f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:08:17.096471 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.096443    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "becf50bc-3a61-4ce4-9473-0bf3ae26b7f5" (UID: "becf50bc-3a61-4ce4-9473-0bf3ae26b7f5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:08:17.096561 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.096457    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "becf50bc-3a61-4ce4-9473-0bf3ae26b7f5" (UID: "becf50bc-3a61-4ce4-9473-0bf3ae26b7f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:08:17.096664 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.096647    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-kube-api-access-25b6p" (OuterVolumeSpecName: "kube-api-access-25b6p") pod "becf50bc-3a61-4ce4-9473-0bf3ae26b7f5" (UID: "becf50bc-3a61-4ce4-9473-0bf3ae26b7f5"). InnerVolumeSpecName "kube-api-access-25b6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:08:17.195757 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.195693    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:08:17.195757 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.195716    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:08:17.195757 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.195725    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:08:17.195757 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.195734    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25b6p\" (UniqueName: \"kubernetes.io/projected/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5-kube-api-access-25b6p\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:08:17.437873 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.437832    2576 generic.go:356] "Generic (PLEG): container finished" podID="becf50bc-3a61-4ce4-9473-0bf3ae26b7f5" containerID="d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323" exitCode=0
Sep 09 21:08:17.438099 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.437877    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"
Sep 09 21:08:17.438099 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.437906    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9" event={"ID":"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5","Type":"ContainerDied","Data":"d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323"}
Sep 09 21:08:17.438099 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.437953    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9" event={"ID":"becf50bc-3a61-4ce4-9473-0bf3ae26b7f5","Type":"ContainerDied","Data":"3647a6a3f4ceb0fb43a235312649f2bdbff2a00774934dfcfd0ba4d9729cdbb0"}
Sep 09 21:08:17.438099 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.437974    2576 scope.go:117] "RemoveContainer" containerID="d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323"
Sep 09 21:08:17.447817 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.447801    2576 scope.go:117] "RemoveContainer" containerID="d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323"
Sep 09 21:08:17.448090 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:08:17.448065    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323\": container with ID starting with d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323 not found: ID does not exist" containerID="d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323"
Sep 09 21:08:17.448156 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.448099    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323"} err="failed to get container status \"d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323\": rpc error: code = NotFound desc = could not find container \"d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323\": container with ID starting with d1b870953f0621c8f1c6787fa99f522727e701ea349fee77c86a984431150323 not found: ID does not exist"
Sep 09 21:08:17.460582 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.460560    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"]
Sep 09 21:08:17.466315 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:17.466296    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-35e9ca-78fff54d87-c99z9"]
Sep 09 21:08:18.284330 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:08:18.284294    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="becf50bc-3a61-4ce4-9473-0bf3ae26b7f5" path="/var/lib/kubelet/pods/becf50bc-3a61-4ce4-9473-0bf3ae26b7f5/volumes"
Sep 09 21:09:20.702289 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:20.702256    2576 scope.go:117] "RemoveContainer" containerID="0a7807318e42d1f60255219df30574ce5239a7359b2a3b431bc1e17f946c5b8b"
Sep 09 21:09:38.720249 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:38.720214    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"]
Sep 09 21:09:38.720779 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:38.720473    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k" podUID="160a2cb4-c96c-4d3d-be1b-b5264ec19193" containerName="maas-api" containerID="cri-o://91fb347fb5ca69b1b34d27748675dbd8475b621b0cdfeab77c1623b085d5b00c" gracePeriod=30
Sep 09 21:09:38.866985 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:38.866949    2576 generic.go:356] "Generic (PLEG): container finished" podID="160a2cb4-c96c-4d3d-be1b-b5264ec19193" containerID="91fb347fb5ca69b1b34d27748675dbd8475b621b0cdfeab77c1623b085d5b00c" exitCode=0
Sep 09 21:09:38.867167 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:38.867033    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k" event={"ID":"160a2cb4-c96c-4d3d-be1b-b5264ec19193","Type":"ContainerDied","Data":"91fb347fb5ca69b1b34d27748675dbd8475b621b0cdfeab77c1623b085d5b00c"}
Sep 09 21:09:38.979659 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:38.979600    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:09:39.102596 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.102558    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dng99\" (UniqueName: \"kubernetes.io/projected/160a2cb4-c96c-4d3d-be1b-b5264ec19193-kube-api-access-dng99\") pod \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") "
Sep 09 21:09:39.102757 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.102609    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-maas-api-tls\") pod \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") "
Sep 09 21:09:39.102757 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.102701    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160a2cb4-c96c-4d3d-be1b-b5264ec19193-openshift-service-ca\") pod \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") "
Sep 09 21:09:39.102757 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.102729    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-metrics-certs\") pod \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\" (UID: \"160a2cb4-c96c-4d3d-be1b-b5264ec19193\") "
Sep 09 21:09:39.103137 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.103107    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/160a2cb4-c96c-4d3d-be1b-b5264ec19193-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "160a2cb4-c96c-4d3d-be1b-b5264ec19193" (UID: "160a2cb4-c96c-4d3d-be1b-b5264ec19193"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:09:39.104739 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.104715    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "160a2cb4-c96c-4d3d-be1b-b5264ec19193" (UID: "160a2cb4-c96c-4d3d-be1b-b5264ec19193"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:09:39.104863 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.104769    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160a2cb4-c96c-4d3d-be1b-b5264ec19193-kube-api-access-dng99" (OuterVolumeSpecName: "kube-api-access-dng99") pod "160a2cb4-c96c-4d3d-be1b-b5264ec19193" (UID: "160a2cb4-c96c-4d3d-be1b-b5264ec19193"). InnerVolumeSpecName "kube-api-access-dng99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:09:39.104863 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.104800    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "160a2cb4-c96c-4d3d-be1b-b5264ec19193" (UID: "160a2cb4-c96c-4d3d-be1b-b5264ec19193"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:09:39.204393 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.204361    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160a2cb4-c96c-4d3d-be1b-b5264ec19193-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:09:39.204393 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.204388    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:09:39.204393 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.204397    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dng99\" (UniqueName: \"kubernetes.io/projected/160a2cb4-c96c-4d3d-be1b-b5264ec19193-kube-api-access-dng99\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:09:39.204602 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.204406    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160a2cb4-c96c-4d3d-be1b-b5264ec19193-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:09:39.873212 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.873179    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k" event={"ID":"160a2cb4-c96c-4d3d-be1b-b5264ec19193","Type":"ContainerDied","Data":"c769d1129d02166c0bfe0bd6bb80452806e627df6f10381cad2d579f79e8ca2c"}
Sep 09 21:09:39.873212 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.873211    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"
Sep 09 21:09:39.873701 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.873266    2576 scope.go:117] "RemoveContainer" containerID="91fb347fb5ca69b1b34d27748675dbd8475b621b0cdfeab77c1623b085d5b00c"
Sep 09 21:09:39.894935 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.894913    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"]
Sep 09 21:09:39.899210 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:39.899189    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2ff038-87fdf8967-v676k"]
Sep 09 21:09:40.284743 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:40.284718    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="160a2cb4-c96c-4d3d-be1b-b5264ec19193" path="/var/lib/kubelet/pods/160a2cb4-c96c-4d3d-be1b-b5264ec19193/volumes"
Sep 09 21:09:56.761271 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:56.761188    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"]
Sep 09 21:09:56.761659 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:56.761432    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd" podUID="cfc213dc-68df-428b-b530-66ab441cdae7" containerName="maas-api" containerID="cri-o://687f60adf3ee9f7c4839d4d8b3a22689e1417a98b60dbfefb73208b7c7c0717c" gracePeriod=30
Sep 09 21:09:56.961234 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:56.961202    2576 generic.go:356] "Generic (PLEG): container finished" podID="cfc213dc-68df-428b-b530-66ab441cdae7" containerID="687f60adf3ee9f7c4839d4d8b3a22689e1417a98b60dbfefb73208b7c7c0717c" exitCode=0
Sep 09 21:09:56.961395 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:56.961276    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd" event={"ID":"cfc213dc-68df-428b-b530-66ab441cdae7","Type":"ContainerDied","Data":"687f60adf3ee9f7c4839d4d8b3a22689e1417a98b60dbfefb73208b7c7c0717c"}
Sep 09 21:09:57.017365 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.017298    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 21:09:57.167449 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.167405    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-maas-api-tls\") pod \"cfc213dc-68df-428b-b530-66ab441cdae7\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") "
Sep 09 21:09:57.167617 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.167494    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-metrics-certs\") pod \"cfc213dc-68df-428b-b530-66ab441cdae7\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") "
Sep 09 21:09:57.168028 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.167558    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4llg\" (UniqueName: \"kubernetes.io/projected/cfc213dc-68df-428b-b530-66ab441cdae7-kube-api-access-q4llg\") pod \"cfc213dc-68df-428b-b530-66ab441cdae7\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") "
Sep 09 21:09:57.168144 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.168107    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc213dc-68df-428b-b530-66ab441cdae7-openshift-service-ca\") pod \"cfc213dc-68df-428b-b530-66ab441cdae7\" (UID: \"cfc213dc-68df-428b-b530-66ab441cdae7\") "
Sep 09 21:09:57.168619 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.168594    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfc213dc-68df-428b-b530-66ab441cdae7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cfc213dc-68df-428b-b530-66ab441cdae7" (UID: "cfc213dc-68df-428b-b530-66ab441cdae7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:09:57.169240 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.169218    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc213dc-68df-428b-b530-66ab441cdae7-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:09:57.172102 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.170339    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cfc213dc-68df-428b-b530-66ab441cdae7" (UID: "cfc213dc-68df-428b-b530-66ab441cdae7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:09:57.172102 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.170465    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cfc213dc-68df-428b-b530-66ab441cdae7" (UID: "cfc213dc-68df-428b-b530-66ab441cdae7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:09:57.172102 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.170501    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc213dc-68df-428b-b530-66ab441cdae7-kube-api-access-q4llg" (OuterVolumeSpecName: "kube-api-access-q4llg") pod "cfc213dc-68df-428b-b530-66ab441cdae7" (UID: "cfc213dc-68df-428b-b530-66ab441cdae7"). InnerVolumeSpecName "kube-api-access-q4llg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:09:57.270326 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.270249    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:09:57.270326 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.270288    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4llg\" (UniqueName: \"kubernetes.io/projected/cfc213dc-68df-428b-b530-66ab441cdae7-kube-api-access-q4llg\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:09:57.270326 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.270302    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc213dc-68df-428b-b530-66ab441cdae7-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:09:57.967490 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.967454    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"
Sep 09 21:09:57.967490 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.967472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd" event={"ID":"cfc213dc-68df-428b-b530-66ab441cdae7","Type":"ContainerDied","Data":"93a4933761e4a4dadec3a1af31b6d18c0995d7697497dd991f524df9b89d39d2"}
Sep 09 21:09:57.967974 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.967542    2576 scope.go:117] "RemoveContainer" containerID="687f60adf3ee9f7c4839d4d8b3a22689e1417a98b60dbfefb73208b7c7c0717c"
Sep 09 21:09:57.988914 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.988885    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"]
Sep 09 21:09:57.995921 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:57.995899    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cb82f2-78cdf77ddf-4gmzd"]
Sep 09 21:09:58.284513 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:09:58.284487    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfc213dc-68df-428b-b530-66ab441cdae7" path="/var/lib/kubelet/pods/cfc213dc-68df-428b-b530-66ab441cdae7/volumes"
Sep 09 21:10:14.760792 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:14.760751    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"]
Sep 09 21:10:14.761388 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:14.760970    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc" podUID="ca79ea13-1e17-4978-b09b-138979991cf7" containerName="maas-api" containerID="cri-o://f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f" gracePeriod=30
Sep 09 21:10:15.009326 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.009298    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 21:10:15.053991 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.053950    2576 generic.go:356] "Generic (PLEG): container finished" podID="ca79ea13-1e17-4978-b09b-138979991cf7" containerID="f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f" exitCode=0
Sep 09 21:10:15.054262 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.054027    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"
Sep 09 21:10:15.054262 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.054028    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc" event={"ID":"ca79ea13-1e17-4978-b09b-138979991cf7","Type":"ContainerDied","Data":"f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f"}
Sep 09 21:10:15.054262 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.054196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc" event={"ID":"ca79ea13-1e17-4978-b09b-138979991cf7","Type":"ContainerDied","Data":"c20783473149b3a46962f1e57a9f6fc499a9a8982a81c0bb1d4e2a8a8aee463e"}
Sep 09 21:10:15.054262 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.054235    2576 scope.go:117] "RemoveContainer" containerID="f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f"
Sep 09 21:10:15.063261 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.063244    2576 scope.go:117] "RemoveContainer" containerID="f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f"
Sep 09 21:10:15.063734 ip-10-0-137-148 kubenswrapper[2576]: E0909 21:10:15.063670    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f\": container with ID starting with f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f not found: ID does not exist" containerID="f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f"
Sep 09 21:10:15.063837 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.063746    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f"} err="failed to get container status \"f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f\": rpc error: code = NotFound desc = could not find container \"f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f\": container with ID starting with f42281b080f3934ba2e53e2507d723257b943314cf8294805483ccf7f6702c6f not found: ID does not exist"
Sep 09 21:10:15.115793 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.115774    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-978tz\" (UniqueName: \"kubernetes.io/projected/ca79ea13-1e17-4978-b09b-138979991cf7-kube-api-access-978tz\") pod \"ca79ea13-1e17-4978-b09b-138979991cf7\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") "
Sep 09 21:10:15.115921 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.115849    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-metrics-certs\") pod \"ca79ea13-1e17-4978-b09b-138979991cf7\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") "
Sep 09 21:10:15.115986 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.115959    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca79ea13-1e17-4978-b09b-138979991cf7-openshift-service-ca\") pod \"ca79ea13-1e17-4978-b09b-138979991cf7\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") "
Sep 09 21:10:15.116074 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.116006    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-maas-api-tls\") pod \"ca79ea13-1e17-4978-b09b-138979991cf7\" (UID: \"ca79ea13-1e17-4978-b09b-138979991cf7\") "
Sep 09 21:10:15.116349 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.116329    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca79ea13-1e17-4978-b09b-138979991cf7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca79ea13-1e17-4978-b09b-138979991cf7" (UID: "ca79ea13-1e17-4978-b09b-138979991cf7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:10:15.117884 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.117862    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ca79ea13-1e17-4978-b09b-138979991cf7" (UID: "ca79ea13-1e17-4978-b09b-138979991cf7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:10:15.117957 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.117879    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca79ea13-1e17-4978-b09b-138979991cf7-kube-api-access-978tz" (OuterVolumeSpecName: "kube-api-access-978tz") pod "ca79ea13-1e17-4978-b09b-138979991cf7" (UID: "ca79ea13-1e17-4978-b09b-138979991cf7"). InnerVolumeSpecName "kube-api-access-978tz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:10:15.117957 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.117884    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca79ea13-1e17-4978-b09b-138979991cf7" (UID: "ca79ea13-1e17-4978-b09b-138979991cf7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:10:15.216700 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.216667    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-metrics-certs\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:10:15.216700 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.216696    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca79ea13-1e17-4978-b09b-138979991cf7-openshift-service-ca\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:10:15.216700 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.216708    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca79ea13-1e17-4978-b09b-138979991cf7-maas-api-tls\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:10:15.216909 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.216717    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-978tz\" (UniqueName: \"kubernetes.io/projected/ca79ea13-1e17-4978-b09b-138979991cf7-kube-api-access-978tz\") on node \"ip-10-0-137-148.ec2.internal\" DevicePath \"\""
Sep 09 21:10:15.376767 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.376730    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"]
Sep 09 21:10:15.381128 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:15.381096    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-a2fb5a-5556cdb888-mlhsc"]
Sep 09 21:10:16.283402 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:10:16.283366    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca79ea13-1e17-4978-b09b-138979991cf7" path="/var/lib/kubelet/pods/ca79ea13-1e17-4978-b09b-138979991cf7/volumes"
Sep 09 21:12:20.419214 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:12:20.419187    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 21:12:20.427155 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:12:20.427129    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 21:12:20.428337 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:12:20.428314    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 21:12:20.435335 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:12:20.435318    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdv5s_cc9892d0-0892-44d3-ba24-52b0a05abcee/ovn-acl-logging/0.log"
Sep 09 21:15:39.579011 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.578973    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"]
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579381    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="becf50bc-3a61-4ce4-9473-0bf3ae26b7f5" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579394    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="becf50bc-3a61-4ce4-9473-0bf3ae26b7f5" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579406    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc213dc-68df-428b-b530-66ab441cdae7" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579412    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc213dc-68df-428b-b530-66ab441cdae7" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579425    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160a2cb4-c96c-4d3d-be1b-b5264ec19193" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579431    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="160a2cb4-c96c-4d3d-be1b-b5264ec19193" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579438    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca79ea13-1e17-4978-b09b-138979991cf7" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579443    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca79ea13-1e17-4978-b09b-138979991cf7" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579453    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e225a6f1-3311-4967-9ce8-4981f0e80eeb" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579458    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e225a6f1-3311-4967-9ce8-4981f0e80eeb" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579512    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e225a6f1-3311-4967-9ce8-4981f0e80eeb" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579519    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfc213dc-68df-428b-b530-66ab441cdae7" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579526    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca79ea13-1e17-4978-b09b-138979991cf7" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579534    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="160a2cb4-c96c-4d3d-be1b-b5264ec19193" containerName="maas-api"
Sep 09 21:15:39.579696 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.579540    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="becf50bc-3a61-4ce4-9473-0bf3ae26b7f5" containerName="maas-api"
Sep 09 21:15:39.582490 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.582469    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.585195 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.585169    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-maas-api-tls\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.585310 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.585205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-openshift-service-ca\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.585380 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.585307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcrsx\" (UniqueName: \"kubernetes.io/projected/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-kube-api-access-hcrsx\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.585467 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.585439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-metrics-certs\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.585589 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.585566    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 21:15:39.585589 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.585575    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pzpjp\""
Sep 09 21:15:39.585707 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.585640    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 21:15:39.593020 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.592998    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"]
Sep 09 21:15:39.686216 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.686179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcrsx\" (UniqueName: \"kubernetes.io/projected/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-kube-api-access-hcrsx\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.686410 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.686274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-metrics-certs\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.686410 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.686303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-maas-api-tls\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.686410 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.686328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-openshift-service-ca\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.687032 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.687007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-openshift-service-ca\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.688788 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.688766    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-maas-api-tls\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.688876 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.688847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-metrics-certs\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.694709 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.694691    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcrsx\" (UniqueName: \"kubernetes.io/projected/30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2-kube-api-access-hcrsx\") pod \"maas-api-57c49c564c-dwpph\" (UID: \"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2\") " pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:39.893980 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:39.893886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:40.165367 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:40.165343    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"]
Sep 09 21:15:40.167809 ip-10-0-137-148 kubenswrapper[2576]: W0909 21:15:40.167783    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f4ac20_eca6_4ed0_97cd_0e9eb03f01e2.slice/crio-9a33c55eafacd6752f2189cd56b2daf6c3bb806a0ae29e398226f2ebe24bf664 WatchSource:0}: Error finding container 9a33c55eafacd6752f2189cd56b2daf6c3bb806a0ae29e398226f2ebe24bf664: Status 404 returned error can't find the container with id 9a33c55eafacd6752f2189cd56b2daf6c3bb806a0ae29e398226f2ebe24bf664
Sep 09 21:15:40.169449 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:40.169432    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:15:40.637004 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:40.636976    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph" event={"ID":"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2","Type":"ContainerStarted","Data":"33e558c6ed8dc2850ed23a87f9c454db3bf55a6469c0844c20443d659ad51495"}
Sep 09 21:15:40.637339 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:40.637026    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph" event={"ID":"30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2","Type":"ContainerStarted","Data":"9a33c55eafacd6752f2189cd56b2daf6c3bb806a0ae29e398226f2ebe24bf664"}
Sep 09 21:15:40.637339 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:40.637074    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:15:40.654471 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:40.654428    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph" podStartSLOduration=1.312115881 podStartE2EDuration="1.654410199s" totalImagesPullingTime="342.294318ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:15:40.653894966 +0000 UTC m=+2600.898723547" watchObservedRunningTime="2026-09-09 21:15:40.654410199 +0000 UTC m=+2600.899238780"
Sep 09 21:15:46.646894 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:15:46.646819    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-57c49c564c-dwpph"
Sep 09 21:16:06.629256 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:06.629224    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4vv59_c7a75abd-e205-466d-90c5-7c51ca86911b/server/0.log"
Sep 09 21:16:06.754400 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:06.754369    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qcjdv_859a7174-9a0f-47ec-b0ea-5c9039b6ea2c/manager/0.log"
Sep 09 21:16:06.972101 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:06.972015    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859cf57674-fpbz2_6de65ffc-ebcf-4ad3-9a79-a21071b0892c/copy-manifests/0.log"
Sep 09 21:16:06.989777 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:06.989740    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859cf57674-fpbz2_6de65ffc-ebcf-4ad3-9a79-a21071b0892c/manager/0.log"
Sep 09 21:16:07.547464 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:07.547435    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-57c49c564c-dwpph_30f4ac20-eca6-4ed0-97cd-0e9eb03f01e2/maas-api/0.log"
Sep 09 21:16:07.947103 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:07.947006    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zvqq6_41a41bca-8d05-49dd-a79f-9ca665caef45/postgres/0.log"
Sep 09 21:16:09.804205 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:09.804156    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4lrb5_dde0acaa-abc2-461f-b484-0d0c2ca231ed/discovery/0.log"
Sep 09 21:16:10.248365 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:10.248284    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8prfq_c8cef09e-03d5-4102-8c13-73e2c5a96941/payload-pre-processing/0.log"
Sep 09 21:16:10.474017 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:10.473985    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6ff78776b6-sf6fh_07ac87e1-029c-4b8d-a3bf-d6824fc996b1/router/0.log"
Sep 09 21:16:10.794841 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:10.794812    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mfgwf_a9fe94d4-6e62-4a93-9cfc-c7d2d16667af/main/0.log"
Sep 09 21:16:11.214690 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:11.214603    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fp56xd_d91e6d65-4fa2-4f97-bc49-bfd2ca5b025c/main/0.log"
Sep 09 21:16:11.320791 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:11.320763    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ztp9m_0c3f81b4-57dc-40ae-bf95-66c7d47a3748/main/0.log"
Sep 09 21:16:19.841041 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:19.841009    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bdq2b_3bdc10f7-ca9b-4fca-8f00-646d10bd9fed/global-pull-secret-syncer/0.log"
Sep 09 21:16:20.106877 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:20.106798    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vjhf2_dcdc94ca-27de-4312-abb5-68e3fca5340f/konnectivity-agent/0.log"
Sep 09 21:16:20.158453 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:20.158423    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-148.ec2.internal_07650a7db62586f9e69be13fe56d6e10/haproxy/0.log"
Sep 09 21:16:26.585304 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:26.585269    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-5lwhz_b5e47679-aac4-4d6c-86dc-f0aa8470a620/cluster-monitoring-operator/0.log"
Sep 09 21:16:26.985064 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:26.984977    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cdgsf_ecb9ea66-639e-48ba-8eca-15c1f2912768/node-exporter/0.log"
Sep 09 21:16:27.018234 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:27.018204    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cdgsf_ecb9ea66-639e-48ba-8eca-15c1f2912768/kube-rbac-proxy/0.log"
Sep 09 21:16:27.059506 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:27.059483    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cdgsf_ecb9ea66-639e-48ba-8eca-15c1f2912768/init-textfile/0.log"
Sep 09 21:16:27.913626 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:27.913599    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85497c9447-5vthh_e20bcb22-c59f-46f4-adf0-05ada86eb1f7/telemeter-client/0.log"
Sep 09 21:16:27.943913 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:27.943883    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85497c9447-5vthh_e20bcb22-c59f-46f4-adf0-05ada86eb1f7/reload/0.log"
Sep 09 21:16:27.969596 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:27.969571    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85497c9447-5vthh_e20bcb22-c59f-46f4-adf0-05ada86eb1f7/kube-rbac-proxy/0.log"
Sep 09 21:16:29.335534 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:29.335506    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-m8xnm_b916b4e7-efa8-4bdf-80f8-b55053d694f1/networking-console-plugin/0.log"
Sep 09 21:16:29.962533 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:29.962498    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/2.log"
Sep 09 21:16:29.969530 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:29.969506    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-89qb9_14dfc402-d1ec-4e2a-8b92-97cbea8ff336/console-operator/3.log"
Sep 09 21:16:30.128012 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.127979    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"]
Sep 09 21:16:30.131670 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.131647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.133784 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.133763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8prvh\"/\"kube-root-ca.crt\""
Sep 09 21:16:30.133891 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.133807    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8prvh\"/\"openshift-service-ca.crt\""
Sep 09 21:16:30.134462 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.134444    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8prvh\"/\"default-dockercfg-lr2bl\""
Sep 09 21:16:30.140539 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.140519    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"]
Sep 09 21:16:30.317874 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.317841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-lib-modules\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.318031 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.317890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-proc\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.318031 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.317944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-podres\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.318182 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.318028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-sys\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.318182 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.318077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2x9w\" (UniqueName: \"kubernetes.io/projected/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-kube-api-access-k2x9w\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.418612 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.418575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-sys\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.418612 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.418617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2x9w\" (UniqueName: \"kubernetes.io/projected/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-kube-api-access-k2x9w\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.419128 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.418684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-lib-modules\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.419128 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.418747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-proc\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.419128 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.418784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-podres\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.419128 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.418860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-sys\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.419128 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.418858    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-proc\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.419128 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.418890    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-lib-modules\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.419128 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.418963    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-podres\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.426200 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.426176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2x9w\" (UniqueName: \"kubernetes.io/projected/f1fd285b-4b1a-4c55-bd54-379c7af66bb1-kube-api-access-k2x9w\") pod \"perf-node-gather-daemonset-dmmtd\" (UID: \"f1fd285b-4b1a-4c55-bd54-379c7af66bb1\") " pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.442823 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.442804    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.568312 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.568236    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77856c6bbc-86db7_e20699ba-94ca-46f2-a327-9c444742fdea/console/0.log"
Sep 09 21:16:30.607119 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.607090    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-llmk7_16b76a60-dab3-45f4-a4f7-87989e648825/download-server/0.log"
Sep 09 21:16:30.713547 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.713528    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"]
Sep 09 21:16:30.715367 ip-10-0-137-148 kubenswrapper[2576]: W0909 21:16:30.715344    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf1fd285b_4b1a_4c55_bd54_379c7af66bb1.slice/crio-0a3d43c633cab6e6149678224944645a79c2fed362315bc65f539735dc354654 WatchSource:0}: Error finding container 0a3d43c633cab6e6149678224944645a79c2fed362315bc65f539735dc354654: Status 404 returned error can't find the container with id 0a3d43c633cab6e6149678224944645a79c2fed362315bc65f539735dc354654
Sep 09 21:16:30.883756 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.883732    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd" event={"ID":"f1fd285b-4b1a-4c55-bd54-379c7af66bb1","Type":"ContainerStarted","Data":"35313616ed69d1aa39e114012229d400675c3dcd564d4010188dad47f23972cb"}
Sep 09 21:16:30.883882 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.883788    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:30.883882 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.883814    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd" event={"ID":"f1fd285b-4b1a-4c55-bd54-379c7af66bb1","Type":"ContainerStarted","Data":"0a3d43c633cab6e6149678224944645a79c2fed362315bc65f539735dc354654"}
Sep 09 21:16:30.899996 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:30.899949    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd" podStartSLOduration=0.899934299 podStartE2EDuration="899.934299ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:16:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:16:30.89875428 +0000 UTC m=+2651.143582861" watchObservedRunningTime="2026-09-09 21:16:30.899934299 +0000 UTC m=+2651.144762879"
Sep 09 21:16:31.271233 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:31.271150    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-qsrhq_a905cef8-9ede-4ef9-b010-ba78a21cf9e5/volume-data-source-validator/0.log"
Sep 09 21:16:32.417401 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:32.417373    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qx7w6_09017953-d969-484e-a7f5-2b283dcc9057/dns/0.log"
Sep 09 21:16:32.440228 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:32.440205    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qx7w6_09017953-d969-484e-a7f5-2b283dcc9057/kube-rbac-proxy/0.log"
Sep 09 21:16:32.575127 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:32.575093    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zcn9h_7603a07e-0f67-4839-8e2e-b2e311c996c6/dns-node-resolver/0.log"
Sep 09 21:16:33.190622 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:33.190594    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-srzwr_da9f7d49-8d2b-467a-9a40-d426dd917c99/node-ca/0.log"
Sep 09 21:16:34.692774 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:34.692741    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4lrb5_dde0acaa-abc2-461f-b484-0d0c2ca231ed/discovery/0.log"
Sep 09 21:16:34.820104 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:34.820073    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8prfq_c8cef09e-03d5-4102-8c13-73e2c5a96941/payload-pre-processing/0.log"
Sep 09 21:16:34.889576 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:34.889553    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6ff78776b6-sf6fh_07ac87e1-029c-4b8d-a3bf-d6824fc996b1/router/0.log"
Sep 09 21:16:35.827105 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:35.827071    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wrk8d_c71a4735-d550-4196-9076-3649aab7c6c8/serve-healthcheck-canary/0.log"
Sep 09 21:16:36.349925 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:36.349893    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-m6s8n_12779b83-c860-4919-8ec3-b4182eae8455/insights-operator/0.log"
Sep 09 21:16:36.351118 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:36.351095    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-m6s8n_12779b83-c860-4919-8ec3-b4182eae8455/insights-operator/1.log"
Sep 09 21:16:36.526123 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:36.526093    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-twshm_7cd53f81-f651-4934-9948-017af2f70ec8/kube-rbac-proxy/0.log"
Sep 09 21:16:36.548541 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:36.548512    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-twshm_7cd53f81-f651-4934-9948-017af2f70ec8/exporter/0.log"
Sep 09 21:16:36.572119 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:36.572093    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-twshm_7cd53f81-f651-4934-9948-017af2f70ec8/extractor/0.log"
Sep 09 21:16:36.898126 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:36.898104    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8prvh/perf-node-gather-daemonset-dmmtd"
Sep 09 21:16:39.447869 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:39.447843    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4vv59_c7a75abd-e205-466d-90c5-7c51ca86911b/server/0.log"
Sep 09 21:16:39.592822 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:39.592791    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qcjdv_859a7174-9a0f-47ec-b0ea-5c9039b6ea2c/manager/0.log"
Sep 09 21:16:39.757116 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:39.757007    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859cf57674-fpbz2_6de65ffc-ebcf-4ad3-9a79-a21071b0892c/manager/0.log"
Sep 09 21:16:39.783572 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:39.783541    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859cf57674-fpbz2_6de65ffc-ebcf-4ad3-9a79-a21071b0892c/copy-manifests/0.log"
Sep 09 21:16:40.435166 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:40.435082    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4lrb5_dde0acaa-abc2-461f-b484-0d0c2ca231ed/discovery/0.log"
Sep 09 21:16:40.526778 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:40.526745    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8prfq_c8cef09e-03d5-4102-8c13-73e2c5a96941/payload-pre-processing/0.log"
Sep 09 21:16:40.579316 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:40.579282    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6ff78776b6-sf6fh_07ac87e1-029c-4b8d-a3bf-d6824fc996b1/router/0.log"
Sep 09 21:16:41.238463 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:41.238435    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6cdf7f9947-hlvtl_4ba6560a-9e88-48b9-a257-8a48fba85524/manager/0.log"
Sep 09 21:16:41.303416 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:41.303387    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-npkf9_4d941521-2f57-451a-9be3-1682a6dd0bd9/openshift-lws-operator/0.log"
Sep 09 21:16:42.763069 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:42.763028    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4lrb5_dde0acaa-abc2-461f-b484-0d0c2ca231ed/discovery/0.log"
Sep 09 21:16:42.864558 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:42.864530    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8prfq_c8cef09e-03d5-4102-8c13-73e2c5a96941/payload-pre-processing/0.log"
Sep 09 21:16:42.921975 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:42.921896    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6ff78776b6-sf6fh_07ac87e1-029c-4b8d-a3bf-d6824fc996b1/router/0.log"
Sep 09 21:16:46.230533 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:46.230498    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-x6jkn_8190571a-3912-46ac-8a71-cd5d36404fbb/migrator/0.log"
Sep 09 21:16:46.251363 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:46.251340    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-x6jkn_8190571a-3912-46ac-8a71-cd5d36404fbb/graceful-termination/0.log"
Sep 09 21:16:46.606728 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:46.606693    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-s79ft_e372e750-ab89-4af3-abce-7451c51194d3/kube-storage-version-migrator-operator/1.log"
Sep 09 21:16:46.608367 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:46.608337    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-s79ft_e372e750-ab89-4af3-abce-7451c51194d3/kube-storage-version-migrator-operator/0.log"
Sep 09 21:16:47.899702 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:47.899676    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vs4js_6b191398-6bb5-4187-975f-b3f80cbfa755/kube-multus-additional-cni-plugins/0.log"
Sep 09 21:16:47.921222 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:47.921189    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vs4js_6b191398-6bb5-4187-975f-b3f80cbfa755/egress-router-binary-copy/0.log"
Sep 09 21:16:47.940389 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:47.940358    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vs4js_6b191398-6bb5-4187-975f-b3f80cbfa755/cni-plugins/0.log"
Sep 09 21:16:47.961966 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:47.961918    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vs4js_6b191398-6bb5-4187-975f-b3f80cbfa755/bond-cni-plugin/0.log"
Sep 09 21:16:47.981974 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:47.981949    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vs4js_6b191398-6bb5-4187-975f-b3f80cbfa755/routeoverride-cni/0.log"
Sep 09 21:16:48.003555 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:48.003528    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vs4js_6b191398-6bb5-4187-975f-b3f80cbfa755/whereabouts-cni-bincopy/0.log"
Sep 09 21:16:48.023380 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:48.023352    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vs4js_6b191398-6bb5-4187-975f-b3f80cbfa755/whereabouts-cni/0.log"
Sep 09 21:16:48.262104 ip-10-0-137-148 kubenswrapper[2576]: I0909 21:16:48.262018    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n2rtn_6a06601e-0088-465b-a2b7-018e6c2dec8d/kube-multus/0.log"