Sep 06 00:50:19.359593 ip-10-0-130-34 systemd[1]: Starting Kubernetes Kubelet...
Sep 06 00:50:19.782072 ip-10-0-130-34 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 00:50:19.782072 ip-10-0-130-34 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 06 00:50:19.782072 ip-10-0-130-34 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 00:50:19.782072 ip-10-0-130-34 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 06 00:50:19.782072 ip-10-0-130-34 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 00:50:19.783192 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.783102    2548 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 06 00:50:19.790162 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790142    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:19.790162 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790160    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:19.790162 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790164    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790167    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790171    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790174    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790176    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790179    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790183    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790186    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790189    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790192    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790194    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790197    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790200    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790203    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790205    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790208    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790210    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790213    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790216    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790218    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:19.790280 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790221    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790224    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790227    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790229    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790232    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790236    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790239    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790243    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790248    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790253    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790256    2548 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790259    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790274    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790277    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790281    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790284    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790287    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790290    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790293    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790295    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:19.790758 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790298    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790301    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790304    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790307    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790310    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790312    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790316    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790319    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790322    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790324    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790327    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790329    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790332    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790336    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790339    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790341    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790344    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790347    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790350    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790353    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:19.791372 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790356    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790359    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790361    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790364    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790367    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790370    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790372    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790376    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790378    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790381    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790383    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790386    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790388    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790392    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790394    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790397    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790402    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790405    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790408    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:19.792167 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790411    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790414    2548 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790416    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790419    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790423    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790427    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790430    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790433    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790436    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790439    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790443    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790445    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790449    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790452    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790454    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790457    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790461    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:19.792653 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.790464    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:19.793239 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793222    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:19.793239 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793238    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793242    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793245    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793247    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793251    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793253    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793256    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793259    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793274    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793279    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793283    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793285    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793289    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793292    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793294    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793298    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793300    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793303    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793307    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793309    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:19.793309 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793313    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793316    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793319    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793321    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793324    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793327    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793329    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793332    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793335    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793338    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793341    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793345    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793349    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793352    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793355    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793358    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793360    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793363    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793365    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793368    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:19.793810 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793370    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793373    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793375    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793378    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793380    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793383    2548 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793385    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793388    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793390    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793394    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793396    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793399    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793404    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793407    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793411    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793415    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793418    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793421    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793423    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:19.794317 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793426    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793429    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793433    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793437    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793441    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793444    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793448    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793450    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793453    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793456    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793459    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793461    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793464    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793466    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793469    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793472    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793474    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793477    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793480    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:19.794793 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793482    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793485    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793487    2548 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793490    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793493    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793495    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793498    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793501    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793505    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793507    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793510    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793513    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793515    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793518    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793521    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793523    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793526    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793529    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793531    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793534    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:19.795292 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793928    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793933    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793935    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793938    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793941    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793944    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793946    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793949    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793952    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793955    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793957    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793960    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793962    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793965    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793968    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793970    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793973    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793976    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793979    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793981    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:19.795785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793984    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793987    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793990    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793993    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793995    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.793998    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794001    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794003    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794006    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794009    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794012    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794014    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794017    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794020    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794023    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794026    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794029    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794033    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794037    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:19.796295 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794040    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794043    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794046    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794049    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794052    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794055    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794058    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794061    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794064    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794066    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794070    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794072    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794075    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794079    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794082    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794085    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794088    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794091    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794093    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794096    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:19.796785 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794099    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794103    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794106    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794108    2548 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794112    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794114    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794117    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794120    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794122    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794125    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794127    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794130    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794132    2548 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794135    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794138    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794140    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794143    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794145    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794148    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794151    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:19.797297 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794153    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794156    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794158    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794161    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794164    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794167    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794170    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794173    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794176    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794178    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794181    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794185    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794188    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794190    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794193    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794196    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794198    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794201    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794204    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794207    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:19.797853 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794296    2548 flags.go:64] FLAG: --address="0.0.0.0"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794332    2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794339    2548 flags.go:64] FLAG: --anonymous-auth="true"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794343    2548 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794347    2548 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794351    2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794355    2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794359    2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794363    2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794366    2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794369    2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794373    2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794376    2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794379    2548 flags.go:64] FLAG: --cgroup-root=""
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794381    2548 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794385    2548 flags.go:64] FLAG: --client-ca-file=""
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794389    2548 flags.go:64] FLAG: --cloud-provider="external"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794392    2548 flags.go:64] FLAG: --cluster-dns="[]"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794396    2548 flags.go:64] FLAG: --cluster-domain=""
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794399    2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794403    2548 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794406    2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794409    2548 flags.go:64] FLAG: --container-log-max-files="5"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794413    2548 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 06 00:50:19.798363 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794416    2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794419    2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794423    2548 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794425    2548 flags.go:64] FLAG: --contention-profiling="false"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794428    2548 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794431    2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794435    2548 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794438    2548 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794442    2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794445    2548 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794448    2548 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794451    2548 flags.go:64] FLAG: --enable-load-reader="false"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794454    2548 flags.go:64] FLAG: --enable-server="true"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794457    2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794462    2548 flags.go:64] FLAG: --event-burst="100"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794465    2548 flags.go:64] FLAG: --event-qps="50"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794468    2548 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794470    2548 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794474    2548 flags.go:64] FLAG: --eviction-hard=""
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794478    2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794480    2548 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794484    2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794487    2548 flags.go:64] FLAG: --eviction-soft=""
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794490    2548 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794493    2548 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 06 00:50:19.798941 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794497    2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794500    2548 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794503    2548 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794506    2548 flags.go:64] FLAG: --fail-swap-on="true"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794509    2548 flags.go:64] FLAG: --feature-gates=""
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794513    2548 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794516    2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794518    2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794522    2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794524    2548 flags.go:64] FLAG: --healthz-port="10248"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794527    2548 flags.go:64] FLAG: --help="false"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794530    2548 flags.go:64] FLAG: --hostname-override="ip-10-0-130-34.ec2.internal"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794533    2548 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794536    2548 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794539    2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794542    2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794546    2548 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794548    2548 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794551    2548 flags.go:64] FLAG: --image-service-endpoint=""
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794554    2548 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794557    2548 flags.go:64] FLAG: --kube-api-burst="100"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794560    2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794563    2548 flags.go:64] FLAG: --kube-api-qps="50"
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794565    2548 flags.go:64] FLAG: --kube-reserved=""
Sep 06 00:50:19.799620 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794568    2548 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794571    2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794574    2548 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794577    2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794580    2548 flags.go:64] FLAG: --lock-file=""
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794583    2548 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794586    2548 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794589    2548 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794595    2548 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794599    2548 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794602    2548 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794605    2548 flags.go:64] FLAG: --logging-format="text"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794608    2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794611    2548 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794614    2548 flags.go:64] FLAG: --manifest-url=""
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794617    2548 flags.go:64] FLAG: --manifest-url-header=""
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794621    2548 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794624    2548 flags.go:64] FLAG: --max-open-files="1000000"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794628    2548 flags.go:64] FLAG: --max-pods="110"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794631    2548 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794634    2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794637    2548 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794640    2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794643    2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794646    2548 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 06 00:50:19.800202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794649    2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794656    2548 flags.go:64] FLAG: --node-status-max-images="50"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794660    2548 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794663    2548 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794666    2548 flags.go:64] FLAG: --pod-cidr=""
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794668    2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794675    2548 flags.go:64] FLAG: --pod-manifest-path=""
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794678    2548 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794681    2548 flags.go:64] FLAG: --pods-per-core="0"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794684    2548 flags.go:64] FLAG: --port="10250"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794687    2548 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794690    2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0924a43020115379d"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794694    2548 flags.go:64] FLAG: --qos-reserved=""
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794697    2548 flags.go:64] FLAG: --read-only-port="10255"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794700    2548 flags.go:64] FLAG: --register-node="true"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794706    2548 flags.go:64] FLAG: --register-with-taints=""
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794714    2548 flags.go:64] FLAG: --registry-burst="10"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794717    2548 flags.go:64] FLAG: --registry-qps="5"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794721    2548 flags.go:64] FLAG: --reserved-cpus=""
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794724    2548 flags.go:64] FLAG: --reserved-memory=""
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794727    2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794730    2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794733    2548 flags.go:64] FLAG: --rotate-certificates="false"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794737    2548 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794740    2548 flags.go:64] FLAG: --runonce="false"
Sep 06 00:50:19.800843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794743    2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794746    2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794749    2548 flags.go:64] FLAG: --seccomp-default="false"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794752    2548 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794755    2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794758    2548 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794760    2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794764    2548 flags.go:64] FLAG: --storage-driver-password="root"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794766    2548 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794769    2548 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794772    2548 flags.go:64] FLAG: --storage-driver-user="root"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794775    2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794778    2548 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794781    2548 flags.go:64] FLAG: --system-cgroups=""
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794784    2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794789    2548 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794792    2548 flags.go:64] FLAG: --tls-cert-file=""
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794795    2548 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794800    2548 flags.go:64] FLAG: --tls-min-version=""
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794804    2548 flags.go:64] FLAG: --tls-private-key-file=""
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794807    2548 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794810    2548 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794814    2548 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794817    2548 flags.go:64] FLAG: --v="2"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794821    2548 flags.go:64] FLAG: --version="false"
Sep 06 00:50:19.801475 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794826    2548 flags.go:64] FLAG: --vmodule=""
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794829    2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.794833    2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794946    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794950    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794954    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794958    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794961    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794964    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794967    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794970    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794973    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794977    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794980    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794983    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794986    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794989    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794992    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794995    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:19.802092 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.794998    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795001    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795003    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795006    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795009    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795011    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795014    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795018    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795022    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795025    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795030    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795033    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795036    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795039    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795045    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795048    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795050    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795053    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795056    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:19.802617 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795059    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795077    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795081    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795084    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795088    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795090    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795093    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795096    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795099    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795102    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795105    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795108    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795111    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795114    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795117    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795119    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795122    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795125    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795127    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795130    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:19.803137 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795133    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795136    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795139    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795144    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795146    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795149    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795152    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795155    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795158    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795161    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795164    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795167    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795169    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795172    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795174    2548 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795177    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795180    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795182    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795185    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795187    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:19.803668 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795190    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795193    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795196    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795198    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795201    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795203    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795206    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795209    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795211    2548 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795214    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795216    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795219    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795222    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795225    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795228    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795232    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795235    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795238    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795240    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795243    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:19.804157 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795245    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:19.804665 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795249    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:19.804665 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795252    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:19.804665 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.795254    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:19.804665 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.796256    2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 00:50:19.804665 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.804026    2548 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 06 00:50:19.804665 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.804042    2548 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 06 00:50:19.804962 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.804951    2548 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 06 00:50:19.804995 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.804966    2548 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 06 00:50:19.805034 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805026    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:19.805034 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805034    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805037    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805040    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805044    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805048    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805052    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805056    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805059    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805062    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805065    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805068    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805071    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805074    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805077    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805079    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805083    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805088    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805091    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805093    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:19.805090 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805097    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805100    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805103    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805106    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805109    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805112    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805114    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805117    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805120    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805124    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805126    2548 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805129    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805132    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805135    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805137    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805140    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805143    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805145    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805148    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805151    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:19.805594 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805153    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805156    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805159    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805161    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805164    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805166    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805169    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805172    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805174    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805176    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805179    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805182    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805184    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805188    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805193    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805196    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805199    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805202    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805205    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:19.806089 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805208    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805211    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805213    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805217    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805220    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805223    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805225    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805228    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805231    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805234    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805236    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805239    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805241    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805244    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805247    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805250    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805252    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805255    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805258    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805261    2548 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:19.806600 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805279    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805282    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805285    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805287    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805290    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805293    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805295    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805299    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805302    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805305    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805308    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805311    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805314    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805317    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805319    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805322    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805325    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805328    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805331    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:19.807091 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805333    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.805338    2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805458    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805463    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805467    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805470    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805473    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805476    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805479    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805482    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805485    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805488    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805491    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805493    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805496    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:19.807576 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805499    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805502    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805504    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805507    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805510    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805513    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805517    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805519    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805522    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805525    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805527    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805530    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805533    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805544    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805547    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805551    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805554    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805556    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805559    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805562    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:19.807953 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805564    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805567    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805570    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805572    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805575    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805578    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805580    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805583    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805585    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805588    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805591    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805594    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805597    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805599    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805602    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805605    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805608    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805611    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805614    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:19.808467 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805617    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805619    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805622    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805625    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805628    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805630    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805633    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805635    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805639    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805644    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805647    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805650    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805653    2548 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805656    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805659    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805663    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805667    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805670    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805673    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:19.808945 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805675    2548 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805678    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805681    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805684    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805687    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805689    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805692    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805695    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805697    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805700    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805703    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805706    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805709    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805711    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805714    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805718    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805721    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805724    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805726    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:19.809425 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805729    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805731    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805734    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805737    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805740    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805742    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805745    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805748    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:19.805750    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.805755    2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.805883    2548 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.808325    2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.809359    2548 server.go:1019] "Starting client certificate rotation"
Sep 06 00:50:19.809935 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.809462    2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 00:50:19.810259 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.809494    2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 00:50:19.812995 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.812969    2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 00:50:19.814175 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.814154    2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 00:50:19.829674 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.829649    2548 log.go:25] "Validated CRI v1 runtime API"
Sep 06 00:50:19.832982 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.832964    2548 log.go:25] "Validated CRI v1 image API"
Sep 06 00:50:19.833846 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.833830    2548 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 06 00:50:19.838110 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.838088    2548 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 85757c14-257f-49ff-a3ca-a73d35b0a788:/dev/nvme0n1p3 9c317b7b-48c1-4eee-8d16-76a034b1fc06:/dev/nvme0n1p4]
Sep 06 00:50:19.838200 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.838116    2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 06 00:50:19.840062 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.840042    2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 00:50:19.843397 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.843285    2548 manager.go:216] Machine: {Timestamp:2026-09-06 00:50:19.841930374 +0000 UTC m=+0.375564693 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3050789 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24abddb90ad6c2a150ee927e5d2aa5 SystemUUID:ec24abdd-b90a-d6c2-a150-ee927e5d2aa5 BootID:823b4ca7-7e1b-4dca-809a-1edce9bfa56f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:c1:80:00:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:c1:80:00:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:1a:40:d6:62:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 06 00:50:19.843397 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.843394    2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 06 00:50:19.843519 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.843485    2548 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 06 00:50:19.844701 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.844674    2548 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 06 00:50:19.844900 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.844707    2548 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-34.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 06 00:50:19.845628 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.845616    2548 topology_manager.go:138] "Creating topology manager with none policy"
Sep 06 00:50:19.845663 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.845634    2548 container_manager_linux.go:309] "Creating device plugin manager"
Sep 06 00:50:19.845663 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.845646    2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 00:50:19.846486 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.846473    2548 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 00:50:19.848392 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.848380    2548 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 06 00:50:19.854060 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.854034    2548 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 00:50:19.854204 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.854193    2548 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 06 00:50:19.854245 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.854236    2548 kubelet.go:486] "Attempting to sync node with API server"
Sep 06 00:50:19.854299 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.854261    2548 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 06 00:50:19.854299 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.854295    2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 06 00:50:19.854393 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.854310    2548 kubelet.go:398] "Adding apiserver pod source"
Sep 06 00:50:19.854393 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.854334    2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 06 00:50:19.854782 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.854769    2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 00:50:19.854812 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.854793    2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 00:50:19.857595 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.857580    2548 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 06 00:50:19.860505 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.860485    2548 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 06 00:50:19.860568 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.860519    2548 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 06 00:50:19.860691 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.860679    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 06 00:50:19.860733 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.860700    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 06 00:50:19.860733 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.860709    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 06 00:50:19.860733 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.860714    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 06 00:50:19.860733 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.860723    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 06 00:50:19.860733 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.860729    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 06 00:50:19.861390 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.861381    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 06 00:50:19.861390 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.861390    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 06 00:50:19.861455 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.861396    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 06 00:50:19.861455 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.861402    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 06 00:50:19.861455 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.861410    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 06 00:50:19.861455 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.861418    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 06 00:50:19.862337 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.862326    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 06 00:50:19.862337 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.862336    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 06 00:50:19.865819 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.865770    2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 06 00:50:19.865819 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.865737    2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 06 00:50:19.868092 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.868074    2548 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-34.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 06 00:50:19.869632 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.869608    2548 server.go:1268] "Started kubelet"
Sep 06 00:50:19.869715 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.869661    2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 06 00:50:19.869785 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.869748    2548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 06 00:50:19.869855 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.869840    2548 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 06 00:50:19.870624 ip-10-0-130-34 systemd[1]: Started Kubernetes Kubelet.
Sep 06 00:50:19.870889 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.870877    2548 server.go:310] "Adding debug handlers to kubelet server"
Sep 06 00:50:19.871379 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.871360    2548 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 06 00:50:19.874731 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.874700    2548 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 06 00:50:19.876256 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.875130    2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-34.ec2.internal.18d294fdd0c2b8da  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-34.ec2.internal,UID:ip-10-0-130-34.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-34.ec2.internal,},FirstTimestamp:2026-09-06 00:50:19.869567194 +0000 UTC m=+0.403201515,LastTimestamp:2026-09-06 00:50:19.869567194 +0000 UTC m=+0.403201515,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-34.ec2.internal,}"
Sep 06 00:50:19.877172 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.877152    2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 06 00:50:19.877875 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.877858    2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 06 00:50:19.878072 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.878052    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:19.878806 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.878670    2548 factory.go:55] Registering systemd factory
Sep 06 00:50:19.878806 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.878691    2548 factory.go:223] Registration of the systemd container factory successfully
Sep 06 00:50:19.878895 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.878887    2548 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 06 00:50:19.878970 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.878949    2548 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 06 00:50:19.878970 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.878972    2548 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 06 00:50:19.879115 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.879051    2548 reconstruct.go:97] "Volume reconstruction finished"
Sep 06 00:50:19.879115 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.879059    2548 reconciler.go:29] "Reconciler: start to sync state"
Sep 06 00:50:19.879330 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.879313    2548 factory.go:153] Registering CRI-O factory
Sep 06 00:50:19.879330 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.879332    2548 factory.go:223] Registration of the crio container factory successfully
Sep 06 00:50:19.879470 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.879387    2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 06 00:50:19.879470 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.879406    2548 factory.go:103] Registering Raw factory
Sep 06 00:50:19.879470 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.879424    2548 manager.go:1196] Started watching for new ooms in manager
Sep 06 00:50:19.879932 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.879917    2548 manager.go:349] Starting recovery of all containers
Sep 06 00:50:19.883436 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.883406    2548 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 06 00:50:19.883547 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.883524    2548 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 06 00:50:19.891244 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.891060    2548 manager.go:354] Recovery completed
Sep 06 00:50:19.893644 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.893620    2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gkjkb"
Sep 06 00:50:19.897017 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.897003    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:19.898817 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.898801    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:19.898880 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.898834    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:19.898880 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.898848    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:19.899435 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.899412    2548 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 06 00:50:19.899435 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.899427    2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 06 00:50:19.899519 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.899447    2548 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 00:50:19.899519 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.899452    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:19.900108 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.900092    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:19.900192 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.900123    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:19.900192 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.900138    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:19.900939 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.900868    2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-34.ec2.internal.18d294fdd281126a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-34.ec2.internal,UID:ip-10-0-130-34.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-34.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-34.ec2.internal,},FirstTimestamp:2026-09-06 00:50:19.898819178 +0000 UTC m=+0.432453507,LastTimestamp:2026-09-06 00:50:19.898819178 +0000 UTC m=+0.432453507,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-34.ec2.internal,}"
Sep 06 00:50:19.901324 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.901310    2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gkjkb"
Sep 06 00:50:19.901793 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.901779    2548 policy_none.go:49] "None policy: Start"
Sep 06 00:50:19.901847 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.901798    2548 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 06 00:50:19.901847 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.901811    2548 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 06 00:50:19.904329 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.904317    2548 policy_none.go:47] "Start"
Sep 06 00:50:19.940891 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.940870    2548 manager.go:337] "Starting Device Plugin manager"
Sep 06 00:50:19.962093 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.940914    2548 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 06 00:50:19.962093 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.940926    2548 server.go:87] "Starting device plugin registration server"
Sep 06 00:50:19.962093 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.941289    2548 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 06 00:50:19.962093 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.941300    2548 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 06 00:50:19.962093 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.941409    2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 06 00:50:19.962093 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.941563    2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 06 00:50:19.962093 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.941579    2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 06 00:50:19.962093 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.942117    2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 06 00:50:19.962093 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.942172    2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:19.978819 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.978788    2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 06 00:50:19.979934 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.979916    2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 06 00:50:19.979993 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.979963    2548 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 06 00:50:19.979993 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.979987    2548 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 06 00:50:19.980108 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:19.980079    2548 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 06 00:50:19.982321 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:19.982302    2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 00:50:20.042167 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.042043    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:20.043108 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.043086    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:20.043207 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.043126    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:20.043207 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.043140    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:20.043207 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.043170    2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.052306 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.052284    2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.052381 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.052309    2548 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-34.ec2.internal\": node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:20.078157 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.078125    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:20.080148 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.080131    2548 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal"]
Sep 06 00:50:20.080207 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.080190    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:20.081465 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.081447    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:20.081580 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.081482    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:20.081580 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.081497    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:20.083972 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.083945    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:20.084109 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.084093    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.084159 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.084124    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:20.084719 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.084704    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:20.084809 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.084729    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:20.084809 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.084739    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:20.085322 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.085300    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:20.085403 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.085329    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:20.085403 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.085341    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:20.087644 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.087632    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.087690 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.087656    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:20.088308 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.088292    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:20.088384 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.088322    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:20.088384 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.088332    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:20.106117 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.106096    2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-34.ec2.internal\" not found" node="ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.110381 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.110364    2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-34.ec2.internal\" not found" node="ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.178352 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.178321    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:20.180512 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.180496    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d319572a83746e1a80bc3a6ea3eed0f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"d319572a83746e1a80bc3a6ea3eed0f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.180575 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.180523    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d319572a83746e1a80bc3a6ea3eed0f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"d319572a83746e1a80bc3a6ea3eed0f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.180575 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.180549    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40602ea1537eae72f6c1193eafd2b1fb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.ec2.internal\" (UID: \"40602ea1537eae72f6c1193eafd2b1fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.278704 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.278668    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:20.280897 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.280883    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40602ea1537eae72f6c1193eafd2b1fb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.ec2.internal\" (UID: \"40602ea1537eae72f6c1193eafd2b1fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.280954 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.280906    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d319572a83746e1a80bc3a6ea3eed0f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"d319572a83746e1a80bc3a6ea3eed0f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.280954 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.280923    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d319572a83746e1a80bc3a6ea3eed0f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"d319572a83746e1a80bc3a6ea3eed0f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.281017 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.280986    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d319572a83746e1a80bc3a6ea3eed0f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"d319572a83746e1a80bc3a6ea3eed0f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.281017 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.280985    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40602ea1537eae72f6c1193eafd2b1fb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.ec2.internal\" (UID: \"40602ea1537eae72f6c1193eafd2b1fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.281079 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.280998    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d319572a83746e1a80bc3a6ea3eed0f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"d319572a83746e1a80bc3a6ea3eed0f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.379548 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.379477    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:20.408816 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.408790    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.413877 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.413800    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:20.480570 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.480514    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:20.585880 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.585835    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:20.686529 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.686434    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:20.786779 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.786735    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:20.809114 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.809088    2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 06 00:50:20.809266 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.809248    2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 00:50:20.886828 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.886798    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:20.904914 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.904868    2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 00:45:20 +0000 UTC" deadline="2028-05-02 14:20:38.20011828 +0000 UTC"
Sep 06 00:50:20.904914 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:20.904908    2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14509h30m17.295215321s"
Sep 06 00:50:20.987057 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:20.986987    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found"
Sep 06 00:50:21.004671 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.004643    2548 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 00:50:21.019937 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:21.019903    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40602ea1537eae72f6c1193eafd2b1fb.slice/crio-b344c36d193a5538211d398e8d3104ab4da9d0459c4d2372972f5b7186bc4ae4 WatchSource:0}: Error finding container b344c36d193a5538211d398e8d3104ab4da9d0459c4d2372972f5b7186bc4ae4: Status 404 returned error can't find the container with id b344c36d193a5538211d398e8d3104ab4da9d0459c4d2372972f5b7186bc4ae4
Sep 06 00:50:21.020180 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:21.020158    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd319572a83746e1a80bc3a6ea3eed0f2.slice/crio-988307d76dfa35529bc2ecd0a47c564dc31b09106ca44d647f7ead50f8efbf2a WatchSource:0}: Error finding container 988307d76dfa35529bc2ecd0a47c564dc31b09106ca44d647f7ead50f8efbf2a: Status 404 returned error can't find the container with id 988307d76dfa35529bc2ecd0a47c564dc31b09106ca44d647f7ead50f8efbf2a
Sep 06 00:50:21.028601 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.028533    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 00:50:21.079609 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.079564    2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:21.090636 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.090608    2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 00:50:21.092726 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.092712    2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal"
Sep 06 00:50:21.104946 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.104925    2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 00:50:21.144594 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.144461    2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 00:50:21.290599 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.290508    2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 00:50:21.739574 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.739493    2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 00:50:21.856067 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.856030    2548 apiserver.go:52] "Watching apiserver"
Sep 06 00:50:21.863308 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.863280    2548 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 06 00:50:21.863893 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.863863    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-qzqcf","openshift-multus/multus-additional-cni-plugins-b5j2m","openshift-multus/multus-x6hc9","openshift-network-operator/iptables-alerter-4vf67","openshift-ovn-kubernetes/ovnkube-node-8ttrf","kube-system/global-pull-secret-syncer-fkfvk","kube-system/konnectivity-agent-4ljff","kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal","openshift-dns/node-resolver-q96w7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal","openshift-multus/network-metrics-daemon-2rjrr","openshift-network-diagnostics/network-check-target-kgj47","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj","openshift-cluster-node-tuning-operator/tuned-xxtxh"]
Sep 06 00:50:21.866534 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.866507    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:21.868784 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.868757    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.869238 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.869215    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h8fgp\""
Sep 06 00:50:21.869364 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.869231    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 06 00:50:21.869364 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.869284    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 06 00:50:21.871117 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.871090    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 06 00:50:21.871356 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.871338    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 06 00:50:21.871570 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.871551    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l6c2f\""
Sep 06 00:50:21.871684 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.871634    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 06 00:50:21.872079 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.872059    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.874849 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.874440    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 06 00:50:21.874849 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.874528    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 06 00:50:21.874849 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.874550    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vf67"
Sep 06 00:50:21.874849 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.874583    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 06 00:50:21.874849 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.874689    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fq8l4\""
Sep 06 00:50:21.875131 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.874947    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 06 00:50:21.878584 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.876933    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 06 00:50:21.878584 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.877214    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cj6x7\""
Sep 06 00:50:21.878584 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.877571    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 06 00:50:21.878584 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.877823    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.878584 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.877848    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 06 00:50:21.878584 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.878606    2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 06 00:50:21.879837 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.879813    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:21.879953 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:21.879889    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:21.880306 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.880257    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 06 00:50:21.880306 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.880266    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 06 00:50:21.880487 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.880389    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 06 00:50:21.880487 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.880418    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ggz6l\""
Sep 06 00:50:21.881520 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.881500    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 06 00:50:21.881625 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.881589    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 06 00:50:21.881681 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.881621    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 06 00:50:21.882679 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.882658    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:21.885042 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.885017    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 06 00:50:21.885144 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.885055    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vgddn\""
Sep 06 00:50:21.885144 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.885078    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qzqcf"
Sep 06 00:50:21.885268 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.885218    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 06 00:50:21.887605 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.887585    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 06 00:50:21.888013 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.887995    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 06 00:50:21.888308 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.887623    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:21.889861 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.887631    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8lbrd\""
Sep 06 00:50:21.890026 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.888370    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 06 00:50:21.892563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.891939    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:21.892563 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:21.892037    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:21.892563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892231    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-run-netns\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.892563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892265    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-var-lib-cni-bin\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.892563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892302    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-hostroot\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.892563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892353    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-run-openvswitch\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.892563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892390    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/efcd94a4-731f-48e2-89d3-b17b6b312647-dbus\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:21.892563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892466    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-device-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.892563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892503    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-socket-dir-parent\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.892563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892538    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-var-lib-kubelet\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.892563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892569    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-etc-kubernetes\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892618    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mps9w\" (UniqueName: \"kubernetes.io/projected/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-kube-api-access-mps9w\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892683    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-conf-dir\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892703    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p9qps\""
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892748    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892789    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-system-cni-dir\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892823    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-cnibin\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892865    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-var-lib-openvswitch\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892906    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b970d1f3-2798-418c-a795-2b6b6d988028-ovnkube-config\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892948    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-kubelet\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.892989    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-run-ovn\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.893022    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b970d1f3-2798-418c-a795-2b6b6d988028-env-overrides\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.893070    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b970d1f3-2798-418c-a795-2b6b6d988028-ovn-node-metrics-cert\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.893107    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwqq9\" (UniqueName: \"kubernetes.io/projected/b970d1f3-2798-418c-a795-2b6b6d988028-kube-api-access-dwqq9\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.893157    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b94681b-36d9-4371-ad05-47c56b6c5c2e-agent-certs\") pod \"konnectivity-agent-4ljff\" (UID: \"9b94681b-36d9-4371-ad05-47c56b6c5c2e\") " pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:21.893232 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.893197    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-registration-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.894032 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.893747    2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 00:50:21.894032 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.893992    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 06 00:50:21.894032 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894023    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 06 00:50:21.894250 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894231    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jlq2\" (UniqueName: \"kubernetes.io/projected/b40fa62c-73cf-4d99-b7a0-8455fc32f187-kube-api-access-9jlq2\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.894486 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894464    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-systemd-units\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.894596 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894510    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-run-systemd\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.894596 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894539    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-cni-bin\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.894596 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894570    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b94681b-36d9-4371-ad05-47c56b6c5c2e-konnectivity-ca\") pod \"konnectivity-agent-4ljff\" (UID: \"9b94681b-36d9-4371-ad05-47c56b6c5c2e\") " pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:21.894782 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894603    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-run-multus-certs\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.894782 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894638    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71634091-e5a9-4928-86fd-64aa21a3d44c-iptables-alerter-script\") pod \"iptables-alerter-4vf67\" (UID: \"71634091-e5a9-4928-86fd-64aa21a3d44c\") " pod="openshift-network-operator/iptables-alerter-4vf67"
Sep 06 00:50:21.894782 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894665    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-slash\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.894782 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894749    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-etc-openvswitch\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.894982 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894814    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-log-socket\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.894982 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894855    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-cni-netd\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.894982 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894895    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b970d1f3-2798-418c-a795-2b6b6d988028-ovnkube-script-lib\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.894982 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894936    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-var-lib-cni-multus\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.894982 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894963    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-daemon-config\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.895239 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.894994    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-etc-selinux\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.895239 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895026    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.895239 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895056    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-run-k8s-cni-cncf-io\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.895239 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895088    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-run-netns\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.895239 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895112    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-node-log\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.895239 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895142    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-run-ovn-kubernetes\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.895239 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895173    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/efcd94a4-731f-48e2-89d3-b17b6b312647-kubelet-config\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:21.895633 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895407    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-cni-binary-copy\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.895633 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895447    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71634091-e5a9-4928-86fd-64aa21a3d44c-host-slash\") pod \"iptables-alerter-4vf67\" (UID: \"71634091-e5a9-4928-86fd-64aa21a3d44c\") " pod="openshift-network-operator/iptables-alerter-4vf67"
Sep 06 00:50:21.895633 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895476    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkj52\" (UniqueName: \"kubernetes.io/projected/71634091-e5a9-4928-86fd-64aa21a3d44c-kube-api-access-xkj52\") pod \"iptables-alerter-4vf67\" (UID: \"71634091-e5a9-4928-86fd-64aa21a3d44c\") " pod="openshift-network-operator/iptables-alerter-4vf67"
Sep 06 00:50:21.895633 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895511    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.895633 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895550    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-sys-fs\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.895633 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895580    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-socket-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.895633 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895608    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-cni-dir\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.896048 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.895924    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:21.896048 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:21.896024    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:21.899396 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.899374    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q96w7"
Sep 06 00:50:21.901977 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.901957    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 06 00:50:21.902133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.902079    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 06 00:50:21.902133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.902087    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n7hjk\""
Sep 06 00:50:21.915805 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.915778    2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-624sx"
Sep 06 00:50:21.921512 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.921488    2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-624sx"
Sep 06 00:50:21.980884 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.980853    2548 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 06 00:50:21.985848 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.985789    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" event={"ID":"d319572a83746e1a80bc3a6ea3eed0f2","Type":"ContainerStarted","Data":"988307d76dfa35529bc2ecd0a47c564dc31b09106ca44d647f7ead50f8efbf2a"}
Sep 06 00:50:21.987162 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.987133    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" event={"ID":"40602ea1537eae72f6c1193eafd2b1fb","Type":"ContainerStarted","Data":"b344c36d193a5538211d398e8d3104ab4da9d0459c4d2372972f5b7186bc4ae4"}
Sep 06 00:50:21.996848 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.996769    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-daemon-config\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.996848 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.996811    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-etc-selinux\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.996848 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.996837    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.997100 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.996920    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.997100 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.996937    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-etc-selinux\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.997100 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.996988    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-run-ovn-kubernetes\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.997100 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997022    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-modprobe-d\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:21.997100 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997045    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-run-ovn-kubernetes\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.997100 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997050    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997104    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71634091-e5a9-4928-86fd-64aa21a3d44c-host-slash\") pod \"iptables-alerter-4vf67\" (UID: \"71634091-e5a9-4928-86fd-64aa21a3d44c\") " pod="openshift-network-operator/iptables-alerter-4vf67"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997131    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkj52\" (UniqueName: \"kubernetes.io/projected/71634091-e5a9-4928-86fd-64aa21a3d44c-kube-api-access-xkj52\") pod \"iptables-alerter-4vf67\" (UID: \"71634091-e5a9-4928-86fd-64aa21a3d44c\") " pod="openshift-network-operator/iptables-alerter-4vf67"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997156    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb45d3f6-b91f-430b-b76c-0261720d3daf-host\") pod \"node-ca-qzqcf\" (UID: \"cb45d3f6-b91f-430b-b76c-0261720d3daf\") " pod="openshift-image-registry/node-ca-qzqcf"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997176    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71634091-e5a9-4928-86fd-64aa21a3d44c-host-slash\") pod \"iptables-alerter-4vf67\" (UID: \"71634091-e5a9-4928-86fd-64aa21a3d44c\") " pod="openshift-network-operator/iptables-alerter-4vf67"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997181    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/206b4891-2024-44ed-9975-9c6e90ac3500-hosts-file\") pod \"node-resolver-q96w7\" (UID: \"206b4891-2024-44ed-9975-9c6e90ac3500\") " pod="openshift-dns/node-resolver-q96w7"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997227    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-sys-fs\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997269    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-socket-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997298    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmhmr\" (UniqueName: \"kubernetes.io/projected/206b4891-2024-44ed-9975-9c6e90ac3500-kube-api-access-lmhmr\") pod \"node-resolver-q96w7\" (UID: \"206b4891-2024-44ed-9975-9c6e90ac3500\") " pod="openshift-dns/node-resolver-q96w7"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997329    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/efcd94a4-731f-48e2-89d3-b17b6b312647-dbus\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997345    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-sys-fs\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997391    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-device-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997406    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/efcd94a4-731f-48e2-89d3-b17b6b312647-dbus\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997417    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-var-lib-kubelet\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997446    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mps9w\" (UniqueName: \"kubernetes.io/projected/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-kube-api-access-mps9w\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.997490 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997476    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-sysctl-d\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997530    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-socket-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997545    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b970d1f3-2798-418c-a795-2b6b6d988028-ovn-node-metrics-cert\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997560    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-daemon-config\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997573    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-conf-dir\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997566    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-var-lib-kubelet\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997606    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997625    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-conf-dir\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997642    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-system-cni-dir\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997660    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-cnibin\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997680    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-var-lib-openvswitch\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997712    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b970d1f3-2798-418c-a795-2b6b6d988028-ovnkube-config\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997738    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09bf172c-624e-4812-9f3b-8c05095cedc0-tmp\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997764    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-run-ovn\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997782    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-kubernetes\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997798    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-system-cni-dir\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997817    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-var-lib-openvswitch\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.998269 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997826    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997844    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-registration-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997888    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-systemd-units\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:21.997907    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997912    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-run\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997932    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-tuned\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997980    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b94681b-36d9-4371-ad05-47c56b6c5c2e-konnectivity-ca\") pod \"konnectivity-agent-4ljff\" (UID: \"9b94681b-36d9-4371-ad05-47c56b6c5c2e\") " pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998004    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-run-multus-certs\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998040    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71634091-e5a9-4928-86fd-64aa21a3d44c-iptables-alerter-script\") pod \"iptables-alerter-4vf67\" (UID: \"71634091-e5a9-4928-86fd-64aa21a3d44c\") " pod="openshift-network-operator/iptables-alerter-4vf67"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998066    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-slash\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.997598    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-device-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998090    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-log-socket\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998122    2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998137    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-log-socket\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998151    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-cni-netd\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998204    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b970d1f3-2798-418c-a795-2b6b6d988028-ovnkube-script-lib\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998236    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-cnibin\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998239    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-system-cni-dir\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:21.999129 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998271    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-var-lib-cni-multus\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998296    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-cni-netd\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998303    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-run-k8s-cni-cncf-io\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998332    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-run-netns\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998386    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-systemd-units\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998379    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-node-log\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998433    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-systemd\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998464    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt8f4\" (UniqueName: \"kubernetes.io/projected/ba72479c-dee0-49b8-b076-5cc94e837a4b-kube-api-access-qt8f4\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998468    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-run-ovn\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998494    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/efcd94a4-731f-48e2-89d3-b17b6b312647-kubelet-config\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998523    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-cni-binary-copy\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998543    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b40fa62c-73cf-4d99-b7a0-8455fc32f187-registration-dir\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998552    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998578    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-sys\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998587    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-run-netns\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998608    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb45d3f6-b91f-430b-b76c-0261720d3daf-serviceca\") pod \"node-ca-qzqcf\" (UID: \"cb45d3f6-b91f-430b-b76c-0261720d3daf\") " pod="openshift-image-registry/node-ca-qzqcf"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998636    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-cni-dir\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000015 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998641    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-cnibin\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998669    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-run-netns\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998697    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-var-lib-cni-bin\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998708    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-cni-dir\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998728    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-hostroot\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998754    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b970d1f3-2798-418c-a795-2b6b6d988028-ovnkube-config\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998789    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-run-openvswitch\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998839    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-var-lib-cni-multus\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998880    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-run-k8s-cni-cncf-io\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998916    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-run-netns\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998954    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-var-lib-cni-bin\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998991    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-hostroot\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998760    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-node-log\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999078    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b970d1f3-2798-418c-a795-2b6b6d988028-ovnkube-script-lib\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:21.999136    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret podName:efcd94a4-731f-48e2-89d3-b17b6b312647 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:22.499110693 +0000 UTC m=+3.032745029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret") pod "global-pull-secret-syncer-fkfvk" (UID: "efcd94a4-731f-48e2-89d3-b17b6b312647") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999208    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-host-run-multus-certs\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.998759    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-run-openvswitch\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.000831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999269    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999298    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnzwl\" (UniqueName: \"kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl\") pod \"network-check-target-kgj47\" (UID: \"ec16694e-2880-40f9-adca-896b59377e8d\") " pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999320    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-cni-binary-copy\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999328    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-socket-dir-parent\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999383    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-etc-kubernetes\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999395    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b94681b-36d9-4371-ad05-47c56b6c5c2e-konnectivity-ca\") pod \"konnectivity-agent-4ljff\" (UID: \"9b94681b-36d9-4371-ad05-47c56b6c5c2e\") " pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999409    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9kgp\" (UniqueName: \"kubernetes.io/projected/cb45d3f6-b91f-430b-b76c-0261720d3daf-kube-api-access-s9kgp\") pod \"node-ca-qzqcf\" (UID: \"cb45d3f6-b91f-430b-b76c-0261720d3daf\") " pod="openshift-image-registry/node-ca-qzqcf"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999419    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999436    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/206b4891-2024-44ed-9975-9c6e90ac3500-tmp-dir\") pod \"node-resolver-q96w7\" (UID: \"206b4891-2024-44ed-9975-9c6e90ac3500\") " pod="openshift-dns/node-resolver-q96w7"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999469    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/efcd94a4-731f-48e2-89d3-b17b6b312647-kubelet-config\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999485    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-etc-kubernetes\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999483    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-multus-socket-dir-parent\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999526    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-sysconfig\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999552    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-slash\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999601    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-lib-modules\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999629    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71634091-e5a9-4928-86fd-64aa21a3d44c-iptables-alerter-script\") pod \"iptables-alerter-4vf67\" (UID: \"71634091-e5a9-4928-86fd-64aa21a3d44c\") " pod="openshift-network-operator/iptables-alerter-4vf67"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999643    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-var-lib-kubelet\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.001466 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999677    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-host\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999705    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999758    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-kubelet\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999788    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b970d1f3-2798-418c-a795-2b6b6d988028-env-overrides\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999813    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwqq9\" (UniqueName: \"kubernetes.io/projected/b970d1f3-2798-418c-a795-2b6b6d988028-kube-api-access-dwqq9\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999841    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-kubelet\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999847    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b94681b-36d9-4371-ad05-47c56b6c5c2e-agent-certs\") pod \"konnectivity-agent-4ljff\" (UID: \"9b94681b-36d9-4371-ad05-47c56b6c5c2e\") " pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999886    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jlq2\" (UniqueName: \"kubernetes.io/projected/b40fa62c-73cf-4d99-b7a0-8455fc32f187-kube-api-access-9jlq2\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999938    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-run-systemd\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999966    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-cni-bin\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:21.999991    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z8zn\" (UniqueName: \"kubernetes.io/projected/09bf172c-624e-4812-9f3b-8c05095cedc0-kube-api-access-6z8zn\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.000039    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.000076    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-etc-openvswitch\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.000113    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-sysctl-conf\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.000168    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-host-cni-bin\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.000204    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xbhc\" (UniqueName: \"kubernetes.io/projected/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-kube-api-access-7xbhc\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.000263    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b970d1f3-2798-418c-a795-2b6b6d988028-env-overrides\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002053 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.000293    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-etc-openvswitch\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002867 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.000320    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b970d1f3-2798-418c-a795-2b6b6d988028-run-systemd\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002867 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.002716    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b970d1f3-2798-418c-a795-2b6b6d988028-ovn-node-metrics-cert\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.002981 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.002958    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b94681b-36d9-4371-ad05-47c56b6c5c2e-agent-certs\") pod \"konnectivity-agent-4ljff\" (UID: \"9b94681b-36d9-4371-ad05-47c56b6c5c2e\") " pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:22.008887 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.008858    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkj52\" (UniqueName: \"kubernetes.io/projected/71634091-e5a9-4928-86fd-64aa21a3d44c-kube-api-access-xkj52\") pod \"iptables-alerter-4vf67\" (UID: \"71634091-e5a9-4928-86fd-64aa21a3d44c\") " pod="openshift-network-operator/iptables-alerter-4vf67"
Sep 06 00:50:22.010859 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.010827    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mps9w\" (UniqueName: \"kubernetes.io/projected/d6e22eb1-677d-48e4-99be-bb0fdfe966ad-kube-api-access-mps9w\") pod \"multus-x6hc9\" (UID: \"d6e22eb1-677d-48e4-99be-bb0fdfe966ad\") " pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.012152 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.012126    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwqq9\" (UniqueName: \"kubernetes.io/projected/b970d1f3-2798-418c-a795-2b6b6d988028-kube-api-access-dwqq9\") pod \"ovnkube-node-8ttrf\" (UID: \"b970d1f3-2798-418c-a795-2b6b6d988028\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.012901 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.012873    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jlq2\" (UniqueName: \"kubernetes.io/projected/b40fa62c-73cf-4d99-b7a0-8455fc32f187-kube-api-access-9jlq2\") pod \"aws-ebs-csi-driver-node-57nwj\" (UID: \"b40fa62c-73cf-4d99-b7a0-8455fc32f187\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:22.101365 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101325    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-sys\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.101365 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101377    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb45d3f6-b91f-430b-b76c-0261720d3daf-serviceca\") pod \"node-ca-qzqcf\" (UID: \"cb45d3f6-b91f-430b-b76c-0261720d3daf\") " pod="openshift-image-registry/node-ca-qzqcf"
Sep 06 00:50:22.101625 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101408    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.101625 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101438    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzwl\" (UniqueName: \"kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl\") pod \"network-check-target-kgj47\" (UID: \"ec16694e-2880-40f9-adca-896b59377e8d\") " pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:22.101625 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101466    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9kgp\" (UniqueName: \"kubernetes.io/projected/cb45d3f6-b91f-430b-b76c-0261720d3daf-kube-api-access-s9kgp\") pod \"node-ca-qzqcf\" (UID: \"cb45d3f6-b91f-430b-b76c-0261720d3daf\") " pod="openshift-image-registry/node-ca-qzqcf"
Sep 06 00:50:22.101625 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101470    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-sys\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.101625 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101491    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/206b4891-2024-44ed-9975-9c6e90ac3500-tmp-dir\") pod \"node-resolver-q96w7\" (UID: \"206b4891-2024-44ed-9975-9c6e90ac3500\") " pod="openshift-dns/node-resolver-q96w7"
Sep 06 00:50:22.101625 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101513    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-sysconfig\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.101625 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101537    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-lib-modules\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.101994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101661    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-lib-modules\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.101994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101686    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-var-lib-kubelet\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.101994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101714    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-sysconfig\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.101994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101731    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-host\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.101994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101764    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-var-lib-kubelet\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.101994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101763    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.101994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101799    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-host\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.101994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101813    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z8zn\" (UniqueName: \"kubernetes.io/projected/09bf172c-624e-4812-9f3b-8c05095cedc0-kube-api-access-6z8zn\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.101994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101938    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/206b4891-2024-44ed-9975-9c6e90ac3500-tmp-dir\") pod \"node-resolver-q96w7\" (UID: \"206b4891-2024-44ed-9975-9c6e90ac3500\") " pod="openshift-dns/node-resolver-q96w7"
Sep 06 00:50:22.101994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101947    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:22.101994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.101990    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-sysctl-conf\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102017    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xbhc\" (UniqueName: \"kubernetes.io/projected/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-kube-api-access-7xbhc\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102047    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-modprobe-d\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.102066    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102072    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102099    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb45d3f6-b91f-430b-b76c-0261720d3daf-host\") pod \"node-ca-qzqcf\" (UID: \"cb45d3f6-b91f-430b-b76c-0261720d3daf\") " pod="openshift-image-registry/node-ca-qzqcf"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102126    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/206b4891-2024-44ed-9975-9c6e90ac3500-hosts-file\") pod \"node-resolver-q96w7\" (UID: \"206b4891-2024-44ed-9975-9c6e90ac3500\") " pod="openshift-dns/node-resolver-q96w7"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.102143    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs podName:ba72479c-dee0-49b8-b076-5cc94e837a4b nodeName:}" failed. No retries permitted until 2026-09-06 00:50:22.602123367 +0000 UTC m=+3.135757696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs") pod "network-metrics-daemon-2rjrr" (UID: "ba72479c-dee0-49b8-b076-5cc94e837a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102177    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/206b4891-2024-44ed-9975-9c6e90ac3500-hosts-file\") pod \"node-resolver-q96w7\" (UID: \"206b4891-2024-44ed-9975-9c6e90ac3500\") " pod="openshift-dns/node-resolver-q96w7"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102180    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmhmr\" (UniqueName: \"kubernetes.io/projected/206b4891-2024-44ed-9975-9c6e90ac3500-kube-api-access-lmhmr\") pod \"node-resolver-q96w7\" (UID: \"206b4891-2024-44ed-9975-9c6e90ac3500\") " pod="openshift-dns/node-resolver-q96w7"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102205    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102214    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-sysctl-d\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102291    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09bf172c-624e-4812-9f3b-8c05095cedc0-tmp\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102278    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-sysctl-conf\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102290    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102325    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-sysctl-d\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102321    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-kubernetes\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.102577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102077    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb45d3f6-b91f-430b-b76c-0261720d3daf-serviceca\") pod \"node-ca-qzqcf\" (UID: \"cb45d3f6-b91f-430b-b76c-0261720d3daf\") " pod="openshift-image-registry/node-ca-qzqcf"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102401    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-system-cni-dir\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102424    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-modprobe-d\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102453    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb45d3f6-b91f-430b-b76c-0261720d3daf-host\") pod \"node-ca-qzqcf\" (UID: \"cb45d3f6-b91f-430b-b76c-0261720d3daf\") " pod="openshift-image-registry/node-ca-qzqcf"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102457    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-system-cni-dir\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102470    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-kubernetes\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102481    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102520    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-run\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102556    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-tuned\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102591    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-run\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102592    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-cnibin\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102627    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-cnibin\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102644    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-systemd\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102700    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-systemd\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102683    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102732    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt8f4\" (UniqueName: \"kubernetes.io/projected/ba72479c-dee0-49b8-b076-5cc94e837a4b-kube-api-access-qt8f4\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:22.103437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.102828    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.104952 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.104927    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09bf172c-624e-4812-9f3b-8c05095cedc0-tmp\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.105100 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.105073    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09bf172c-624e-4812-9f3b-8c05095cedc0-etc-tuned\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.109091 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.109066    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:50:22.109205 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.109118    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:50:22.109205 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.109149    2548 projected.go:196] Error preparing data for projected volume kube-api-access-qnzwl for pod openshift-network-diagnostics/network-check-target-kgj47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:22.109474 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.109456    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl podName:ec16694e-2880-40f9-adca-896b59377e8d nodeName:}" failed. No retries permitted until 2026-09-06 00:50:22.60941234 +0000 UTC m=+3.143046676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qnzwl" (UniqueName: "kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl") pod "network-check-target-kgj47" (UID: "ec16694e-2880-40f9-adca-896b59377e8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:22.111856 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.111826    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9kgp\" (UniqueName: \"kubernetes.io/projected/cb45d3f6-b91f-430b-b76c-0261720d3daf-kube-api-access-s9kgp\") pod \"node-ca-qzqcf\" (UID: \"cb45d3f6-b91f-430b-b76c-0261720d3daf\") " pod="openshift-image-registry/node-ca-qzqcf"
Sep 06 00:50:22.112008 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.111976    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xbhc\" (UniqueName: \"kubernetes.io/projected/d5a0b4fa-fb6e-45b7-92b1-db8003e1401a-kube-api-access-7xbhc\") pod \"multus-additional-cni-plugins-b5j2m\" (UID: \"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a\") " pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.112136 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.112114    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z8zn\" (UniqueName: \"kubernetes.io/projected/09bf172c-624e-4812-9f3b-8c05095cedc0-kube-api-access-6z8zn\") pod \"tuned-xxtxh\" (UID: \"09bf172c-624e-4812-9f3b-8c05095cedc0\") " pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.112479 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.112456    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmhmr\" (UniqueName: \"kubernetes.io/projected/206b4891-2024-44ed-9975-9c6e90ac3500-kube-api-access-lmhmr\") pod \"node-resolver-q96w7\" (UID: \"206b4891-2024-44ed-9975-9c6e90ac3500\") " pod="openshift-dns/node-resolver-q96w7"
Sep 06 00:50:22.113184 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.113163    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt8f4\" (UniqueName: \"kubernetes.io/projected/ba72479c-dee0-49b8-b076-5cc94e837a4b-kube-api-access-qt8f4\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:22.182184 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.182141    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:22.192896 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.192858    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj"
Sep 06 00:50:22.204264 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.204237    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x6hc9"
Sep 06 00:50:22.210377 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.210351    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vf67"
Sep 06 00:50:22.218366 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.218338    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:22.225463 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.225433    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xxtxh"
Sep 06 00:50:22.234451 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.234424    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qzqcf"
Sep 06 00:50:22.241438 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.241418    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b5j2m"
Sep 06 00:50:22.249329 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.249281    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q96w7"
Sep 06 00:50:22.505491 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.505411    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:22.505663 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.505563    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:22.505663 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.505641    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret podName:efcd94a4-731f-48e2-89d3-b17b6b312647 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:23.505619239 +0000 UTC m=+4.039253568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret") pod "global-pull-secret-syncer-fkfvk" (UID: "efcd94a4-731f-48e2-89d3-b17b6b312647") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:22.606138 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.606100    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:22.606314 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.606294    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:22.606375 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.606365    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs podName:ba72479c-dee0-49b8-b076-5cc94e837a4b nodeName:}" failed. No retries permitted until 2026-09-06 00:50:23.606348935 +0000 UTC m=+4.139983248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs") pod "network-metrics-daemon-2rjrr" (UID: "ba72479c-dee0-49b8-b076-5cc94e837a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:22.707340 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.707283    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzwl\" (UniqueName: \"kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl\") pod \"network-check-target-kgj47\" (UID: \"ec16694e-2880-40f9-adca-896b59377e8d\") " pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:22.707517 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.707464    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:50:22.707517 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.707485    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:50:22.707517 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.707499    2548 projected.go:196] Error preparing data for projected volume kube-api-access-qnzwl for pod openshift-network-diagnostics/network-check-target-kgj47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:22.707713 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:22.707572    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl podName:ec16694e-2880-40f9-adca-896b59377e8d nodeName:}" failed. No retries permitted until 2026-09-06 00:50:23.707550965 +0000 UTC m=+4.241185291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qnzwl" (UniqueName: "kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl") pod "network-check-target-kgj47" (UID: "ec16694e-2880-40f9-adca-896b59377e8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:22.925325 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.925232    2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 00:45:22 +0000 UTC" deadline="2028-03-05 10:14:49.126322348 +0000 UTC"
Sep 06 00:50:22.925325 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:22.925263    2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13113h24m26.201062786s"
Sep 06 00:50:23.012807 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:23.012617    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb45d3f6_b91f_430b_b76c_0261720d3daf.slice/crio-1859491e1ba87a41393b21255730f3c45fcb22114d75a8209eaa18d9b294199b WatchSource:0}: Error finding container 1859491e1ba87a41393b21255730f3c45fcb22114d75a8209eaa18d9b294199b: Status 404 returned error can't find the container with id 1859491e1ba87a41393b21255730f3c45fcb22114d75a8209eaa18d9b294199b
Sep 06 00:50:23.013158 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:23.013117    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09bf172c_624e_4812_9f3b_8c05095cedc0.slice/crio-21746bcaa366516c7e05c2bb864793b88e72d3fcbc00313f0ddf6155dd3123f5 WatchSource:0}: Error finding container 21746bcaa366516c7e05c2bb864793b88e72d3fcbc00313f0ddf6155dd3123f5: Status 404 returned error can't find the container with id 21746bcaa366516c7e05c2bb864793b88e72d3fcbc00313f0ddf6155dd3123f5
Sep 06 00:50:23.015481 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:23.015304    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb970d1f3_2798_418c_a795_2b6b6d988028.slice/crio-d5bf998d7f9aff9b033ceede5b4c94c4cab30704f0ede06aecd039f94bf8e2e8 WatchSource:0}: Error finding container d5bf998d7f9aff9b033ceede5b4c94c4cab30704f0ede06aecd039f94bf8e2e8: Status 404 returned error can't find the container with id d5bf998d7f9aff9b033ceede5b4c94c4cab30704f0ede06aecd039f94bf8e2e8
Sep 06 00:50:23.016027 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:23.016000    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a0b4fa_fb6e_45b7_92b1_db8003e1401a.slice/crio-39a8b5fa9d876dc1f3df143299a68014ce8a8e9aff7ceb4b87f2aca090d7dbc1 WatchSource:0}: Error finding container 39a8b5fa9d876dc1f3df143299a68014ce8a8e9aff7ceb4b87f2aca090d7dbc1: Status 404 returned error can't find the container with id 39a8b5fa9d876dc1f3df143299a68014ce8a8e9aff7ceb4b87f2aca090d7dbc1
Sep 06 00:50:23.040609 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:23.040585    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40fa62c_73cf_4d99_b7a0_8455fc32f187.slice/crio-98fef6496a207181e36fa3868da6c67ecde399c1dfc33363d202d9e7072bd641 WatchSource:0}: Error finding container 98fef6496a207181e36fa3868da6c67ecde399c1dfc33363d202d9e7072bd641: Status 404 returned error can't find the container with id 98fef6496a207181e36fa3868da6c67ecde399c1dfc33363d202d9e7072bd641
Sep 06 00:50:23.041468 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:23.041431    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71634091_e5a9_4928_86fd_64aa21a3d44c.slice/crio-f3f1c4ec3622a09e532244b7c15acf83d514590605750140f8a52587e3e5a37c WatchSource:0}: Error finding container f3f1c4ec3622a09e532244b7c15acf83d514590605750140f8a52587e3e5a37c: Status 404 returned error can't find the container with id f3f1c4ec3622a09e532244b7c15acf83d514590605750140f8a52587e3e5a37c
Sep 06 00:50:23.043384 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:23.042526    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206b4891_2024_44ed_9975_9c6e90ac3500.slice/crio-8fb807bc075aaf1dfc5009a57ee243478d33444d572c4d9a070b3aff556ec3c2 WatchSource:0}: Error finding container 8fb807bc075aaf1dfc5009a57ee243478d33444d572c4d9a070b3aff556ec3c2: Status 404 returned error can't find the container with id 8fb807bc075aaf1dfc5009a57ee243478d33444d572c4d9a070b3aff556ec3c2
Sep 06 00:50:23.043384 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:23.043325    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b94681b_36d9_4371_ad05_47c56b6c5c2e.slice/crio-79be52c3d87030fb0b604b880f0c9b8d43c102519a419f145c8414b0386534d5 WatchSource:0}: Error finding container 79be52c3d87030fb0b604b880f0c9b8d43c102519a419f145c8414b0386534d5: Status 404 returned error can't find the container with id 79be52c3d87030fb0b604b880f0c9b8d43c102519a419f145c8414b0386534d5
Sep 06 00:50:23.045396 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:23.045381    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e22eb1_677d_48e4_99be_bb0fdfe966ad.slice/crio-f8d32a532edf3e4feb406cd25b6ab543c88ce127daa34dd6f5a8e748dc2dfdf9 WatchSource:0}: Error finding container f8d32a532edf3e4feb406cd25b6ab543c88ce127daa34dd6f5a8e748dc2dfdf9: Status 404 returned error can't find the container with id f8d32a532edf3e4feb406cd25b6ab543c88ce127daa34dd6f5a8e748dc2dfdf9
Sep 06 00:50:23.514256 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:23.514216    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:23.514505 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:23.514445    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:23.514627 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:23.514520    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret podName:efcd94a4-731f-48e2-89d3-b17b6b312647 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:25.514500574 +0000 UTC m=+6.048134885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret") pod "global-pull-secret-syncer-fkfvk" (UID: "efcd94a4-731f-48e2-89d3-b17b6b312647") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:23.615364 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:23.615128    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:23.615364 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:23.615356    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:23.615584 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:23.615431    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs podName:ba72479c-dee0-49b8-b076-5cc94e837a4b nodeName:}" failed. No retries permitted until 2026-09-06 00:50:25.615410905 +0000 UTC m=+6.149045229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs") pod "network-metrics-daemon-2rjrr" (UID: "ba72479c-dee0-49b8-b076-5cc94e837a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:23.716678 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:23.715963    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzwl\" (UniqueName: \"kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl\") pod \"network-check-target-kgj47\" (UID: \"ec16694e-2880-40f9-adca-896b59377e8d\") " pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:23.716678 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:23.716184    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:50:23.716678 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:23.716206    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:50:23.716678 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:23.716223    2548 projected.go:196] Error preparing data for projected volume kube-api-access-qnzwl for pod openshift-network-diagnostics/network-check-target-kgj47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:23.716678 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:23.716288    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl podName:ec16694e-2880-40f9-adca-896b59377e8d nodeName:}" failed. No retries permitted until 2026-09-06 00:50:25.716268463 +0000 UTC m=+6.249902785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qnzwl" (UniqueName: "kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl") pod "network-check-target-kgj47" (UID: "ec16694e-2880-40f9-adca-896b59377e8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:23.926306 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:23.926118    2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 00:45:22 +0000 UTC" deadline="2028-05-28 00:28:22.908798844 +0000 UTC"
Sep 06 00:50:23.926306 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:23.926184    2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15119h37m58.982619578s"
Sep 06 00:50:23.984738 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:23.983964    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:23.984738 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:23.984109    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:23.984738 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:23.984447    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:23.984738 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:23.984555    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:23.984738 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:23.984622    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:23.984738 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:23.984692    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:24.000262 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:23.999612    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" event={"ID":"40602ea1537eae72f6c1193eafd2b1fb","Type":"ContainerStarted","Data":"16e7fbd066708e12b3bae83be325710954abaa289b3563432193e0126098bbcb"}
Sep 06 00:50:24.002621 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.002555    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4ljff" event={"ID":"9b94681b-36d9-4371-ad05-47c56b6c5c2e","Type":"ContainerStarted","Data":"79be52c3d87030fb0b604b880f0c9b8d43c102519a419f145c8414b0386534d5"}
Sep 06 00:50:24.006673 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.006604    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q96w7" event={"ID":"206b4891-2024-44ed-9975-9c6e90ac3500","Type":"ContainerStarted","Data":"8fb807bc075aaf1dfc5009a57ee243478d33444d572c4d9a070b3aff556ec3c2"}
Sep 06 00:50:24.009157 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.009089    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj" event={"ID":"b40fa62c-73cf-4d99-b7a0-8455fc32f187","Type":"ContainerStarted","Data":"98fef6496a207181e36fa3868da6c67ecde399c1dfc33363d202d9e7072bd641"}
Sep 06 00:50:24.011061 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.010940    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf" event={"ID":"b970d1f3-2798-418c-a795-2b6b6d988028","Type":"ContainerStarted","Data":"d5bf998d7f9aff9b033ceede5b4c94c4cab30704f0ede06aecd039f94bf8e2e8"}
Sep 06 00:50:24.014366 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.014240    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qzqcf" event={"ID":"cb45d3f6-b91f-430b-b76c-0261720d3daf","Type":"ContainerStarted","Data":"1859491e1ba87a41393b21255730f3c45fcb22114d75a8209eaa18d9b294199b"}
Sep 06 00:50:24.024391 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.024147    2548 generic.go:356] "Generic (PLEG): container finished" podID="d319572a83746e1a80bc3a6ea3eed0f2" containerID="ac6720cca2302799fe4f36e570fb3a9bb7679d5d6badb6fe9b4d594204c1ae95" exitCode=0
Sep 06 00:50:24.024391 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.024225    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" event={"ID":"d319572a83746e1a80bc3a6ea3eed0f2","Type":"ContainerDied","Data":"ac6720cca2302799fe4f36e570fb3a9bb7679d5d6badb6fe9b4d594204c1ae95"}
Sep 06 00:50:24.034184 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.034115    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x6hc9" event={"ID":"d6e22eb1-677d-48e4-99be-bb0fdfe966ad","Type":"ContainerStarted","Data":"f8d32a532edf3e4feb406cd25b6ab543c88ce127daa34dd6f5a8e748dc2dfdf9"}
Sep 06 00:50:24.038128 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.038096    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vf67" event={"ID":"71634091-e5a9-4928-86fd-64aa21a3d44c","Type":"ContainerStarted","Data":"f3f1c4ec3622a09e532244b7c15acf83d514590605750140f8a52587e3e5a37c"}
Sep 06 00:50:24.042719 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.042666    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" podStartSLOduration=3.0426473 podStartE2EDuration="3.0426473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:24.015809604 +0000 UTC m=+4.549443937" watchObservedRunningTime="2026-09-06 00:50:24.0426473 +0000 UTC m=+4.576281638"
Sep 06 00:50:24.044503 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.044474    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5j2m" event={"ID":"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a","Type":"ContainerStarted","Data":"39a8b5fa9d876dc1f3df143299a68014ce8a8e9aff7ceb4b87f2aca090d7dbc1"}
Sep 06 00:50:24.050350 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:24.050273    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xxtxh" event={"ID":"09bf172c-624e-4812-9f3b-8c05095cedc0","Type":"ContainerStarted","Data":"21746bcaa366516c7e05c2bb864793b88e72d3fcbc00313f0ddf6155dd3123f5"}
Sep 06 00:50:25.083779 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:25.083590    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" event={"ID":"d319572a83746e1a80bc3a6ea3eed0f2","Type":"ContainerStarted","Data":"620112a980400e683e7d91d766bd9b0bf95152d6c41b2c353caa5da9f6624ede"}
Sep 06 00:50:25.536514 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:25.536428    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:25.536683 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:25.536631    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:25.536754 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:25.536697    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret podName:efcd94a4-731f-48e2-89d3-b17b6b312647 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:29.536678218 +0000 UTC m=+10.070312529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret") pod "global-pull-secret-syncer-fkfvk" (UID: "efcd94a4-731f-48e2-89d3-b17b6b312647") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:25.641944 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:25.641358    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:25.641944 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:25.641519    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:25.641944 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:25.641591    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs podName:ba72479c-dee0-49b8-b076-5cc94e837a4b nodeName:}" failed. No retries permitted until 2026-09-06 00:50:29.641571095 +0000 UTC m=+10.175205405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs") pod "network-metrics-daemon-2rjrr" (UID: "ba72479c-dee0-49b8-b076-5cc94e837a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:25.742436 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:25.741742    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzwl\" (UniqueName: \"kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl\") pod \"network-check-target-kgj47\" (UID: \"ec16694e-2880-40f9-adca-896b59377e8d\") " pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:25.742436 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:25.741965    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:50:25.742436 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:25.741988    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:50:25.742436 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:25.742003    2548 projected.go:196] Error preparing data for projected volume kube-api-access-qnzwl for pod openshift-network-diagnostics/network-check-target-kgj47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:25.742436 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:25.742065    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl podName:ec16694e-2880-40f9-adca-896b59377e8d nodeName:}" failed. No retries permitted until 2026-09-06 00:50:29.742046338 +0000 UTC m=+10.275680652 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qnzwl" (UniqueName: "kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl") pod "network-check-target-kgj47" (UID: "ec16694e-2880-40f9-adca-896b59377e8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:25.981847 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:25.981291    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:25.981847 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:25.981292    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:25.981847 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:25.981445    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:25.981847 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:25.981498    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:25.981847 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:25.981623    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:25.981847 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:25.981721    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:27.981738 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:27.980949    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:27.981738 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:27.981079    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:27.981738 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:27.981562    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:27.981738 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:27.981593    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:27.981738 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:27.981670    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:27.981738 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:27.981752    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:29.578252 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:29.578193    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:29.578704 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:29.578354    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:29.578704 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:29.578419    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret podName:efcd94a4-731f-48e2-89d3-b17b6b312647 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:37.578398485 +0000 UTC m=+18.112032802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret") pod "global-pull-secret-syncer-fkfvk" (UID: "efcd94a4-731f-48e2-89d3-b17b6b312647") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:29.679603 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:29.679562    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:29.679774 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:29.679707    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:29.679840 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:29.679784    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs podName:ba72479c-dee0-49b8-b076-5cc94e837a4b nodeName:}" failed. No retries permitted until 2026-09-06 00:50:37.67976325 +0000 UTC m=+18.213397571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs") pod "network-metrics-daemon-2rjrr" (UID: "ba72479c-dee0-49b8-b076-5cc94e837a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:29.781076 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:29.781017    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzwl\" (UniqueName: \"kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl\") pod \"network-check-target-kgj47\" (UID: \"ec16694e-2880-40f9-adca-896b59377e8d\") " pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:29.781254 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:29.781173    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:50:29.781254 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:29.781196    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:50:29.781254 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:29.781210    2548 projected.go:196] Error preparing data for projected volume kube-api-access-qnzwl for pod openshift-network-diagnostics/network-check-target-kgj47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:29.781454 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:29.781288    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl podName:ec16694e-2880-40f9-adca-896b59377e8d nodeName:}" failed. No retries permitted until 2026-09-06 00:50:37.78125497 +0000 UTC m=+18.314889290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qnzwl" (UniqueName: "kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl") pod "network-check-target-kgj47" (UID: "ec16694e-2880-40f9-adca-896b59377e8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:29.985038 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:29.984525    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:29.985038 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:29.984556    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:29.985038 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:29.984525    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:29.985038 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:29.984654    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:29.985038 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:29.984697    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:29.985038 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:29.984761    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:31.984212 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:31.983395    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:31.984212 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:31.983529    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:31.984212 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:31.983943    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:31.984212 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:31.984042    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:31.984212 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:31.984101    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:31.984212 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:31.984181    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:33.980843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:33.980753    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:33.980843 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:33.980790    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:33.981382 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:33.980871    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:33.981382 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:33.980894    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:33.981382 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:33.980988    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:33.981382 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:33.981079    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:35.983645 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:35.983614    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:35.984043 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:35.983739    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:35.984043 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:35.983742    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:35.984043 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:35.983746    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:35.984043 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:35.983827    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:35.984043 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:35.983886    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:37.643862 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:37.643827    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:37.644243 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:37.643933    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:37.644243 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:37.643984    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret podName:efcd94a4-731f-48e2-89d3-b17b6b312647 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:53.643969625 +0000 UTC m=+34.177603930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret") pod "global-pull-secret-syncer-fkfvk" (UID: "efcd94a4-731f-48e2-89d3-b17b6b312647") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:37.744606 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:37.744566    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:37.744785 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:37.744684    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:37.744785 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:37.744750    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs podName:ba72479c-dee0-49b8-b076-5cc94e837a4b nodeName:}" failed. No retries permitted until 2026-09-06 00:50:53.744730634 +0000 UTC m=+34.278364940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs") pod "network-metrics-daemon-2rjrr" (UID: "ba72479c-dee0-49b8-b076-5cc94e837a4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:37.845174 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:37.845142    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzwl\" (UniqueName: \"kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl\") pod \"network-check-target-kgj47\" (UID: \"ec16694e-2880-40f9-adca-896b59377e8d\") " pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:37.845359 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:37.845295    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:50:37.845359 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:37.845328    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:50:37.845359 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:37.845337    2548 projected.go:196] Error preparing data for projected volume kube-api-access-qnzwl for pod openshift-network-diagnostics/network-check-target-kgj47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:37.845542 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:37.845388    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl podName:ec16694e-2880-40f9-adca-896b59377e8d nodeName:}" failed. No retries permitted until 2026-09-06 00:50:53.84537449 +0000 UTC m=+34.379008808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qnzwl" (UniqueName: "kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl") pod "network-check-target-kgj47" (UID: "ec16694e-2880-40f9-adca-896b59377e8d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:37.980373 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:37.980337    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:37.980373 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:37.980373    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:37.980583 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:37.980337    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:37.980583 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:37.980452    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:37.980583 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:37.980549    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:37.980750 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:37.980653    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:39.983727 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:39.983695    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:39.984149 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:39.983818    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:39.984149 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:39.983831    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:39.984149 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:39.983813    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:39.984149 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:39.983905    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:39.984149 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:39.983971    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:41.980885 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:41.980701    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:41.981608 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:41.980701    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:41.981608 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:41.980952    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:41.981608 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:41.981035    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:41.981608 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:41.980761    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:41.981608 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:41.981122    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:42.135356 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.135307    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4ljff" event={"ID":"9b94681b-36d9-4371-ad05-47c56b6c5c2e","Type":"ContainerStarted","Data":"45d3d0750644a74f68d56084c72ece128da763d3528e6f69c32fc9da8f69e266"}
Sep 06 00:50:42.137218 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.137178    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q96w7" event={"ID":"206b4891-2024-44ed-9975-9c6e90ac3500","Type":"ContainerStarted","Data":"2b752fd6e0289c797589fb7fc85bfe1e4e4025eb4914e625748d5953d1f2bfc4"}
Sep 06 00:50:42.139024 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.138995    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj" event={"ID":"b40fa62c-73cf-4d99-b7a0-8455fc32f187","Type":"ContainerStarted","Data":"e041ec9081a576bdf3d961c54030a9e3d02a96b46fc8f0a83201b43fbabe2ce4"}
Sep 06 00:50:42.142797 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.142767    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf" event={"ID":"b970d1f3-2798-418c-a795-2b6b6d988028","Type":"ContainerStarted","Data":"0e4f1a4c6455583d276d034fcfaa76ad86947ed0776190a6000bb0f10aee78d1"}
Sep 06 00:50:42.142905 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.142853    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf" event={"ID":"b970d1f3-2798-418c-a795-2b6b6d988028","Type":"ContainerStarted","Data":"f9d8cc79bebed42c079d6f6bee4e6d7568596fe1f0782d731002add060e693e5"}
Sep 06 00:50:42.142969 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.142907    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf" event={"ID":"b970d1f3-2798-418c-a795-2b6b6d988028","Type":"ContainerStarted","Data":"2117f08d97e065757a7a0ec6087624ced3a11920b489f05c8b50ce7fc0711eb4"}
Sep 06 00:50:42.143030 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.142970    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf" event={"ID":"b970d1f3-2798-418c-a795-2b6b6d988028","Type":"ContainerStarted","Data":"3cfeb2e076aa29770821b923d83049166438d25b02dc511bd4cfd646e224b640"}
Sep 06 00:50:42.143030 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.143000    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf" event={"ID":"b970d1f3-2798-418c-a795-2b6b6d988028","Type":"ContainerStarted","Data":"2ee2e49a69700edf4af2abc949d1dc6f06048d95ab5798997716103ec8532f86"}
Sep 06 00:50:42.143128 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.143028    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf" event={"ID":"b970d1f3-2798-418c-a795-2b6b6d988028","Type":"ContainerStarted","Data":"dfe9fa3e21e749e8e2a9512bc8f40c1c174abdf83c98a42e45bd25111e6c3fac"}
Sep 06 00:50:42.144411 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.144383    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qzqcf" event={"ID":"cb45d3f6-b91f-430b-b76c-0261720d3daf","Type":"ContainerStarted","Data":"35e1f2a87cc935075958423f85df1db37d71ddc120a50f7cbc81ca938ec55aff"}
Sep 06 00:50:42.145877 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.145847    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x6hc9" event={"ID":"d6e22eb1-677d-48e4-99be-bb0fdfe966ad","Type":"ContainerStarted","Data":"25978baceb239918be71333013f8fa25617b99cd4563a7582f8694c8600edde9"}
Sep 06 00:50:42.149137 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.149107    2548 generic.go:356] "Generic (PLEG): container finished" podID="d5a0b4fa-fb6e-45b7-92b1-db8003e1401a" containerID="01f070d66b6b7d3388b6ac3eb88f6b1d52a5a973b9df0463020a527d2700b213" exitCode=0
Sep 06 00:50:42.149233 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.149150    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5j2m" event={"ID":"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a","Type":"ContainerDied","Data":"01f070d66b6b7d3388b6ac3eb88f6b1d52a5a973b9df0463020a527d2700b213"}
Sep 06 00:50:42.150697 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.150673    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xxtxh" event={"ID":"09bf172c-624e-4812-9f3b-8c05095cedc0","Type":"ContainerStarted","Data":"cbdf8119407259385efb6f58339e00048bc4a61963281cf1d80cd273a09dde57"}
Sep 06 00:50:42.153891 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.153858    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" podStartSLOduration=21.153845847 podStartE2EDuration="21.153845847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:25.10023019 +0000 UTC m=+5.633864523" watchObservedRunningTime="2026-09-06 00:50:42.153845847 +0000 UTC m=+22.687480175"
Sep 06 00:50:42.169826 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.169795    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4ljff" podStartSLOduration=11.600798705999999 podStartE2EDuration="22.169782908s" totalImagesPullingTime="10.568984202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:42.153779339 +0000 UTC m=+22.687413667" watchObservedRunningTime="2026-09-06 00:50:42.169782908 +0000 UTC m=+22.703417235"
Sep 06 00:50:42.191484 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.191432    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xxtxh" podStartSLOduration=4.134811499 podStartE2EDuration="22.191418517s" totalImagesPullingTime="18.056607018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:42.169534897 +0000 UTC m=+22.703169225" watchObservedRunningTime="2026-09-06 00:50:42.191418517 +0000 UTC m=+22.725052846"
Sep 06 00:50:42.222831 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.222788    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qzqcf" podStartSLOduration=4.165507806 podStartE2EDuration="22.22277306s" totalImagesPullingTime="18.057265254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:42.222732871 +0000 UTC m=+22.756367200" watchObservedRunningTime="2026-09-06 00:50:42.22277306 +0000 UTC m=+22.756407389"
Sep 06 00:50:42.241279 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.239132    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q96w7" podStartSLOduration=3.211290848 podStartE2EDuration="21.239110161s" totalImagesPullingTime="18.027819313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:42.23896303 +0000 UTC m=+22.772597358" watchObservedRunningTime="2026-09-06 00:50:42.239110161 +0000 UTC m=+22.772744491"
Sep 06 00:50:42.256792 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.256751    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x6hc9" podStartSLOduration=4.174928581 podStartE2EDuration="22.256740186s" totalImagesPullingTime="18.081811605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:42.256374755 +0000 UTC m=+22.790009084" watchObservedRunningTime="2026-09-06 00:50:42.256740186 +0000 UTC m=+22.790374514"
Sep 06 00:50:42.595137 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.595111    2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 06 00:50:42.957645 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.957544    2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T00:50:42.595132223Z","UUID":"a734f653-a4ec-40f8-96fd-85050ccf7b1a","Handler":null,"Name":"","Endpoint":""}
Sep 06 00:50:42.959354 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.959322    2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 06 00:50:42.959354 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:42.959365    2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 06 00:50:43.154937 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:43.154901    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vf67" event={"ID":"71634091-e5a9-4928-86fd-64aa21a3d44c","Type":"ContainerStarted","Data":"f27e400ccb6fbb39bd327a753348bc539f5eadfb9cf69da8662585a8138c3c01"}
Sep 06 00:50:43.157190 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:43.157157    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj" event={"ID":"b40fa62c-73cf-4d99-b7a0-8455fc32f187","Type":"ContainerStarted","Data":"2d2eb8ff2405cf9cd62465b3fde3252d7620ba85334bbd9c246f0595bc38fa2e"}
Sep 06 00:50:43.170306 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:43.170242    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4vf67" podStartSLOduration=5.145413068 podStartE2EDuration="23.170227109s" totalImagesPullingTime="18.024814041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:43.169286952 +0000 UTC m=+23.702921282" watchObservedRunningTime="2026-09-06 00:50:43.170227109 +0000 UTC m=+23.703861438"
Sep 06 00:50:43.980804 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:43.980565    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:43.980974 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:43.980565    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:43.980974 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:43.980922    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:43.981093 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:43.980565    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:43.981093 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:43.980985    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:43.981199 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:43.981090    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:44.066161 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:44.066130    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:44.161528 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:44.161496    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj" event={"ID":"b40fa62c-73cf-4d99-b7a0-8455fc32f187","Type":"ContainerStarted","Data":"66a6d4cb6e3ccbac58415519358dc1342b45a28233ecf66cb5cc983786306859"}
Sep 06 00:50:44.166001 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:44.165971    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf" event={"ID":"b970d1f3-2798-418c-a795-2b6b6d988028","Type":"ContainerStarted","Data":"801730056f61dbfd950b273215a4468c197c0f54924de73dbd112b7eb0864337"}
Sep 06 00:50:44.183143 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:44.183096    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57nwj" podStartSLOduration=4.01880649 podStartE2EDuration="24.183079659s" totalImagesPullingTime="20.164273169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:44.180943851 +0000 UTC m=+24.714578180" watchObservedRunningTime="2026-09-06 00:50:44.183079659 +0000 UTC m=+24.716713988"
Sep 06 00:50:44.476820 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:44.476790    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:44.477445 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:44.477422    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:45.169542 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:45.169509    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4ljff"
Sep 06 00:50:45.980706 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:45.980670    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:45.980872 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:45.980803    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:45.980872 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:45.980809    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:45.980994 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:45.980929    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:45.981057 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:45.980992    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:45.981107 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:45.981067    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:47.980680 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:47.980468    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:47.981137 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:47.980473    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:47.981137 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:47.980712    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:47.981137 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:47.980468    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:47.981137 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:47.980809    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:47.981137 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:47.980907    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:48.179028 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:48.178993    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf" event={"ID":"b970d1f3-2798-418c-a795-2b6b6d988028","Type":"ContainerStarted","Data":"20d86a0b90254dfd2e90f0adb8b6c114601f07a9ee90484689b13a1f72d7d461"}
Sep 06 00:50:48.179329 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:48.179295    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:48.180857 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:48.180831    2548 generic.go:356] "Generic (PLEG): container finished" podID="d5a0b4fa-fb6e-45b7-92b1-db8003e1401a" containerID="26fb66c8dd81591432e76dcb796701e08fa6fa86639eae75b5321aa286b42eed" exitCode=0
Sep 06 00:50:48.180950 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:48.180863    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5j2m" event={"ID":"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a","Type":"ContainerDied","Data":"26fb66c8dd81591432e76dcb796701e08fa6fa86639eae75b5321aa286b42eed"}
Sep 06 00:50:48.194851 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:48.194833    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:48.205084 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:48.205049    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf" podStartSLOduration=10.109400918 podStartE2EDuration="28.205038117s" totalImagesPullingTime="18.095637199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:48.203594661 +0000 UTC m=+28.737228990" watchObservedRunningTime="2026-09-06 00:50:48.205038117 +0000 UTC m=+28.738672445"
Sep 06 00:50:49.107084 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:49.107055    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgj47"]
Sep 06 00:50:49.107873 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:49.107179    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:49.107873 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:49.107359    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:49.111496 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:49.111470    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fkfvk"]
Sep 06 00:50:49.111731 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:49.111589    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:49.111731 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:49.111594    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2rjrr"]
Sep 06 00:50:49.111731 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:49.111703    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:49.111907 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:49.111783    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:49.111907 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:49.111883    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:49.185297 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:49.185248    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5j2m" event={"ID":"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a","Type":"ContainerStarted","Data":"64a2ae7a7ca7563512e56159a48d67692137a4af912e6476d026c558ccce2797"}
Sep 06 00:50:49.185453 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:49.185424    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:49.185568 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:49.185497    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:49.199616 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:49.199598    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:50:50.189674 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:50.189594    2548 generic.go:356] "Generic (PLEG): container finished" podID="d5a0b4fa-fb6e-45b7-92b1-db8003e1401a" containerID="64a2ae7a7ca7563512e56159a48d67692137a4af912e6476d026c558ccce2797" exitCode=0
Sep 06 00:50:50.190141 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:50.189680    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5j2m" event={"ID":"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a","Type":"ContainerDied","Data":"64a2ae7a7ca7563512e56159a48d67692137a4af912e6476d026c558ccce2797"}
Sep 06 00:50:50.980676 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:50.980519    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:50.980764 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:50.980545    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:50.980812 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:50.980758    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rjrr" podUID="ba72479c-dee0-49b8-b076-5cc94e837a4b"
Sep 06 00:50:50.980850 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:50.980568    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:50.980850 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:50.980820    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkfvk" podUID="efcd94a4-731f-48e2-89d3-b17b6b312647"
Sep 06 00:50:50.980912 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:50.980883    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgj47" podUID="ec16694e-2880-40f9-adca-896b59377e8d"
Sep 06 00:50:51.194383 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:51.194306    2548 generic.go:356] "Generic (PLEG): container finished" podID="d5a0b4fa-fb6e-45b7-92b1-db8003e1401a" containerID="ee8e7e4b0d91e1378991896ae38f7f36e684dbd8e9b34c5f1a22140f6e677c62" exitCode=0
Sep 06 00:50:51.194741 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:51.194385    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5j2m" event={"ID":"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a","Type":"ContainerDied","Data":"ee8e7e4b0d91e1378991896ae38f7f36e684dbd8e9b34c5f1a22140f6e677c62"}
Sep 06 00:50:52.733017 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.732989    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeReady"
Sep 06 00:50:52.733433 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.733120    2548 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 06 00:50:52.766437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.766397    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-864659dbbd-wcx7r"]
Sep 06 00:50:52.772146 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.772129    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:52.775024 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.775004    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 06 00:50:52.775133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.775004    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 06 00:50:52.775133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.775036    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 06 00:50:52.775133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.775036    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tfhmt\""
Sep 06 00:50:52.779783 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.779766    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 06 00:50:52.785636 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.785615    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-66gtb"]
Sep 06 00:50:52.789986 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.789967    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mrjrs"]
Sep 06 00:50:52.790094 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.790077    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:52.792550 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.792530    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 06 00:50:52.792550 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.792546    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 06 00:50:52.792685 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.792537    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sw7jk\""
Sep 06 00:50:52.793296 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.793282    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-864659dbbd-wcx7r"]
Sep 06 00:50:52.793357 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.793344    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mrjrs"
Sep 06 00:50:52.795226 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.795204    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ht4cf\""
Sep 06 00:50:52.795453 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.795436    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 06 00:50:52.795504 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.795440    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 06 00:50:52.795542 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.795513    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 06 00:50:52.800702 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.800678    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mrjrs"]
Sep 06 00:50:52.800811 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.800759    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-66gtb"]
Sep 06 00:50:52.955721 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.955682    2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ljff_9b94681b-36d9-4371-ad05-47c56b6c5c2e/konnectivity-agent/0.log" limit=1024
Sep 06 00:50:52.958546 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958522    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvhbl\" (UniqueName: \"kubernetes.io/projected/cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0-kube-api-access-zvhbl\") pod \"ingress-canary-mrjrs\" (UID: \"cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0\") " pod="openshift-ingress-canary/ingress-canary-mrjrs"
Sep 06 00:50:52.958659 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958563    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/064e339b-b333-4667-9f51-0af255e62f11-ca-trust-extracted\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:52.958659 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958594    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-image-registry-private-configuration\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:52.958659 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958629    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a6f2386-4763-4ee2-ac46-26b654018da3-tmp-dir\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:52.958780 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958729    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-trusted-ca\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:52.958840 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958779    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-bound-sa-token\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:52.958840 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958808    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-installation-pull-secrets\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:52.958840 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958834    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2bd8\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-kube-api-access-c2bd8\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:52.958985 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958863    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0-cert\") pod \"ingress-canary-mrjrs\" (UID: \"cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0\") " pod="openshift-ingress-canary/ingress-canary-mrjrs"
Sep 06 00:50:52.958985 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958888    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:52.958985 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958934    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a6f2386-4763-4ee2-ac46-26b654018da3-config-volume\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:52.958985 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958959    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-registry-certificates\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:52.959134 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.958987    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh9fp\" (UniqueName: \"kubernetes.io/projected/8a6f2386-4763-4ee2-ac46-26b654018da3-kube-api-access-gh9fp\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:52.959134 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.959014    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:52.980827 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.980802    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:52.980827 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.980814    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:52.980961 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.980834    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:52.984281 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.984241    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 00:50:52.984379 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.984318    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 00:50:52.984379 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.984330    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 00:50:52.984525 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.984512    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7ttx4\""
Sep 06 00:50:52.984604 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.984587    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 00:50:52.984644 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:52.984613    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bctds\""
Sep 06 00:50:53.042120 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.042084    2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ljff_9b94681b-36d9-4371-ad05-47c56b6c5c2e/konnectivity-agent/0.log" limit=1024
Sep 06 00:50:53.060050 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060026    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0-cert\") pod \"ingress-canary-mrjrs\" (UID: \"cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0\") " pod="openshift-ingress-canary/ingress-canary-mrjrs"
Sep 06 00:50:53.060198 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060056    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:53.060198 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060096    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a6f2386-4763-4ee2-ac46-26b654018da3-config-volume\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:53.060198 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060121    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-registry-certificates\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.060198 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060148    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9fp\" (UniqueName: \"kubernetes.io/projected/8a6f2386-4763-4ee2-ac46-26b654018da3-kube-api-access-gh9fp\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:53.060198 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060173    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.060198 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.060193    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 00:50:53.060534 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060213    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvhbl\" (UniqueName: \"kubernetes.io/projected/cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0-kube-api-access-zvhbl\") pod \"ingress-canary-mrjrs\" (UID: \"cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0\") " pod="openshift-ingress-canary/ingress-canary-mrjrs"
Sep 06 00:50:53.060534 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.060253    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls podName:8a6f2386-4763-4ee2-ac46-26b654018da3 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:53.560233923 +0000 UTC m=+34.093868237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls") pod "dns-default-66gtb" (UID: "8a6f2386-4763-4ee2-ac46-26b654018da3") : secret "dns-default-metrics-tls" not found
Sep 06 00:50:53.060647 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.060535    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 00:50:53.060647 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.060550    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864659dbbd-wcx7r: secret "image-registry-tls" not found
Sep 06 00:50:53.060647 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060570    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/064e339b-b333-4667-9f51-0af255e62f11-ca-trust-extracted\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.060647 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.060590    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls podName:064e339b-b333-4667-9f51-0af255e62f11 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:53.560575653 +0000 UTC m=+34.094209960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls") pod "image-registry-864659dbbd-wcx7r" (UID: "064e339b-b333-4667-9f51-0af255e62f11") : secret "image-registry-tls" not found
Sep 06 00:50:53.060647 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060623    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-image-registry-private-configuration\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.060887 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060663    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a6f2386-4763-4ee2-ac46-26b654018da3-tmp-dir\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:53.060887 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060685    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-trusted-ca\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.060887 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060748    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-bound-sa-token\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.060887 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060766    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a6f2386-4763-4ee2-ac46-26b654018da3-config-volume\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:53.060887 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060778    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-installation-pull-secrets\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.060887 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060806    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bd8\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-kube-api-access-c2bd8\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.060887 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060858    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-registry-certificates\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.061210 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060899    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/064e339b-b333-4667-9f51-0af255e62f11-ca-trust-extracted\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.061210 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.060951    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a6f2386-4763-4ee2-ac46-26b654018da3-tmp-dir\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:53.061751 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.061730    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-trusted-ca\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.065126 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.065107    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-installation-pull-secrets\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.065126 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.065121    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0-cert\") pod \"ingress-canary-mrjrs\" (UID: \"cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0\") " pod="openshift-ingress-canary/ingress-canary-mrjrs"
Sep 06 00:50:53.065305 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.065136    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-image-registry-private-configuration\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.069789 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.069768    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh9fp\" (UniqueName: \"kubernetes.io/projected/8a6f2386-4763-4ee2-ac46-26b654018da3-kube-api-access-gh9fp\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:53.069904 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.069823    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-bound-sa-token\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.070003 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.069984    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvhbl\" (UniqueName: \"kubernetes.io/projected/cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0-kube-api-access-zvhbl\") pod \"ingress-canary-mrjrs\" (UID: \"cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0\") " pod="openshift-ingress-canary/ingress-canary-mrjrs"
Sep 06 00:50:53.070041 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.069982    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2bd8\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-kube-api-access-c2bd8\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.108284 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.108243    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mrjrs"
Sep 06 00:50:53.435865 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.435817    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mrjrs"]
Sep 06 00:50:53.439912 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:53.439883    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2c520a_fd1b_4c14_a2d3_7a2d31adb7b0.slice/crio-02e2b97c428bef4b56dcf6f59bed99f9d2ff30e8d905fcd563bddd17ec051f23 WatchSource:0}: Error finding container 02e2b97c428bef4b56dcf6f59bed99f9d2ff30e8d905fcd563bddd17ec051f23: Status 404 returned error can't find the container with id 02e2b97c428bef4b56dcf6f59bed99f9d2ff30e8d905fcd563bddd17ec051f23
Sep 06 00:50:53.563698 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.563630    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:53.563840 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.563700    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:53.563840 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.563748    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 00:50:53.563840 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.563802    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls podName:8a6f2386-4763-4ee2-ac46-26b654018da3 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:54.563785259 +0000 UTC m=+35.097419570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls") pod "dns-default-66gtb" (UID: "8a6f2386-4763-4ee2-ac46-26b654018da3") : secret "dns-default-metrics-tls" not found
Sep 06 00:50:53.563840 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.563824    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 00:50:53.563840 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.563837    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864659dbbd-wcx7r: secret "image-registry-tls" not found
Sep 06 00:50:53.564109 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.563895    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls podName:064e339b-b333-4667-9f51-0af255e62f11 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:54.563878694 +0000 UTC m=+35.097513011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls") pod "image-registry-864659dbbd-wcx7r" (UID: "064e339b-b333-4667-9f51-0af255e62f11") : secret "image-registry-tls" not found
Sep 06 00:50:53.664282 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.664234    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:53.667311 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.667294    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/efcd94a4-731f-48e2-89d3-b17b6b312647-original-pull-secret\") pod \"global-pull-secret-syncer-fkfvk\" (UID: \"efcd94a4-731f-48e2-89d3-b17b6b312647\") " pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:53.765684 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.765645    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:50:53.766098 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.765767    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 06 00:50:53.766098 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:53.765849    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs podName:ba72479c-dee0-49b8-b076-5cc94e837a4b nodeName:}" failed. No retries permitted until 2026-09-06 00:51:25.765827629 +0000 UTC m=+66.299461958 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs") pod "network-metrics-daemon-2rjrr" (UID: "ba72479c-dee0-49b8-b076-5cc94e837a4b") : secret "metrics-daemon-secret" not found
Sep 06 00:50:53.866988 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.866914    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzwl\" (UniqueName: \"kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl\") pod \"network-check-target-kgj47\" (UID: \"ec16694e-2880-40f9-adca-896b59377e8d\") " pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:53.869755 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.869732    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnzwl\" (UniqueName: \"kubernetes.io/projected/ec16694e-2880-40f9-adca-896b59377e8d-kube-api-access-qnzwl\") pod \"network-check-target-kgj47\" (UID: \"ec16694e-2880-40f9-adca-896b59377e8d\") " pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:53.895563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.895543    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkfvk"
Sep 06 00:50:53.900733 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:53.900709    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:50:54.200770 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:54.200508    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fkfvk"]
Sep 06 00:50:54.203631 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:54.203595    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mrjrs" event={"ID":"cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0","Type":"ContainerStarted","Data":"02e2b97c428bef4b56dcf6f59bed99f9d2ff30e8d905fcd563bddd17ec051f23"}
Sep 06 00:50:54.204103 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:54.204077    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefcd94a4_731f_48e2_89d3_b17b6b312647.slice/crio-a228af55d2007a0afe8202a7e37017a33a011037f0ad9cb719ebc0b06d431bb7 WatchSource:0}: Error finding container a228af55d2007a0afe8202a7e37017a33a011037f0ad9cb719ebc0b06d431bb7: Status 404 returned error can't find the container with id a228af55d2007a0afe8202a7e37017a33a011037f0ad9cb719ebc0b06d431bb7
Sep 06 00:50:54.229837 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:54.229812    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgj47"]
Sep 06 00:50:54.233446 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:50:54.233419    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec16694e_2880_40f9_adca_896b59377e8d.slice/crio-72d5918e1f48f1003f374864292346ab109cdff1dd4333064f6383f98e2572e0 WatchSource:0}: Error finding container 72d5918e1f48f1003f374864292346ab109cdff1dd4333064f6383f98e2572e0: Status 404 returned error can't find the container with id 72d5918e1f48f1003f374864292346ab109cdff1dd4333064f6383f98e2572e0
Sep 06 00:50:54.573489 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:54.573453    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:54.573699 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:54.573537    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:54.573699 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:54.573612    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 00:50:54.573699 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:54.573632    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864659dbbd-wcx7r: secret "image-registry-tls" not found
Sep 06 00:50:54.573699 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:54.573669    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 00:50:54.573699 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:54.573692    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls podName:064e339b-b333-4667-9f51-0af255e62f11 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:56.573671429 +0000 UTC m=+37.107305753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls") pod "image-registry-864659dbbd-wcx7r" (UID: "064e339b-b333-4667-9f51-0af255e62f11") : secret "image-registry-tls" not found
Sep 06 00:50:54.573955 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:54.573719    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls podName:8a6f2386-4763-4ee2-ac46-26b654018da3 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:56.57370193 +0000 UTC m=+37.107336252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls") pod "dns-default-66gtb" (UID: "8a6f2386-4763-4ee2-ac46-26b654018da3") : secret "dns-default-metrics-tls" not found
Sep 06 00:50:55.208457 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:55.208389    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fkfvk" event={"ID":"efcd94a4-731f-48e2-89d3-b17b6b312647","Type":"ContainerStarted","Data":"a228af55d2007a0afe8202a7e37017a33a011037f0ad9cb719ebc0b06d431bb7"}
Sep 06 00:50:55.209908 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:55.209854    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgj47" event={"ID":"ec16694e-2880-40f9-adca-896b59377e8d","Type":"ContainerStarted","Data":"72d5918e1f48f1003f374864292346ab109cdff1dd4333064f6383f98e2572e0"}
Sep 06 00:50:56.590449 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:56.590410    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:50:56.591097 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:56.590493    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:50:56.591097 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:56.590587    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 00:50:56.591097 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:56.590612    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864659dbbd-wcx7r: secret "image-registry-tls" not found
Sep 06 00:50:56.591097 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:56.590628    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 00:50:56.591097 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:56.590678    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls podName:064e339b-b333-4667-9f51-0af255e62f11 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:00.590655298 +0000 UTC m=+41.124289620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls") pod "image-registry-864659dbbd-wcx7r" (UID: "064e339b-b333-4667-9f51-0af255e62f11") : secret "image-registry-tls" not found
Sep 06 00:50:56.591097 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:56.590697    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls podName:8a6f2386-4763-4ee2-ac46-26b654018da3 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:00.590687423 +0000 UTC m=+41.124321735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls") pod "dns-default-66gtb" (UID: "8a6f2386-4763-4ee2-ac46-26b654018da3") : secret "dns-default-metrics-tls" not found
Sep 06 00:50:58.560552 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.560492    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"]
Sep 06 00:50:58.605092 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.605055    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"]
Sep 06 00:50:58.605247 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.605183    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:50:58.607900 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.607872    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 06 00:50:58.607900 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.607873    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 06 00:50:58.608079 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.608015    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-t5l9t\""
Sep 06 00:50:58.608332 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.608316    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 06 00:50:58.620846 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.620819    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-tn5q6"]
Sep 06 00:50:58.620980 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.620956    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:50:58.623544 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.623525    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 06 00:50:58.623656 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.623525    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 06 00:50:58.624812 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.624790    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 06 00:50:58.624812 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.624806    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8b7v7\""
Sep 06 00:50:58.624953 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.624828    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 06 00:50:58.640911 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.640876    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-kr428"]
Sep 06 00:50:58.641031 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.640995    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-tn5q6"
Sep 06 00:50:58.644004 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.643854    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 06 00:50:58.644004 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.643862    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 06 00:50:58.644004 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.643889    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6spfg\""
Sep 06 00:50:58.659010 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.658963    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"]
Sep 06 00:50:58.659010 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.659006    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-tn5q6"]
Sep 06 00:50:58.659190 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.659027    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"]
Sep 06 00:50:58.659190 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.659043    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-kr428"]
Sep 06 00:50:58.659190 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.659067    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"]
Sep 06 00:50:58.659425 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.659381    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.662255 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.662234    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 06 00:50:58.662381 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.662311    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 06 00:50:58.662486 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.662469    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 06 00:50:58.662552 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.662527    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qcqsc\""
Sep 06 00:50:58.662741 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.662713    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 06 00:50:58.668305 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.668255    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 06 00:50:58.681163 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.681139    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-pzkqj"]
Sep 06 00:50:58.681311 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.681285    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"
Sep 06 00:50:58.683736 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.683700    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 06 00:50:58.684569 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.684338    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 06 00:50:58.684569 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.684353    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 06 00:50:58.684569 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.684450    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dmcfj\""
Sep 06 00:50:58.684796 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.684633    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 06 00:50:58.705236 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.705210    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b797f8856-mpddc"]
Sep 06 00:50:58.705390 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.705338    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.706991 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.706965    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b30512c8-a402-4e9f-916d-77c29036c8ed-tmp\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.707101 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707005    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b30512c8-a402-4e9f-916d-77c29036c8ed-snapshots\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.707101 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707035    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:50:58.707101 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707068    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9qc8\" (UniqueName: \"kubernetes.io/projected/b7651597-3577-4f93-84cc-4b068adf9280-kube-api-access-b9qc8\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:50:58.707242 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707138    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12870d88-2f67-4834-9643-71e9e8547131-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-sktdk\" (UID: \"12870d88-2f67-4834-9643-71e9e8547131\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"
Sep 06 00:50:58.707242 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707173    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b30512c8-a402-4e9f-916d-77c29036c8ed-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.707339 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707222    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12870d88-2f67-4834-9643-71e9e8547131-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-sktdk\" (UID: \"12870d88-2f67-4834-9643-71e9e8547131\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"
Sep 06 00:50:58.707339 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707297    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2lsh\" (UniqueName: \"kubernetes.io/projected/903f27c0-a3ab-4274-b755-74f99d165cc6-kube-api-access-q2lsh\") pod \"volume-data-source-validator-695c895bd6-tn5q6\" (UID: \"903f27c0-a3ab-4274-b755-74f99d165cc6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-tn5q6"
Sep 06 00:50:58.707339 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707320    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b30512c8-a402-4e9f-916d-77c29036c8ed-serving-cert\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.707504 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707387    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7651597-3577-4f93-84cc-4b068adf9280-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:50:58.707504 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707454    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f94dc\" (UniqueName: \"kubernetes.io/projected/b30512c8-a402-4e9f-916d-77c29036c8ed-kube-api-access-f94dc\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.707606 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707519    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5n2t\" (UniqueName: \"kubernetes.io/projected/50a02fa9-2278-4d70-8954-c0bc97660f6b-kube-api-access-j5n2t\") pod \"cluster-samples-operator-7cdcfcf76c-fmhrk\" (UID: \"50a02fa9-2278-4d70-8954-c0bc97660f6b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:50:58.707648 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707616    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fmhrk\" (UID: \"50a02fa9-2278-4d70-8954-c0bc97660f6b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:50:58.707706 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707656    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b30512c8-a402-4e9f-916d-77c29036c8ed-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.707706 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.707689    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkr7t\" (UniqueName: \"kubernetes.io/projected/12870d88-2f67-4834-9643-71e9e8547131-kube-api-access-mkr7t\") pod \"kube-storage-version-migrator-operator-8d7dd4675-sktdk\" (UID: \"12870d88-2f67-4834-9643-71e9e8547131\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"
Sep 06 00:50:58.708382 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.708088    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 06 00:50:58.708382 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.708109    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 06 00:50:58.708382 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.708136    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pqk2h\""
Sep 06 00:50:58.708382 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.708138    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 06 00:50:58.708382 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.708321    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 06 00:50:58.722278 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.722245    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 06 00:50:58.728921 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.728895    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-bpjjc"]
Sep 06 00:50:58.729042 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.729023    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.731657 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.731583    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 06 00:50:58.731841 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.731825    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 06 00:50:58.731927 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.731828    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 06 00:50:58.731927 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.731829    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 06 00:50:58.732126 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.732109    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 06 00:50:58.732192 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.732162    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-w44sc\""
Sep 06 00:50:58.732253 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.732221    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 06 00:50:58.751095 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.751064    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"]
Sep 06 00:50:58.751095 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.751102    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-bpjjc"]
Sep 06 00:50:58.751243 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.751132    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b797f8856-mpddc"]
Sep 06 00:50:58.751243 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.751149    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-pzkqj"]
Sep 06 00:50:58.751243 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.751172    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-fgnd2"]
Sep 06 00:50:58.751243 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.751203    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-bpjjc"
Sep 06 00:50:58.754992 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.754525    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-khrpd\""
Sep 06 00:50:58.767014 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.766994    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"]
Sep 06 00:50:58.767200 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.767127    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:50:58.769909 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.769887    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 06 00:50:58.770480 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.770462    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 06 00:50:58.770640 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.770562    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xkmpn\""
Sep 06 00:50:58.783236 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.783214    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-fgnd2"]
Sep 06 00:50:58.783393 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.783248    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"]
Sep 06 00:50:58.783393 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.783359    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"
Sep 06 00:50:58.788587 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.788564    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 06 00:50:58.788587 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.788577    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 06 00:50:58.788587 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.788587    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bmhdh\""
Sep 06 00:50:58.788902 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.788885    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 06 00:50:58.789007 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.788946    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 06 00:50:58.808012 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.807982    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12870d88-2f67-4834-9643-71e9e8547131-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-sktdk\" (UID: \"12870d88-2f67-4834-9643-71e9e8547131\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"
Sep 06 00:50:58.808185 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808019    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b30512c8-a402-4e9f-916d-77c29036c8ed-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.808185 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808042    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.808344 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808216    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db48g\" (UniqueName: \"kubernetes.io/projected/487de660-0766-4387-9351-63c22a95dd79-kube-api-access-db48g\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.808344 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808283    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12870d88-2f67-4834-9643-71e9e8547131-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-sktdk\" (UID: \"12870d88-2f67-4834-9643-71e9e8547131\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"
Sep 06 00:50:58.808344 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808319    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkx87\" (UniqueName: \"kubernetes.io/projected/656b3a0c-497e-420e-833f-c21acd4e9c80-kube-api-access-pkx87\") pod \"network-check-source-685456655f-bpjjc\" (UID: \"656b3a0c-497e-420e-833f-c21acd4e9c80\") " pod="openshift-network-diagnostics/network-check-source-685456655f-bpjjc"
Sep 06 00:50:58.808462 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808397    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2lsh\" (UniqueName: \"kubernetes.io/projected/903f27c0-a3ab-4274-b755-74f99d165cc6-kube-api-access-q2lsh\") pod \"volume-data-source-validator-695c895bd6-tn5q6\" (UID: \"903f27c0-a3ab-4274-b755-74f99d165cc6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-tn5q6"
Sep 06 00:50:58.808574 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808551    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b30512c8-a402-4e9f-916d-77c29036c8ed-serving-cert\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.808642 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808603    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7651597-3577-4f93-84cc-4b068adf9280-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:50:58.808699 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808642    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/487de660-0766-4387-9351-63c22a95dd79-config\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.808896 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808826    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12870d88-2f67-4834-9643-71e9e8547131-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-sktdk\" (UID: \"12870d88-2f67-4834-9643-71e9e8547131\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"
Sep 06 00:50:58.808896 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808881    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-stats-auth\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.809027 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808911    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f94dc\" (UniqueName: \"kubernetes.io/projected/b30512c8-a402-4e9f-916d-77c29036c8ed-kube-api-access-f94dc\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.809027 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808937    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6527\" (UniqueName: \"kubernetes.io/projected/5b23b0e5-3a15-48a5-843d-e837a905a68b-kube-api-access-h6527\") pod \"service-ca-operator-859f94c4b-6q674\" (UID: \"5b23b0e5-3a15-48a5-843d-e837a905a68b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"
Sep 06 00:50:58.809027 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808968    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5n2t\" (UniqueName: \"kubernetes.io/projected/50a02fa9-2278-4d70-8954-c0bc97660f6b-kube-api-access-j5n2t\") pod \"cluster-samples-operator-7cdcfcf76c-fmhrk\" (UID: \"50a02fa9-2278-4d70-8954-c0bc97660f6b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:50:58.809027 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808981    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b30512c8-a402-4e9f-916d-77c29036c8ed-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.809027 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.808996    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/487de660-0766-4387-9351-63c22a95dd79-trusted-ca\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.809027 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809020    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz467\" (UniqueName: \"kubernetes.io/projected/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-kube-api-access-bz467\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.809296 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809081    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fmhrk\" (UID: \"50a02fa9-2278-4d70-8954-c0bc97660f6b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:50:58.809296 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809163    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b23b0e5-3a15-48a5-843d-e837a905a68b-config\") pod \"service-ca-operator-859f94c4b-6q674\" (UID: \"5b23b0e5-3a15-48a5-843d-e837a905a68b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"
Sep 06 00:50:58.809296 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809192    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.809296 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:58.809212    2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 00:50:58.809296 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809228    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b30512c8-a402-4e9f-916d-77c29036c8ed-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.809296 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809285    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:50:58.809296 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:58.809292    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls podName:50a02fa9-2278-4d70-8954-c0bc97660f6b nodeName:}" failed. No retries permitted until 2026-09-06 00:50:59.309260147 +0000 UTC m=+39.842894472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-fmhrk" (UID: "50a02fa9-2278-4d70-8954-c0bc97660f6b") : secret "samples-operator-tls" not found
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809328    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkr7t\" (UniqueName: \"kubernetes.io/projected/12870d88-2f67-4834-9643-71e9e8547131-kube-api-access-mkr7t\") pod \"kube-storage-version-migrator-operator-8d7dd4675-sktdk\" (UID: \"12870d88-2f67-4834-9643-71e9e8547131\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809351    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-default-certificate\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809378    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-nginx-conf\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809408    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b30512c8-a402-4e9f-916d-77c29036c8ed-tmp\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809438    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b30512c8-a402-4e9f-916d-77c29036c8ed-snapshots\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809461    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7651597-3577-4f93-84cc-4b068adf9280-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809465    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:58.809530    2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809531    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b23b0e5-3a15-48a5-843d-e837a905a68b-serving-cert\") pod \"service-ca-operator-859f94c4b-6q674\" (UID: \"5b23b0e5-3a15-48a5-843d-e837a905a68b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809557    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/487de660-0766-4387-9351-63c22a95dd79-serving-cert\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:58.809582    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls podName:b7651597-3577-4f93-84cc-4b068adf9280 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:59.309568197 +0000 UTC m=+39.843202506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vfxgd" (UID: "b7651597-3577-4f93-84cc-4b068adf9280") : secret "cluster-monitoring-operator-tls" not found
Sep 06 00:50:58.809667 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809626    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9qc8\" (UniqueName: \"kubernetes.io/projected/b7651597-3577-4f93-84cc-4b068adf9280-kube-api-access-b9qc8\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:50:58.810304 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809731    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b30512c8-a402-4e9f-916d-77c29036c8ed-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.810304 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809944    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b30512c8-a402-4e9f-916d-77c29036c8ed-tmp\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.810304 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.809977    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b30512c8-a402-4e9f-916d-77c29036c8ed-snapshots\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.811472 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.811417    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b30512c8-a402-4e9f-916d-77c29036c8ed-serving-cert\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.811580 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.811465    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12870d88-2f67-4834-9643-71e9e8547131-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-sktdk\" (UID: \"12870d88-2f67-4834-9643-71e9e8547131\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"
Sep 06 00:50:58.820597 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.820569    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f94dc\" (UniqueName: \"kubernetes.io/projected/b30512c8-a402-4e9f-916d-77c29036c8ed-kube-api-access-f94dc\") pod \"insights-operator-76bcd6ccf5-kr428\" (UID: \"b30512c8-a402-4e9f-916d-77c29036c8ed\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.821253 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.820885    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkr7t\" (UniqueName: \"kubernetes.io/projected/12870d88-2f67-4834-9643-71e9e8547131-kube-api-access-mkr7t\") pod \"kube-storage-version-migrator-operator-8d7dd4675-sktdk\" (UID: \"12870d88-2f67-4834-9643-71e9e8547131\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"
Sep 06 00:50:58.821253 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.820883    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9qc8\" (UniqueName: \"kubernetes.io/projected/b7651597-3577-4f93-84cc-4b068adf9280-kube-api-access-b9qc8\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:50:58.821430 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.821305    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5n2t\" (UniqueName: \"kubernetes.io/projected/50a02fa9-2278-4d70-8954-c0bc97660f6b-kube-api-access-j5n2t\") pod \"cluster-samples-operator-7cdcfcf76c-fmhrk\" (UID: \"50a02fa9-2278-4d70-8954-c0bc97660f6b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:50:58.821497 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.821479    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2lsh\" (UniqueName: \"kubernetes.io/projected/903f27c0-a3ab-4274-b755-74f99d165cc6-kube-api-access-q2lsh\") pod \"volume-data-source-validator-695c895bd6-tn5q6\" (UID: \"903f27c0-a3ab-4274-b755-74f99d165cc6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-tn5q6"
Sep 06 00:50:58.880464 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.880338    2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ljff_9b94681b-36d9-4371-ad05-47c56b6c5c2e/konnectivity-agent/0.log" limit=1024
Sep 06 00:50:58.910372 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910333    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.910563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910381    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db48g\" (UniqueName: \"kubernetes.io/projected/487de660-0766-4387-9351-63c22a95dd79-kube-api-access-db48g\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.910563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910420    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkx87\" (UniqueName: \"kubernetes.io/projected/656b3a0c-497e-420e-833f-c21acd4e9c80-kube-api-access-pkx87\") pod \"network-check-source-685456655f-bpjjc\" (UID: \"656b3a0c-497e-420e-833f-c21acd4e9c80\") " pod="openshift-network-diagnostics/network-check-source-685456655f-bpjjc"
Sep 06 00:50:58.910563 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910471    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/487de660-0766-4387-9351-63c22a95dd79-config\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.910563 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:58.910495    2548 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 00:50:58.910563 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:58.910559    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:59.41054007 +0000 UTC m=+39.944174396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : secret "router-metrics-certs-default" not found
Sep 06 00:50:58.910789 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910494    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-stats-auth\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.910789 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910601    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6527\" (UniqueName: \"kubernetes.io/projected/5b23b0e5-3a15-48a5-843d-e837a905a68b-kube-api-access-h6527\") pod \"service-ca-operator-859f94c4b-6q674\" (UID: \"5b23b0e5-3a15-48a5-843d-e837a905a68b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"
Sep 06 00:50:58.910789 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910631    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/487de660-0766-4387-9351-63c22a95dd79-trusted-ca\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.910789 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910653    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz467\" (UniqueName: \"kubernetes.io/projected/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-kube-api-access-bz467\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.910789 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910726    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b23b0e5-3a15-48a5-843d-e837a905a68b-config\") pod \"service-ca-operator-859f94c4b-6q674\" (UID: \"5b23b0e5-3a15-48a5-843d-e837a905a68b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"
Sep 06 00:50:58.910789 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910766    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.910789 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910792    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:50:58.911126 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910814    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-default-certificate\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.911126 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910838    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-nginx-conf\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:50:58.911126 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910895    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b23b0e5-3a15-48a5-843d-e837a905a68b-serving-cert\") pod \"service-ca-operator-859f94c4b-6q674\" (UID: \"5b23b0e5-3a15-48a5-843d-e837a905a68b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"
Sep 06 00:50:58.911126 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.910920    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/487de660-0766-4387-9351-63c22a95dd79-serving-cert\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.911126 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:58.910964    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:59.410945637 +0000 UTC m=+39.944579969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : configmap references non-existent config key: service-ca.crt
Sep 06 00:50:58.911465 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.911317    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/487de660-0766-4387-9351-63c22a95dd79-config\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.911465 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.911317    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b23b0e5-3a15-48a5-843d-e837a905a68b-config\") pod \"service-ca-operator-859f94c4b-6q674\" (UID: \"5b23b0e5-3a15-48a5-843d-e837a905a68b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"
Sep 06 00:50:58.911465 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:58.911418    2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 00:50:58.911465 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:58.911466    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert podName:d6eae2e5-a786-45da-9bf9-03f98e4c7e9d nodeName:}" failed. No retries permitted until 2026-09-06 00:50:59.411449384 +0000 UTC m=+39.945083697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fgnd2" (UID: "d6eae2e5-a786-45da-9bf9-03f98e4c7e9d") : secret "networking-console-plugin-cert" not found
Sep 06 00:50:58.911766 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.911720    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/487de660-0766-4387-9351-63c22a95dd79-trusted-ca\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.911766 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.911749    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-nginx-conf\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:50:58.913529 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.913487    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-stats-auth\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.913721 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.913702    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b23b0e5-3a15-48a5-843d-e837a905a68b-serving-cert\") pod \"service-ca-operator-859f94c4b-6q674\" (UID: \"5b23b0e5-3a15-48a5-843d-e837a905a68b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"
Sep 06 00:50:58.913841 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.913816    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-default-certificate\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.914353 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.914335    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/487de660-0766-4387-9351-63c22a95dd79-serving-cert\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.920412 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.920390    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6527\" (UniqueName: \"kubernetes.io/projected/5b23b0e5-3a15-48a5-843d-e837a905a68b-kube-api-access-h6527\") pod \"service-ca-operator-859f94c4b-6q674\" (UID: \"5b23b0e5-3a15-48a5-843d-e837a905a68b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"
Sep 06 00:50:58.920830 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.920808    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz467\" (UniqueName: \"kubernetes.io/projected/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-kube-api-access-bz467\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:58.920920 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.920838    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkx87\" (UniqueName: \"kubernetes.io/projected/656b3a0c-497e-420e-833f-c21acd4e9c80-kube-api-access-pkx87\") pod \"network-check-source-685456655f-bpjjc\" (UID: \"656b3a0c-497e-420e-833f-c21acd4e9c80\") " pod="openshift-network-diagnostics/network-check-source-685456655f-bpjjc"
Sep 06 00:50:58.921629 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.921591    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db48g\" (UniqueName: \"kubernetes.io/projected/487de660-0766-4387-9351-63c22a95dd79-kube-api-access-db48g\") pod \"console-operator-85b454874b-pzkqj\" (UID: \"487de660-0766-4387-9351-63c22a95dd79\") " pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:58.954243 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.954204    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-tn5q6"
Sep 06 00:50:58.969499 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.969469    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-kr428"
Sep 06 00:50:58.980409 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.980386    2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ljff_9b94681b-36d9-4371-ad05-47c56b6c5c2e/konnectivity-agent/0.log" limit=1024
Sep 06 00:50:58.992024 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:58.992008    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"
Sep 06 00:50:59.016705 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.016684    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:50:59.064852 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.064797    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-bpjjc"
Sep 06 00:50:59.081324 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.081296    2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ljff_9b94681b-36d9-4371-ad05-47c56b6c5c2e/konnectivity-agent/0.log" limit=1024
Sep 06 00:50:59.093201 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.093179    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"
Sep 06 00:50:59.182705 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.182669    2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ljff_9b94681b-36d9-4371-ad05-47c56b6c5c2e/konnectivity-agent/0.log" limit=1024
Sep 06 00:50:59.299250 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.299170    2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ljff_9b94681b-36d9-4371-ad05-47c56b6c5c2e/konnectivity-agent/0.log" limit=1024
Sep 06 00:50:59.314108 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.314078    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:50:59.314254 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.314201    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fmhrk\" (UID: \"50a02fa9-2278-4d70-8954-c0bc97660f6b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:50:59.314254 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:59.314243    2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 00:50:59.314387 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:59.314331    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls podName:b7651597-3577-4f93-84cc-4b068adf9280 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:00.314312213 +0000 UTC m=+40.847946523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vfxgd" (UID: "b7651597-3577-4f93-84cc-4b068adf9280") : secret "cluster-monitoring-operator-tls" not found
Sep 06 00:50:59.314387 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:59.314368    2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 00:50:59.314495 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:59.314439    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls podName:50a02fa9-2278-4d70-8954-c0bc97660f6b nodeName:}" failed. No retries permitted until 2026-09-06 00:51:00.314420079 +0000 UTC m=+40.848054386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-fmhrk" (UID: "50a02fa9-2278-4d70-8954-c0bc97660f6b") : secret "samples-operator-tls" not found
Sep 06 00:50:59.401057 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.400971    2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ljff_9b94681b-36d9-4371-ad05-47c56b6c5c2e/konnectivity-agent/0.log" limit=1024
Sep 06 00:50:59.414985 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.414957    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:59.415152 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.415070    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:50:59.415152 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:50:59.415109    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:50:59.415297 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:59.415174    2548 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 00:50:59.415297 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:59.415234    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:00.415218658 +0000 UTC m=+40.948852968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : secret "router-metrics-certs-default" not found
Sep 06 00:50:59.415297 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:59.415254    2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 00:50:59.415465 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:59.415328    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert podName:d6eae2e5-a786-45da-9bf9-03f98e4c7e9d nodeName:}" failed. No retries permitted until 2026-09-06 00:51:00.415308817 +0000 UTC m=+40.948943138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fgnd2" (UID: "d6eae2e5-a786-45da-9bf9-03f98e4c7e9d") : secret "networking-console-plugin-cert" not found
Sep 06 00:50:59.415465 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:50:59.415408    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:00.415396618 +0000 UTC m=+40.949030939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : configmap references non-existent config key: service-ca.crt
Sep 06 00:51:00.171581 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:00.171484    2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ljff_9b94681b-36d9-4371-ad05-47c56b6c5c2e/konnectivity-agent/0.log" limit=1024
Sep 06 00:51:00.279882 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:00.279845    2548 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ljff_9b94681b-36d9-4371-ad05-47c56b6c5c2e/konnectivity-agent/0.log" limit=1024
Sep 06 00:51:00.324437 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:00.324403    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fmhrk\" (UID: \"50a02fa9-2278-4d70-8954-c0bc97660f6b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:51:00.324635 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:00.324494    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:51:00.324635 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.324572    2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 00:51:00.324635 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.324629    2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 00:51:00.324799 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.324647    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls podName:50a02fa9-2278-4d70-8954-c0bc97660f6b nodeName:}" failed. No retries permitted until 2026-09-06 00:51:02.32462385 +0000 UTC m=+42.858258176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-fmhrk" (UID: "50a02fa9-2278-4d70-8954-c0bc97660f6b") : secret "samples-operator-tls" not found
Sep 06 00:51:00.324799 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.324671    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls podName:b7651597-3577-4f93-84cc-4b068adf9280 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:02.324659996 +0000 UTC m=+42.858294307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vfxgd" (UID: "b7651597-3577-4f93-84cc-4b068adf9280") : secret "cluster-monitoring-operator-tls" not found
Sep 06 00:51:00.425677 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:00.425598    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:00.425677 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:00.425648    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:51:00.425932 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:00.425734    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:00.425932 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.425781    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:02.42575841 +0000 UTC m=+42.959392738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : configmap references non-existent config key: service-ca.crt
Sep 06 00:51:00.425932 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.425830    2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 00:51:00.425932 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.425884    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert podName:d6eae2e5-a786-45da-9bf9-03f98e4c7e9d nodeName:}" failed. No retries permitted until 2026-09-06 00:51:02.42586878 +0000 UTC m=+42.959503105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fgnd2" (UID: "d6eae2e5-a786-45da-9bf9-03f98e4c7e9d") : secret "networking-console-plugin-cert" not found
Sep 06 00:51:00.425932 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.425830    2548 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 00:51:00.425932 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.425926    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:02.425916321 +0000 UTC m=+42.959550627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : secret "router-metrics-certs-default" not found
Sep 06 00:51:00.628294 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:00.628241    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:51:00.628531 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:00.628315    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:51:00.628531 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.628405    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 00:51:00.628531 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.628441    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 00:51:00.628531 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.628452    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864659dbbd-wcx7r: secret "image-registry-tls" not found
Sep 06 00:51:00.628531 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.628473    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls podName:8a6f2386-4763-4ee2-ac46-26b654018da3 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:08.628456002 +0000 UTC m=+49.162090311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls") pod "dns-default-66gtb" (UID: "8a6f2386-4763-4ee2-ac46-26b654018da3") : secret "dns-default-metrics-tls" not found
Sep 06 00:51:00.628531 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:00.628487    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls podName:064e339b-b333-4667-9f51-0af255e62f11 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:08.628481706 +0000 UTC m=+49.162116011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls") pod "image-registry-864659dbbd-wcx7r" (UID: "064e339b-b333-4667-9f51-0af255e62f11") : secret "image-registry-tls" not found
Sep 06 00:51:01.359502 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:01.359424    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-tn5q6"]
Sep 06 00:51:01.366871 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:01.366821    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674"]
Sep 06 00:51:01.371171 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:01.371084    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-bpjjc"]
Sep 06 00:51:01.376538 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:01.376511    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-pzkqj"]
Sep 06 00:51:01.421416 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:01.421387    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk"]
Sep 06 00:51:01.424004 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:01.423976    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-kr428"]
Sep 06 00:51:01.444500 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:01.444465    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12870d88_2f67_4834_9643_71e9e8547131.slice/crio-2e1225338ac6d20fb8ac33a4f3fb588ba087c54200f28ca847f6a709b9a3a8dc WatchSource:0}: Error finding container 2e1225338ac6d20fb8ac33a4f3fb588ba087c54200f28ca847f6a709b9a3a8dc: Status 404 returned error can't find the container with id 2e1225338ac6d20fb8ac33a4f3fb588ba087c54200f28ca847f6a709b9a3a8dc
Sep 06 00:51:01.444791 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:01.444768    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903f27c0_a3ab_4274_b755_74f99d165cc6.slice/crio-53da003519ce3fbd8da7a1fb3fe7ca6d5dfe893dbef05de502db92dbd93adb49 WatchSource:0}: Error finding container 53da003519ce3fbd8da7a1fb3fe7ca6d5dfe893dbef05de502db92dbd93adb49: Status 404 returned error can't find the container with id 53da003519ce3fbd8da7a1fb3fe7ca6d5dfe893dbef05de502db92dbd93adb49
Sep 06 00:51:01.445043 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:01.445024    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod656b3a0c_497e_420e_833f_c21acd4e9c80.slice/crio-98f62308802366bb91b41e8bfc36bdeeafb265439adb4a8bd85694b7cfaddad8 WatchSource:0}: Error finding container 98f62308802366bb91b41e8bfc36bdeeafb265439adb4a8bd85694b7cfaddad8: Status 404 returned error can't find the container with id 98f62308802366bb91b41e8bfc36bdeeafb265439adb4a8bd85694b7cfaddad8
Sep 06 00:51:02.234314 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.234212    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-tn5q6" event={"ID":"903f27c0-a3ab-4274-b755-74f99d165cc6","Type":"ContainerStarted","Data":"53da003519ce3fbd8da7a1fb3fe7ca6d5dfe893dbef05de502db92dbd93adb49"}
Sep 06 00:51:02.239205 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.239137    2548 generic.go:356] "Generic (PLEG): container finished" podID="d5a0b4fa-fb6e-45b7-92b1-db8003e1401a" containerID="ee393fe53c5fe40bdcaeff00395c23f8b77861636dbc65b2814f1424de18f57f" exitCode=0
Sep 06 00:51:02.239430 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.239220    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5j2m" event={"ID":"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a","Type":"ContainerDied","Data":"ee393fe53c5fe40bdcaeff00395c23f8b77861636dbc65b2814f1424de18f57f"}
Sep 06 00:51:02.242273 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.242237    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-bpjjc" event={"ID":"656b3a0c-497e-420e-833f-c21acd4e9c80","Type":"ContainerStarted","Data":"b48437bf271d78b7b5e8e91783e9785da8389f8cffa24e9ae7eba0d7dde0e4b3"}
Sep 06 00:51:02.242380 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.242298    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-bpjjc" event={"ID":"656b3a0c-497e-420e-833f-c21acd4e9c80","Type":"ContainerStarted","Data":"98f62308802366bb91b41e8bfc36bdeeafb265439adb4a8bd85694b7cfaddad8"}
Sep 06 00:51:02.245661 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.245603    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mrjrs" event={"ID":"cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0","Type":"ContainerStarted","Data":"614a842b8fbd46b7a9dc4592658af711c5389c18a795165681afc30a9bffdd39"}
Sep 06 00:51:02.249930 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.249867    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fkfvk" event={"ID":"efcd94a4-731f-48e2-89d3-b17b6b312647","Type":"ContainerStarted","Data":"239201f1b3f98993b25f3bf9b7603c4ba4ea9f3a7cb4d69d2c13e22b9d121c67"}
Sep 06 00:51:02.251760 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.251686    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" event={"ID":"487de660-0766-4387-9351-63c22a95dd79","Type":"ContainerStarted","Data":"47fc312d9235b764395c96622772a46947d1dbd31f479936570c1991e61542e8"}
Sep 06 00:51:02.253491 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.253432    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kr428" event={"ID":"b30512c8-a402-4e9f-916d-77c29036c8ed","Type":"ContainerStarted","Data":"6b09b3a86daef68d62e779fcdb8fabd9a160b8eff0e544042d119b658e59bb81"}
Sep 06 00:51:02.254850 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.254793    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674" event={"ID":"5b23b0e5-3a15-48a5-843d-e837a905a68b","Type":"ContainerStarted","Data":"4f35b179bc0ecf2311367fae94b67afdea5d3a5c2deb41ee30c6127963cbc2fc"}
Sep 06 00:51:02.257515 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.257451    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgj47" event={"ID":"ec16694e-2880-40f9-adca-896b59377e8d","Type":"ContainerStarted","Data":"fa1b80161f0447c3899fd7d88cf0d1303947d593609b6b07024b29dc1233102f"}
Sep 06 00:51:02.259897 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.259849    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk" event={"ID":"12870d88-2f67-4834-9643-71e9e8547131","Type":"ContainerStarted","Data":"2e1225338ac6d20fb8ac33a4f3fb588ba087c54200f28ca847f6a709b9a3a8dc"}
Sep 06 00:51:02.266491 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.266285    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:51:02.280290 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.278931    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mrjrs" podStartSLOduration=2.652494723 podStartE2EDuration="10.278913319s" totalImagesPullingTime="7.626418596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:02.276893423 +0000 UTC m=+42.810527751" watchObservedRunningTime="2026-09-06 00:51:02.278913319 +0000 UTC m=+42.812547648"
Sep 06 00:51:02.323493 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.322759    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-bpjjc" podStartSLOduration=4.322738448 podStartE2EDuration="4.322738448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:02.302014006 +0000 UTC m=+42.835648333" watchObservedRunningTime="2026-09-06 00:51:02.322738448 +0000 UTC m=+42.856372777"
Sep 06 00:51:02.344131 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.343203    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fmhrk\" (UID: \"50a02fa9-2278-4d70-8954-c0bc97660f6b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:51:02.344131 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:02.343444    2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 00:51:02.344131 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:02.343513    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls podName:50a02fa9-2278-4d70-8954-c0bc97660f6b nodeName:}" failed. No retries permitted until 2026-09-06 00:51:06.343493855 +0000 UTC m=+46.877128173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-fmhrk" (UID: "50a02fa9-2278-4d70-8954-c0bc97660f6b") : secret "samples-operator-tls" not found
Sep 06 00:51:02.345860 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.344723    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:51:02.345860 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:02.345561    2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 00:51:02.345860 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:02.345621    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls podName:b7651597-3577-4f93-84cc-4b068adf9280 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:06.345602925 +0000 UTC m=+46.879237230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vfxgd" (UID: "b7651597-3577-4f93-84cc-4b068adf9280") : secret "cluster-monitoring-operator-tls" not found
Sep 06 00:51:02.360016 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.359971    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kgj47" podStartSLOduration=35.52399611 podStartE2EDuration="42.359952014s" totalImagesPullingTime="6.835955904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:02.333501945 +0000 UTC m=+42.867136274" watchObservedRunningTime="2026-09-06 00:51:02.359952014 +0000 UTC m=+42.893586344"
Sep 06 00:51:02.447105 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.446147    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:02.447105 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.446293    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:02.447105 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:02.446334    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:51:02.447105 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:02.446501    2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 00:51:02.447105 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:02.446564    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert podName:d6eae2e5-a786-45da-9bf9-03f98e4c7e9d nodeName:}" failed. No retries permitted until 2026-09-06 00:51:06.446545534 +0000 UTC m=+46.980179863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fgnd2" (UID: "d6eae2e5-a786-45da-9bf9-03f98e4c7e9d") : secret "networking-console-plugin-cert" not found
Sep 06 00:51:02.447105 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:02.446956    2548 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 00:51:02.447105 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:02.447002    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:06.446987757 +0000 UTC m=+46.980622065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : secret "router-metrics-certs-default" not found
Sep 06 00:51:02.447105 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:02.447067    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:06.447057239 +0000 UTC m=+46.980691545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : configmap references non-existent config key: service-ca.crt
Sep 06 00:51:03.272709 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:03.270473    2548 generic.go:356] "Generic (PLEG): container finished" podID="d5a0b4fa-fb6e-45b7-92b1-db8003e1401a" containerID="b2a90b89989a1602f8170312cdf99a5ed8c6dbac70a7146c8a49a02605634048" exitCode=0
Sep 06 00:51:03.272709 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:03.271736    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5j2m" event={"ID":"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a","Type":"ContainerDied","Data":"b2a90b89989a1602f8170312cdf99a5ed8c6dbac70a7146c8a49a02605634048"}
Sep 06 00:51:03.296739 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:03.296680    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fkfvk" podStartSLOduration=36.422724238 podStartE2EDuration="43.29665682s" totalImagesPullingTime="6.873932582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:02.361826963 +0000 UTC m=+42.895461274" watchObservedRunningTime="2026-09-06 00:51:03.29665682 +0000 UTC m=+43.830291152"
Sep 06 00:51:04.275906 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:04.275864    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5j2m" event={"ID":"d5a0b4fa-fb6e-45b7-92b1-db8003e1401a","Type":"ContainerStarted","Data":"b3e76a464ffd54c6d2154f3f937e907c6c3930dbab9ed8833262f609def7aa02"}
Sep 06 00:51:04.296427 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:04.296370    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b5j2m" podStartSLOduration=9.470325362 podStartE2EDuration="44.296355875s" totalImagesPullingTime="34.826030513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:04.295308036 +0000 UTC m=+44.828942362" watchObservedRunningTime="2026-09-06 00:51:04.296355875 +0000 UTC m=+44.829990203"
Sep 06 00:51:06.381413 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:06.381373    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:51:06.381765 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:06.381470    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fmhrk\" (UID: \"50a02fa9-2278-4d70-8954-c0bc97660f6b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:51:06.381765 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:06.381516    2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 00:51:06.381765 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:06.381569    2548 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 00:51:06.381765 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:06.381582    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls podName:b7651597-3577-4f93-84cc-4b068adf9280 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:14.381567024 +0000 UTC m=+54.915201329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vfxgd" (UID: "b7651597-3577-4f93-84cc-4b068adf9280") : secret "cluster-monitoring-operator-tls" not found
Sep 06 00:51:06.381765 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:06.381607    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls podName:50a02fa9-2278-4d70-8954-c0bc97660f6b nodeName:}" failed. No retries permitted until 2026-09-06 00:51:14.381596106 +0000 UTC m=+54.915230411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-fmhrk" (UID: "50a02fa9-2278-4d70-8954-c0bc97660f6b") : secret "samples-operator-tls" not found
Sep 06 00:51:06.482193 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:06.482165    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:06.482340 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:06.482200    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:51:06.482340 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:06.482241    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:06.482462 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:06.482348    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:14.482328906 +0000 UTC m=+55.015963227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : configmap references non-existent config key: service-ca.crt
Sep 06 00:51:06.482462 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:06.482369    2548 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 00:51:06.482462 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:06.482373    2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 00:51:06.482462 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:06.482406    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:14.482396086 +0000 UTC m=+55.016030391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : secret "router-metrics-certs-default" not found
Sep 06 00:51:06.482462 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:06.482425    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert podName:d6eae2e5-a786-45da-9bf9-03f98e4c7e9d nodeName:}" failed. No retries permitted until 2026-09-06 00:51:14.482410955 +0000 UTC m=+55.016045284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fgnd2" (UID: "d6eae2e5-a786-45da-9bf9-03f98e4c7e9d") : secret "networking-console-plugin-cert" not found
Sep 06 00:51:07.287058 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.287017    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-tn5q6" event={"ID":"903f27c0-a3ab-4274-b755-74f99d165cc6","Type":"ContainerStarted","Data":"e8d2c961300c8550908a718ea7425af15eb8d01943f88f7f6d2b9f5a11c0c62c"}
Sep 06 00:51:07.288957 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.288937    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/0.log"
Sep 06 00:51:07.289075 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.288973    2548 generic.go:356] "Generic (PLEG): container finished" podID="487de660-0766-4387-9351-63c22a95dd79" containerID="dc8afe63419296ae4c0b02ab7002db3f1f59cdaae78ecba5eb68dea5d0cd413b" exitCode=255
Sep 06 00:51:07.289075 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.289006    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" event={"ID":"487de660-0766-4387-9351-63c22a95dd79","Type":"ContainerDied","Data":"dc8afe63419296ae4c0b02ab7002db3f1f59cdaae78ecba5eb68dea5d0cd413b"}
Sep 06 00:51:07.289231 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.289218    2548 scope.go:117] "RemoveContainer" containerID="dc8afe63419296ae4c0b02ab7002db3f1f59cdaae78ecba5eb68dea5d0cd413b"
Sep 06 00:51:07.290724 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.290683    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kr428" event={"ID":"b30512c8-a402-4e9f-916d-77c29036c8ed","Type":"ContainerStarted","Data":"292467c01fe1c5eff68b9bb9c2a6fc51756af3de2dac898d110620d3a3fff0a0"}
Sep 06 00:51:07.292416 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.292394    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674" event={"ID":"5b23b0e5-3a15-48a5-843d-e837a905a68b","Type":"ContainerStarted","Data":"5bb149d332f639be08e7621d2f361155df1a1f07bf0d53c453721e280ca6bf2b"}
Sep 06 00:51:07.293962 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.293944    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk" event={"ID":"12870d88-2f67-4834-9643-71e9e8547131","Type":"ContainerStarted","Data":"b7ea58ee73b56779b7b4b372c74362b0d288a64eac5fad00eeec2fb665167404"}
Sep 06 00:51:07.302890 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.302846    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-tn5q6" podStartSLOduration=3.988508704 podStartE2EDuration="9.302831021s" totalImagesPullingTime="5.314322317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:07.30198007 +0000 UTC m=+47.835614395" watchObservedRunningTime="2026-09-06 00:51:07.302831021 +0000 UTC m=+47.836465351"
Sep 06 00:51:07.321037 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.320988    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-kr428" podStartSLOduration=4.005463398 podStartE2EDuration="9.32097004s" totalImagesPullingTime="5.315506642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:07.320930563 +0000 UTC m=+47.854564885" watchObservedRunningTime="2026-09-06 00:51:07.32097004 +0000 UTC m=+47.854604369"
Sep 06 00:51:07.342833 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.342782    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk" podStartSLOduration=4.020028459 podStartE2EDuration="9.342762945s" totalImagesPullingTime="5.322734486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:07.341172952 +0000 UTC m=+47.874807274" watchObservedRunningTime="2026-09-06 00:51:07.342762945 +0000 UTC m=+47.876397271"
Sep 06 00:51:07.378755 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:07.378707    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674" podStartSLOduration=4.064435884 podStartE2EDuration="9.378689639s" totalImagesPullingTime="5.314253755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:07.376967671 +0000 UTC m=+47.910601998" watchObservedRunningTime="2026-09-06 00:51:07.378689639 +0000 UTC m=+47.912323968"
Sep 06 00:51:08.117974 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.117897    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp"]
Sep 06 00:51:08.139699 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.139666    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp"]
Sep 06 00:51:08.139838 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.139797    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp"
Sep 06 00:51:08.142110 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.142086    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 06 00:51:08.142208 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.142186    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-h68r9\""
Sep 06 00:51:08.142935 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.142920    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 06 00:51:08.195756 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.195735    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8knr6\" (UniqueName: \"kubernetes.io/projected/e2d21385-2fab-4ae8-9663-cb60816caa24-kube-api-access-8knr6\") pod \"migrator-fdbb8fdff-jtgvp\" (UID: \"e2d21385-2fab-4ae8-9663-cb60816caa24\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp"
Sep 06 00:51:08.283785 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.283749    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8kgwz"]
Sep 06 00:51:08.296934 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.296886    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8knr6\" (UniqueName: \"kubernetes.io/projected/e2d21385-2fab-4ae8-9663-cb60816caa24-kube-api-access-8knr6\") pod \"migrator-fdbb8fdff-jtgvp\" (UID: \"e2d21385-2fab-4ae8-9663-cb60816caa24\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp"
Sep 06 00:51:08.304413 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.304383    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/1.log"
Sep 06 00:51:08.304890 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.304874    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/0.log"
Sep 06 00:51:08.305003 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.304907    2548 generic.go:356] "Generic (PLEG): container finished" podID="487de660-0766-4387-9351-63c22a95dd79" containerID="5cbb374fa73a4bc49dba178581c364ecc0db202c7cb5ab43939815927ed57657" exitCode=255
Sep 06 00:51:08.305623 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.305606    2548 scope.go:117] "RemoveContainer" containerID="5cbb374fa73a4bc49dba178581c364ecc0db202c7cb5ab43939815927ed57657"
Sep 06 00:51:08.305789 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:08.305765    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-pzkqj_openshift-console-operator(487de660-0766-4387-9351-63c22a95dd79)\"" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" podUID="487de660-0766-4387-9351-63c22a95dd79"
Sep 06 00:51:08.306043 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.305856    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8kgwz"]
Sep 06 00:51:08.306043 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.305904    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" event={"ID":"487de660-0766-4387-9351-63c22a95dd79","Type":"ContainerDied","Data":"5cbb374fa73a4bc49dba178581c364ecc0db202c7cb5ab43939815927ed57657"}
Sep 06 00:51:08.306043 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.305939    2548 scope.go:117] "RemoveContainer" containerID="dc8afe63419296ae4c0b02ab7002db3f1f59cdaae78ecba5eb68dea5d0cd413b"
Sep 06 00:51:08.306216 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.306147    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.306526 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.306486    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8knr6\" (UniqueName: \"kubernetes.io/projected/e2d21385-2fab-4ae8-9663-cb60816caa24-kube-api-access-8knr6\") pod \"migrator-fdbb8fdff-jtgvp\" (UID: \"e2d21385-2fab-4ae8-9663-cb60816caa24\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp"
Sep 06 00:51:08.308639 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.308619    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 06 00:51:08.308833 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.308818    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g58m5\""
Sep 06 00:51:08.308956 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.308941    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 06 00:51:08.397847 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.397778    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.397847 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.397824    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/774c006e-d3b9-4d72-a124-e0e577db02ad-crio-socket\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.398061 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.398026    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/774c006e-d3b9-4d72-a124-e0e577db02ad-data-volume\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.398356 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.398327    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4lbm\" (UniqueName: \"kubernetes.io/projected/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-api-access-z4lbm\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.398519 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.398499    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.448848 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.448824    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp"
Sep 06 00:51:08.499494 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.499470    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.499596 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.499515    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.499596 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.499534    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/774c006e-d3b9-4d72-a124-e0e577db02ad-crio-socket\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.499596 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.499573    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/774c006e-d3b9-4d72-a124-e0e577db02ad-data-volume\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.499710 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:08.499612    2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 00:51:08.499710 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.499619    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4lbm\" (UniqueName: \"kubernetes.io/projected/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-api-access-z4lbm\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.499710 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:08.499617    2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 00:51:08.499710 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.499683    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/774c006e-d3b9-4d72-a124-e0e577db02ad-crio-socket\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.499710 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:08.499703    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm podName:774c006e-d3b9-4d72-a124-e0e577db02ad nodeName:}" failed. No retries permitted until 2026-09-06 00:51:08.999680161 +0000 UTC m=+49.533314480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8kgwz" (UID: "774c006e-d3b9-4d72-a124-e0e577db02ad") : configmap "kube-rbac-proxy" not found
Sep 06 00:51:08.499904 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:08.499735    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls podName:774c006e-d3b9-4d72-a124-e0e577db02ad nodeName:}" failed. No retries permitted until 2026-09-06 00:51:08.999716439 +0000 UTC m=+49.533350759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8kgwz" (UID: "774c006e-d3b9-4d72-a124-e0e577db02ad") : secret "insights-runtime-extractor-tls" not found
Sep 06 00:51:08.500007 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.499989    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/774c006e-d3b9-4d72-a124-e0e577db02ad-data-volume\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.510171 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.510147    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4lbm\" (UniqueName: \"kubernetes.io/projected/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-api-access-z4lbm\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:08.701331 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.701239    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:51:08.701491 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:08.701397    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 00:51:08.701491 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.701408    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:51:08.701491 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:08.701460    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls podName:8a6f2386-4763-4ee2-ac46-26b654018da3 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:24.701442909 +0000 UTC m=+65.235077224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls") pod "dns-default-66gtb" (UID: "8a6f2386-4763-4ee2-ac46-26b654018da3") : secret "dns-default-metrics-tls" not found
Sep 06 00:51:08.701660 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:08.701507    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 00:51:08.701660 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:08.701520    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-864659dbbd-wcx7r: secret "image-registry-tls" not found
Sep 06 00:51:08.701660 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:08.701561    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls podName:064e339b-b333-4667-9f51-0af255e62f11 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:24.701549903 +0000 UTC m=+65.235184208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls") pod "image-registry-864659dbbd-wcx7r" (UID: "064e339b-b333-4667-9f51-0af255e62f11") : secret "image-registry-tls" not found
Sep 06 00:51:08.754080 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:08.754049    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp"]
Sep 06 00:51:08.756768 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:08.756735    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d21385_2fab_4ae8_9663_cb60816caa24.slice/crio-ae45510921571f67d1322c1a0a7307b1971c75206bc6f3310f9651319703733a WatchSource:0}: Error finding container ae45510921571f67d1322c1a0a7307b1971c75206bc6f3310f9651319703733a: Status 404 returned error can't find the container with id ae45510921571f67d1322c1a0a7307b1971c75206bc6f3310f9651319703733a
Sep 06 00:51:09.004660 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:09.004627    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:09.004836 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:09.004674    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:09.004836 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:09.004755    2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 00:51:09.004836 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:09.004821    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm podName:774c006e-d3b9-4d72-a124-e0e577db02ad nodeName:}" failed. No retries permitted until 2026-09-06 00:51:10.004803293 +0000 UTC m=+50.538437612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8kgwz" (UID: "774c006e-d3b9-4d72-a124-e0e577db02ad") : configmap "kube-rbac-proxy" not found
Sep 06 00:51:09.004992 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:09.004877    2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 00:51:09.004992 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:09.004921    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls podName:774c006e-d3b9-4d72-a124-e0e577db02ad nodeName:}" failed. No retries permitted until 2026-09-06 00:51:10.004910085 +0000 UTC m=+50.538544395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8kgwz" (UID: "774c006e-d3b9-4d72-a124-e0e577db02ad") : secret "insights-runtime-extractor-tls" not found
Sep 06 00:51:09.017365 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:09.017339    2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:51:09.017449 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:09.017382    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:51:09.309828 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:09.309743    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp" event={"ID":"e2d21385-2fab-4ae8-9663-cb60816caa24","Type":"ContainerStarted","Data":"ae45510921571f67d1322c1a0a7307b1971c75206bc6f3310f9651319703733a"}
Sep 06 00:51:09.311161 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:09.311143    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/1.log"
Sep 06 00:51:09.311473 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:09.311460    2548 scope.go:117] "RemoveContainer" containerID="5cbb374fa73a4bc49dba178581c364ecc0db202c7cb5ab43939815927ed57657"
Sep 06 00:51:09.311628 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:09.311611    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-pzkqj_openshift-console-operator(487de660-0766-4387-9351-63c22a95dd79)\"" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" podUID="487de660-0766-4387-9351-63c22a95dd79"
Sep 06 00:51:10.013197 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.013170    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:10.013374 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:10.013318    2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 00:51:10.013374 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:10.013366    2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 00:51:10.013374 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:10.013373    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls podName:774c006e-d3b9-4d72-a124-e0e577db02ad nodeName:}" failed. No retries permitted until 2026-09-06 00:51:12.013358186 +0000 UTC m=+52.546992496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8kgwz" (UID: "774c006e-d3b9-4d72-a124-e0e577db02ad") : secret "insights-runtime-extractor-tls" not found
Sep 06 00:51:10.013498 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.013322    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:10.013498 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:10.013414    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm podName:774c006e-d3b9-4d72-a124-e0e577db02ad nodeName:}" failed. No retries permitted until 2026-09-06 00:51:12.013398553 +0000 UTC m=+52.547032860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8kgwz" (UID: "774c006e-d3b9-4d72-a124-e0e577db02ad") : configmap "kube-rbac-proxy" not found
Sep 06 00:51:10.265578 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.265519    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q96w7_206b4891-2024-44ed-9975-9c6e90ac3500/dns-node-resolver/0.log"
Sep 06 00:51:10.314398 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.314380    2548 scope.go:117] "RemoveContainer" containerID="5cbb374fa73a4bc49dba178581c364ecc0db202c7cb5ab43939815927ed57657"
Sep 06 00:51:10.314702 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:10.314536    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-pzkqj_openshift-console-operator(487de660-0766-4387-9351-63c22a95dd79)\"" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" podUID="487de660-0766-4387-9351-63c22a95dd79"
Sep 06 00:51:10.370366 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.370339    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-g5dmf"]
Sep 06 00:51:10.395900 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.395875    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-g5dmf"
Sep 06 00:51:10.396016 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.395879    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-g5dmf"]
Sep 06 00:51:10.398583 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.398563    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 06 00:51:10.398661 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.398563    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 06 00:51:10.398661 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.398615    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 06 00:51:10.398757 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.398565    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 06 00:51:10.399594 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.399581    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8g4r7\""
Sep 06 00:51:10.518122 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.518051    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee-signing-key\") pod \"service-ca-75d99c484-g5dmf\" (UID: \"a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee\") " pod="openshift-service-ca/service-ca-75d99c484-g5dmf"
Sep 06 00:51:10.518122 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.518091    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbtkq\" (UniqueName: \"kubernetes.io/projected/a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee-kube-api-access-lbtkq\") pod \"service-ca-75d99c484-g5dmf\" (UID: \"a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee\") " pod="openshift-service-ca/service-ca-75d99c484-g5dmf"
Sep 06 00:51:10.518296 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.518168    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee-signing-cabundle\") pod \"service-ca-75d99c484-g5dmf\" (UID: \"a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee\") " pod="openshift-service-ca/service-ca-75d99c484-g5dmf"
Sep 06 00:51:10.618860 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.618835    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee-signing-key\") pod \"service-ca-75d99c484-g5dmf\" (UID: \"a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee\") " pod="openshift-service-ca/service-ca-75d99c484-g5dmf"
Sep 06 00:51:10.618952 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.618873    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbtkq\" (UniqueName: \"kubernetes.io/projected/a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee-kube-api-access-lbtkq\") pod \"service-ca-75d99c484-g5dmf\" (UID: \"a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee\") " pod="openshift-service-ca/service-ca-75d99c484-g5dmf"
Sep 06 00:51:10.618952 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.618930    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee-signing-cabundle\") pod \"service-ca-75d99c484-g5dmf\" (UID: \"a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee\") " pod="openshift-service-ca/service-ca-75d99c484-g5dmf"
Sep 06 00:51:10.619624 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.619603    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee-signing-cabundle\") pod \"service-ca-75d99c484-g5dmf\" (UID: \"a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee\") " pod="openshift-service-ca/service-ca-75d99c484-g5dmf"
Sep 06 00:51:10.621345 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.621323    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee-signing-key\") pod \"service-ca-75d99c484-g5dmf\" (UID: \"a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee\") " pod="openshift-service-ca/service-ca-75d99c484-g5dmf"
Sep 06 00:51:10.628753 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.628730    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbtkq\" (UniqueName: \"kubernetes.io/projected/a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee-kube-api-access-lbtkq\") pod \"service-ca-75d99c484-g5dmf\" (UID: \"a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee\") " pod="openshift-service-ca/service-ca-75d99c484-g5dmf"
Sep 06 00:51:10.714663 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:10.714640    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-g5dmf"
Sep 06 00:51:11.007464 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:11.007439    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-g5dmf"]
Sep 06 00:51:11.009470 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:11.009446    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97c2c47_6f4c_45fa_9b4c_2bbf613e9aee.slice/crio-7c13f5f2750bb19ece3353acd1b437fe60cd1fbd133c023759110a86626e7fca WatchSource:0}: Error finding container 7c13f5f2750bb19ece3353acd1b437fe60cd1fbd133c023759110a86626e7fca: Status 404 returned error can't find the container with id 7c13f5f2750bb19ece3353acd1b437fe60cd1fbd133c023759110a86626e7fca
Sep 06 00:51:11.319876 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:11.319802    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-g5dmf" event={"ID":"a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee","Type":"ContainerStarted","Data":"1ff7751901d0bbbfd8474170a92c567a9bf0b94047589bb0f238c0f151be0a4b"}
Sep 06 00:51:11.319876 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:11.319854    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-g5dmf" event={"ID":"a97c2c47-6f4c-45fa-9b4c-2bbf613e9aee","Type":"ContainerStarted","Data":"7c13f5f2750bb19ece3353acd1b437fe60cd1fbd133c023759110a86626e7fca"}
Sep 06 00:51:11.321827 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:11.321799    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp" event={"ID":"e2d21385-2fab-4ae8-9663-cb60816caa24","Type":"ContainerStarted","Data":"790d4166c3f93af46673b3f67bb6ae8ff5e364d3f10c1b434c49f89477280f09"}
Sep 06 00:51:11.321953 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:11.321845    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp" event={"ID":"e2d21385-2fab-4ae8-9663-cb60816caa24","Type":"ContainerStarted","Data":"0aa05297425f17db94f6db33dc05ad6121ea221756f506b05fd8ed28ada06032"}
Sep 06 00:51:11.346496 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:11.346444    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-g5dmf" podStartSLOduration=1.346429831 podStartE2EDuration="1.346429831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:11.346149855 +0000 UTC m=+51.879784182" watchObservedRunningTime="2026-09-06 00:51:11.346429831 +0000 UTC m=+51.880064158"
Sep 06 00:51:11.467152 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:11.467129    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qzqcf_cb45d3f6-b91f-430b-b76c-0261720d3daf/node-ca/0.log"
Sep 06 00:51:11.869751 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:11.869722    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mrjrs_cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0/serve-healthcheck-canary/0.log"
Sep 06 00:51:12.031522 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:12.031465    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:12.031681 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:12.031587    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:12.031774 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:12.031754    2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 00:51:12.031866 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:12.031854    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls podName:774c006e-d3b9-4d72-a124-e0e577db02ad nodeName:}" failed. No retries permitted until 2026-09-06 00:51:16.031831195 +0000 UTC m=+56.565465947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8kgwz" (UID: "774c006e-d3b9-4d72-a124-e0e577db02ad") : secret "insights-runtime-extractor-tls" not found
Sep 06 00:51:12.032049 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:12.032026    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/774c006e-d3b9-4d72-a124-e0e577db02ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:12.067663 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:12.067635    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-jtgvp_e2d21385-2fab-4ae8-9663-cb60816caa24/migrator/0.log"
Sep 06 00:51:12.270424 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:12.270387    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-jtgvp_e2d21385-2fab-4ae8-9663-cb60816caa24/graceful-termination/0.log"
Sep 06 00:51:12.467865 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:12.467834    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-sktdk_12870d88-2f67-4834-9643-71e9e8547131/kube-storage-version-migrator-operator/0.log"
Sep 06 00:51:14.453040 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:14.453008    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fmhrk\" (UID: \"50a02fa9-2278-4d70-8954-c0bc97660f6b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:51:14.453533 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:14.453094    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:51:14.453533 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:14.453243    2548 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 00:51:14.453533 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:14.453352    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls podName:b7651597-3577-4f93-84cc-4b068adf9280 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:30.453329194 +0000 UTC m=+70.986963515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vfxgd" (UID: "b7651597-3577-4f93-84cc-4b068adf9280") : secret "cluster-monitoring-operator-tls" not found
Sep 06 00:51:14.455581 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:14.455556    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50a02fa9-2278-4d70-8954-c0bc97660f6b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fmhrk\" (UID: \"50a02fa9-2278-4d70-8954-c0bc97660f6b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:51:14.515895 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:14.515870    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"
Sep 06 00:51:14.554431 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:14.554393    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:14.554579 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:14.554461    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:14.554579 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:14.554486    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:51:14.554691 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:14.554572    2548 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 00:51:14.554691 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:14.554592    2548 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 00:51:14.554691 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:14.554634    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:30.554617951 +0000 UTC m=+71.088252261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : configmap references non-existent config key: service-ca.crt
Sep 06 00:51:14.554691 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:14.554654    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs podName:250efc20-ed5b-4f56-aee8-fcf5afdbacc0 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:30.554647831 +0000 UTC m=+71.088282137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs") pod "router-default-5b797f8856-mpddc" (UID: "250efc20-ed5b-4f56-aee8-fcf5afdbacc0") : secret "router-metrics-certs-default" not found
Sep 06 00:51:14.554691 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:14.554665    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert podName:d6eae2e5-a786-45da-9bf9-03f98e4c7e9d nodeName:}" failed. No retries permitted until 2026-09-06 00:51:30.554659595 +0000 UTC m=+71.088293901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-fgnd2" (UID: "d6eae2e5-a786-45da-9bf9-03f98e4c7e9d") : secret "networking-console-plugin-cert" not found
Sep 06 00:51:14.787215 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:14.787160    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-jtgvp" podStartSLOduration=5.294254689 podStartE2EDuration="6.787141193s" totalImagesPullingTime="1.492886504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:11.372074626 +0000 UTC m=+51.905708954" watchObservedRunningTime="2026-09-06 00:51:14.787141193 +0000 UTC m=+55.320775522"
Sep 06 00:51:14.787611 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:14.787594    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk"]
Sep 06 00:51:15.337648 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:15.337611    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk" event={"ID":"50a02fa9-2278-4d70-8954-c0bc97660f6b","Type":"ContainerStarted","Data":"b1874f17916177fc8d758732620bbe47c6dec560198d53f25a0301f412b993cf"}
Sep 06 00:51:16.068979 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:16.068946    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:16.069421 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:16.069119    2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 00:51:16.069421 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:16.069191    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls podName:774c006e-d3b9-4d72-a124-e0e577db02ad nodeName:}" failed. No retries permitted until 2026-09-06 00:51:24.069171328 +0000 UTC m=+64.602805649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8kgwz" (UID: "774c006e-d3b9-4d72-a124-e0e577db02ad") : secret "insights-runtime-extractor-tls" not found
Sep 06 00:51:17.346513 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:17.346479    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk" event={"ID":"50a02fa9-2278-4d70-8954-c0bc97660f6b","Type":"ContainerStarted","Data":"69ab42175d7d8cdaefe9a1b31b18de10433317848507be11fb9e930d031c9c7d"}
Sep 06 00:51:17.346959 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:17.346535    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk" event={"ID":"50a02fa9-2278-4d70-8954-c0bc97660f6b","Type":"ContainerStarted","Data":"f062ab19426ecc08ffc9f48dba3c01069484904e02b732124179df28db7cac8e"}
Sep 06 00:51:17.362725 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:17.362670    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fmhrk" podStartSLOduration=17.592739663 podStartE2EDuration="19.362655515s" totalImagesPullingTime="1.769915852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:17.362320789 +0000 UTC m=+57.895955115" watchObservedRunningTime="2026-09-06 00:51:17.362655515 +0000 UTC m=+57.896289843"
Sep 06 00:51:21.204902 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:21.204875    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ttrf"
Sep 06 00:51:24.138359 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.138316    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:24.140496 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.140478    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/774c006e-d3b9-4d72-a124-e0e577db02ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kgwz\" (UID: \"774c006e-d3b9-4d72-a124-e0e577db02ad\") " pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:24.221390 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.221369    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g58m5\""
Sep 06 00:51:24.230225 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.230200    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8kgwz"
Sep 06 00:51:24.500940 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.500914    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8kgwz"]
Sep 06 00:51:24.503636 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:24.503612    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774c006e_d3b9_4d72_a124_e0e577db02ad.slice/crio-16247cb71cc4c841df36bdcaf6b95ceb182baca8be7f62bbf17f9fe950283aba WatchSource:0}: Error finding container 16247cb71cc4c841df36bdcaf6b95ceb182baca8be7f62bbf17f9fe950283aba: Status 404 returned error can't find the container with id 16247cb71cc4c841df36bdcaf6b95ceb182baca8be7f62bbf17f9fe950283aba
Sep 06 00:51:24.743986 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.743953    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:51:24.744157 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.744006    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:51:24.746124 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.746101    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a6f2386-4763-4ee2-ac46-26b654018da3-metrics-tls\") pod \"dns-default-66gtb\" (UID: \"8a6f2386-4763-4ee2-ac46-26b654018da3\") " pod="openshift-dns/dns-default-66gtb"
Sep 06 00:51:24.746257 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.746239    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls\") pod \"image-registry-864659dbbd-wcx7r\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") " pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:51:24.883787 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.883729    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tfhmt\""
Sep 06 00:51:24.891632 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.891613    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:51:24.905822 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.905804    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sw7jk\""
Sep 06 00:51:24.913624 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.913585    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-66gtb"
Sep 06 00:51:24.981060 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:24.981039    2548 scope.go:117] "RemoveContainer" containerID="5cbb374fa73a4bc49dba178581c364ecc0db202c7cb5ab43939815927ed57657"
Sep 06 00:51:25.163872 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.163817    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-864659dbbd-wcx7r"]
Sep 06 00:51:25.167165 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:25.167143    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064e339b_b333_4667_9f51_0af255e62f11.slice/crio-b8630c9cb66fab8921c0985b5f12b85875b157660c09b0e6854d97380b1258e0 WatchSource:0}: Error finding container b8630c9cb66fab8921c0985b5f12b85875b157660c09b0e6854d97380b1258e0: Status 404 returned error can't find the container with id b8630c9cb66fab8921c0985b5f12b85875b157660c09b0e6854d97380b1258e0
Sep 06 00:51:25.184809 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.184784    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-66gtb"]
Sep 06 00:51:25.187319 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:25.187298    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a6f2386_4763_4ee2_ac46_26b654018da3.slice/crio-8648bda5c453c9a09ba0d8943e57ab5750339bdc6f0c0e16c5028c86e232101a WatchSource:0}: Error finding container 8648bda5c453c9a09ba0d8943e57ab5750339bdc6f0c0e16c5028c86e232101a: Status 404 returned error can't find the container with id 8648bda5c453c9a09ba0d8943e57ab5750339bdc6f0c0e16c5028c86e232101a
Sep 06 00:51:25.378555 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.378515    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r" event={"ID":"064e339b-b333-4667-9f51-0af255e62f11","Type":"ContainerStarted","Data":"036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f"}
Sep 06 00:51:25.378733 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.378608    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r" event={"ID":"064e339b-b333-4667-9f51-0af255e62f11","Type":"ContainerStarted","Data":"b8630c9cb66fab8921c0985b5f12b85875b157660c09b0e6854d97380b1258e0"}
Sep 06 00:51:25.378889 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.378856    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:51:25.380449 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.380422    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kgwz" event={"ID":"774c006e-d3b9-4d72-a124-e0e577db02ad","Type":"ContainerStarted","Data":"ed15efa15fc71242047abe126e39b887f01cc4139b1498c824435d58eb23e70a"}
Sep 06 00:51:25.380568 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.380470    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kgwz" event={"ID":"774c006e-d3b9-4d72-a124-e0e577db02ad","Type":"ContainerStarted","Data":"16247cb71cc4c841df36bdcaf6b95ceb182baca8be7f62bbf17f9fe950283aba"}
Sep 06 00:51:25.383920 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.383895    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-66gtb" event={"ID":"8a6f2386-4763-4ee2-ac46-26b654018da3","Type":"ContainerStarted","Data":"8648bda5c453c9a09ba0d8943e57ab5750339bdc6f0c0e16c5028c86e232101a"}
Sep 06 00:51:25.385758 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.385742    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 00:51:25.386125 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.386111    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/1.log"
Sep 06 00:51:25.386184 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.386140    2548 generic.go:356] "Generic (PLEG): container finished" podID="487de660-0766-4387-9351-63c22a95dd79" containerID="88274a806c9da7e10da21792e76b7a3dda8c274a8cc71f6356e6257dfbbd876d" exitCode=255
Sep 06 00:51:25.386184 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.386162    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" event={"ID":"487de660-0766-4387-9351-63c22a95dd79","Type":"ContainerDied","Data":"88274a806c9da7e10da21792e76b7a3dda8c274a8cc71f6356e6257dfbbd876d"}
Sep 06 00:51:25.386259 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.386192    2548 scope.go:117] "RemoveContainer" containerID="5cbb374fa73a4bc49dba178581c364ecc0db202c7cb5ab43939815927ed57657"
Sep 06 00:51:25.386487 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.386468    2548 scope.go:117] "RemoveContainer" containerID="88274a806c9da7e10da21792e76b7a3dda8c274a8cc71f6356e6257dfbbd876d"
Sep 06 00:51:25.386642 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:25.386624    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-pzkqj_openshift-console-operator(487de660-0766-4387-9351-63c22a95dd79)\"" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" podUID="487de660-0766-4387-9351-63c22a95dd79"
Sep 06 00:51:25.401398 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.401352    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r" podStartSLOduration=65.401334614 podStartE2EDuration="1m5.401334614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:25.400427595 +0000 UTC m=+65.934061924" watchObservedRunningTime="2026-09-06 00:51:25.401334614 +0000 UTC m=+65.934968944"
Sep 06 00:51:25.854997 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.854959    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:51:25.857371 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.857348    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba72479c-dee0-49b8-b076-5cc94e837a4b-metrics-certs\") pod \"network-metrics-daemon-2rjrr\" (UID: \"ba72479c-dee0-49b8-b076-5cc94e837a4b\") " pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:51:25.992488 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:25.992459    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bctds\""
Sep 06 00:51:26.000394 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:26.000373    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rjrr"
Sep 06 00:51:26.279171 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:26.279128    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2rjrr"]
Sep 06 00:51:26.281993 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:26.281959    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba72479c_dee0_49b8_b076_5cc94e837a4b.slice/crio-c878fb148c8b569ecfcdca1b41e565f1e32e1c0b7fb4d3d03ec2d34eaa11c956 WatchSource:0}: Error finding container c878fb148c8b569ecfcdca1b41e565f1e32e1c0b7fb4d3d03ec2d34eaa11c956: Status 404 returned error can't find the container with id c878fb148c8b569ecfcdca1b41e565f1e32e1c0b7fb4d3d03ec2d34eaa11c956
Sep 06 00:51:26.392448 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:26.392413    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kgwz" event={"ID":"774c006e-d3b9-4d72-a124-e0e577db02ad","Type":"ContainerStarted","Data":"4a9a8099cdf7694166d0277e63c267bfab0c67e25fa74c7f15a5089f51df4d6d"}
Sep 06 00:51:26.393734 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:26.393701    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2rjrr" event={"ID":"ba72479c-dee0-49b8-b076-5cc94e837a4b","Type":"ContainerStarted","Data":"c878fb148c8b569ecfcdca1b41e565f1e32e1c0b7fb4d3d03ec2d34eaa11c956"}
Sep 06 00:51:26.395340 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:26.395319    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 00:51:28.405285 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:28.405175    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kgwz" event={"ID":"774c006e-d3b9-4d72-a124-e0e577db02ad","Type":"ContainerStarted","Data":"1976600156fa7ac72442946ba6b4bfbaad98f70e3a95e2609b5048dd1735e22f"}
Sep 06 00:51:28.407000 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:28.406967    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2rjrr" event={"ID":"ba72479c-dee0-49b8-b076-5cc94e837a4b","Type":"ContainerStarted","Data":"4e9ed5c5e22c2126a4e80a49e2944686133c4a48ec3a3ee8730830714182e56b"}
Sep 06 00:51:28.407124 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:28.407016    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2rjrr" event={"ID":"ba72479c-dee0-49b8-b076-5cc94e837a4b","Type":"ContainerStarted","Data":"687d253eea580225c3c15c0194f3bd06eea7a5e2e5613c3e2f0d0b358da82d3d"}
Sep 06 00:51:28.408681 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:28.408660    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-66gtb" event={"ID":"8a6f2386-4763-4ee2-ac46-26b654018da3","Type":"ContainerStarted","Data":"8f91c2c55694239d377adcdd02ddbe433c3c1f248573d8585d88a777a4fb8497"}
Sep 06 00:51:28.408796 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:28.408693    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-66gtb" event={"ID":"8a6f2386-4763-4ee2-ac46-26b654018da3","Type":"ContainerStarted","Data":"ab2f7b73eadc204ed29382dd3e9da5c54146fa99ef81ef95e48bcea06146f881"}
Sep 06 00:51:28.408796 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:28.408781    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-66gtb"
Sep 06 00:51:28.431197 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:28.428133    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8kgwz" podStartSLOduration=17.610630229 podStartE2EDuration="20.428113057s" totalImagesPullingTime="2.817482828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:51:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:28.426887905 +0000 UTC m=+68.960522231" watchObservedRunningTime="2026-09-06 00:51:28.428113057 +0000 UTC m=+68.961747385"
Sep 06 00:51:28.448645 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:28.448587    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-66gtb" podStartSLOduration=34.204534339 podStartE2EDuration="36.448572361s" totalImagesPullingTime="2.244038022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:28.44710653 +0000 UTC m=+68.980740857" watchObservedRunningTime="2026-09-06 00:51:28.448572361 +0000 UTC m=+68.982206719"
Sep 06 00:51:28.464943 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:28.464899    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2rjrr" podStartSLOduration=66.677089481 podStartE2EDuration="1m8.464884584s" totalImagesPullingTime="1.787795103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:28.464641114 +0000 UTC m=+68.998275452" watchObservedRunningTime="2026-09-06 00:51:28.464884584 +0000 UTC m=+68.998518911"
Sep 06 00:51:29.017187 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:29.017154    2548 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:51:29.017359 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:29.017229    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:51:29.017536 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:29.017516    2548 scope.go:117] "RemoveContainer" containerID="88274a806c9da7e10da21792e76b7a3dda8c274a8cc71f6356e6257dfbbd876d"
Sep 06 00:51:29.017686 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:29.017666    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-pzkqj_openshift-console-operator(487de660-0766-4387-9351-63c22a95dd79)\"" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" podUID="487de660-0766-4387-9351-63c22a95dd79"
Sep 06 00:51:30.496522 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.496491    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:51:30.498759 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.498740    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7651597-3577-4f93-84cc-4b068adf9280-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vfxgd\" (UID: \"b7651597-3577-4f93-84cc-4b068adf9280\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:51:30.597170 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.597142    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:30.597301 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.597174    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:51:30.597301 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.597208    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:30.597708 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.597680    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-service-ca-bundle\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:30.599404 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.599380    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/250efc20-ed5b-4f56-aee8-fcf5afdbacc0-metrics-certs\") pod \"router-default-5b797f8856-mpddc\" (UID: \"250efc20-ed5b-4f56-aee8-fcf5afdbacc0\") " pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:30.599404 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.599388    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d6eae2e5-a786-45da-9bf9-03f98e4c7e9d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-fgnd2\" (UID: \"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:51:30.734543 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.734522    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8b7v7\""
Sep 06 00:51:30.742539 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.742523    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"
Sep 06 00:51:30.841157 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.841134    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-w44sc\""
Sep 06 00:51:30.849148 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.849130    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:30.880347 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.880327    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xkmpn\""
Sep 06 00:51:30.888168 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:30.888149    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2"
Sep 06 00:51:31.037899 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:31.037817    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd"]
Sep 06 00:51:31.041143 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:31.041118    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7651597_3577_4f93_84cc_4b068adf9280.slice/crio-730087123e2adc74372974b573d4fd63dd8070e7c93a7d4fc2ea701695d4b4d7 WatchSource:0}: Error finding container 730087123e2adc74372974b573d4fd63dd8070e7c93a7d4fc2ea701695d4b4d7: Status 404 returned error can't find the container with id 730087123e2adc74372974b573d4fd63dd8070e7c93a7d4fc2ea701695d4b4d7
Sep 06 00:51:31.147744 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:31.147722    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b797f8856-mpddc"]
Sep 06 00:51:31.150085 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:31.150056    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250efc20_ed5b_4f56_aee8_fcf5afdbacc0.slice/crio-4ceb3cd9781903808ca65347cf63365f1b0434d5c46ae9e3b8d0b91b9c2494ba WatchSource:0}: Error finding container 4ceb3cd9781903808ca65347cf63365f1b0434d5c46ae9e3b8d0b91b9c2494ba: Status 404 returned error can't find the container with id 4ceb3cd9781903808ca65347cf63365f1b0434d5c46ae9e3b8d0b91b9c2494ba
Sep 06 00:51:31.180613 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:31.180588    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-fgnd2"]
Sep 06 00:51:31.183500 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:31.183479    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6eae2e5_a786_45da_9bf9_03f98e4c7e9d.slice/crio-201fa37de63994608dc22835a4cb3bf0076657817ad01321c82cdad80157a6f6 WatchSource:0}: Error finding container 201fa37de63994608dc22835a4cb3bf0076657817ad01321c82cdad80157a6f6: Status 404 returned error can't find the container with id 201fa37de63994608dc22835a4cb3bf0076657817ad01321c82cdad80157a6f6
Sep 06 00:51:31.425885 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:31.425803    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b797f8856-mpddc" event={"ID":"250efc20-ed5b-4f56-aee8-fcf5afdbacc0","Type":"ContainerStarted","Data":"6ec30dc4701198e85c83755378ad057b74824e3d043973c46dbca97f785c3df1"}
Sep 06 00:51:31.425885 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:31.425882    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b797f8856-mpddc" event={"ID":"250efc20-ed5b-4f56-aee8-fcf5afdbacc0","Type":"ContainerStarted","Data":"4ceb3cd9781903808ca65347cf63365f1b0434d5c46ae9e3b8d0b91b9c2494ba"}
Sep 06 00:51:31.427036 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:31.427007    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd" event={"ID":"b7651597-3577-4f93-84cc-4b068adf9280","Type":"ContainerStarted","Data":"730087123e2adc74372974b573d4fd63dd8070e7c93a7d4fc2ea701695d4b4d7"}
Sep 06 00:51:31.428077 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:31.428053    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2" event={"ID":"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d","Type":"ContainerStarted","Data":"201fa37de63994608dc22835a4cb3bf0076657817ad01321c82cdad80157a6f6"}
Sep 06 00:51:31.443937 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:31.443889    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b797f8856-mpddc" podStartSLOduration=33.443871704 podStartE2EDuration="33.443871704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:31.442596443 +0000 UTC m=+71.976230763" watchObservedRunningTime="2026-09-06 00:51:31.443871704 +0000 UTC m=+71.977506032"
Sep 06 00:51:31.849825 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:31.849790    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:31.852600 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:31.852574    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:32.432289 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:32.432249    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:32.433533 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:32.433512    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b797f8856-mpddc"
Sep 06 00:51:34.278645 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:34.278617    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kgj47"
Sep 06 00:51:34.440972 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:34.440937    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2" event={"ID":"d6eae2e5-a786-45da-9bf9-03f98e4c7e9d","Type":"ContainerStarted","Data":"24ed760ea6978bd5ba34323d29cda5c3739fd84e3f990505ec72887de1f7b4db"}
Sep 06 00:51:34.442410 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:34.442381    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd" event={"ID":"b7651597-3577-4f93-84cc-4b068adf9280","Type":"ContainerStarted","Data":"2c54fae1f6b124640a5fb31365e7fe0d86e1ea148e7a26fa337877df8c703173"}
Sep 06 00:51:34.457565 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:34.457524    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-fgnd2" podStartSLOduration=34.183424829 podStartE2EDuration="36.45751183s" totalImagesPullingTime="2.274087001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:34.457160401 +0000 UTC m=+74.990794729" watchObservedRunningTime="2026-09-06 00:51:34.45751183 +0000 UTC m=+74.991146176"
Sep 06 00:51:34.475083 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:34.475045    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vfxgd" podStartSLOduration=34.053482489 podStartE2EDuration="36.475033001s" totalImagesPullingTime="2.421550512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:34.474184606 +0000 UTC m=+75.007818934" watchObservedRunningTime="2026-09-06 00:51:34.475033001 +0000 UTC m=+75.008667370"
Sep 06 00:51:35.240383 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.240353    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"]
Sep 06 00:51:35.270715 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.270684    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"]
Sep 06 00:51:35.270892 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.270815    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:35.274659 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.274634    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 06 00:51:35.274881 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.274862    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 06 00:51:35.275104 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.275088    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 06 00:51:35.275534 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.275504    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 06 00:51:35.285236 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.285212    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"]
Sep 06 00:51:35.285632 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.285324    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.288367 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.288347    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 06 00:51:35.288477 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.288451    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 06 00:51:35.288594 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.288572    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 06 00:51:35.288709 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.288621    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 06 00:51:35.291330 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.291044    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"]
Sep 06 00:51:35.435258 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.435224    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.435453 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.435294    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eb50603e-5e95-4271-8dbe-ac433606178d-klusterlet-config\") pod \"klusterlet-addon-workmgr-94b9dbc96-kllzv\" (UID: \"eb50603e-5e95-4271-8dbe-ac433606178d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:35.435453 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.435327    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-hub\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.435453 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.435387    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr6n7\" (UniqueName: \"kubernetes.io/projected/4df8a922-ba01-4b4a-8e71-15439b7e005d-kube-api-access-qr6n7\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.435453 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.435439    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.435659 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.435474    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbb8q\" (UniqueName: \"kubernetes.io/projected/eb50603e-5e95-4271-8dbe-ac433606178d-kube-api-access-hbb8q\") pod \"klusterlet-addon-workmgr-94b9dbc96-kllzv\" (UID: \"eb50603e-5e95-4271-8dbe-ac433606178d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:35.435659 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.435510    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4df8a922-ba01-4b4a-8e71-15439b7e005d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.435659 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.435539    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-ca\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.435659 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.435567    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb50603e-5e95-4271-8dbe-ac433606178d-tmp\") pod \"klusterlet-addon-workmgr-94b9dbc96-kllzv\" (UID: \"eb50603e-5e95-4271-8dbe-ac433606178d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:35.536921 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.536848    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.536921 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.536888    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eb50603e-5e95-4271-8dbe-ac433606178d-klusterlet-config\") pod \"klusterlet-addon-workmgr-94b9dbc96-kllzv\" (UID: \"eb50603e-5e95-4271-8dbe-ac433606178d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:35.536921 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.536906    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-hub\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.537133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.536927    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr6n7\" (UniqueName: \"kubernetes.io/projected/4df8a922-ba01-4b4a-8e71-15439b7e005d-kube-api-access-qr6n7\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.537133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.536947    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.537133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.536964    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbb8q\" (UniqueName: \"kubernetes.io/projected/eb50603e-5e95-4271-8dbe-ac433606178d-kube-api-access-hbb8q\") pod \"klusterlet-addon-workmgr-94b9dbc96-kllzv\" (UID: \"eb50603e-5e95-4271-8dbe-ac433606178d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:35.537133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.537030    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4df8a922-ba01-4b4a-8e71-15439b7e005d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.537133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.537065    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-ca\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.537133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.537094    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb50603e-5e95-4271-8dbe-ac433606178d-tmp\") pod \"klusterlet-addon-workmgr-94b9dbc96-kllzv\" (UID: \"eb50603e-5e95-4271-8dbe-ac433606178d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:35.537530 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.537504    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb50603e-5e95-4271-8dbe-ac433606178d-tmp\") pod \"klusterlet-addon-workmgr-94b9dbc96-kllzv\" (UID: \"eb50603e-5e95-4271-8dbe-ac433606178d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:35.537893 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.537871    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4df8a922-ba01-4b4a-8e71-15439b7e005d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.539552 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.539531    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.539877 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.539859    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-ca\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.539948 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.539925    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-hub\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.539985 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.539959    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eb50603e-5e95-4271-8dbe-ac433606178d-klusterlet-config\") pod \"klusterlet-addon-workmgr-94b9dbc96-kllzv\" (UID: \"eb50603e-5e95-4271-8dbe-ac433606178d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:35.540160 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.540140    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4df8a922-ba01-4b4a-8e71-15439b7e005d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.546669 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.546646    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr6n7\" (UniqueName: \"kubernetes.io/projected/4df8a922-ba01-4b4a-8e71-15439b7e005d-kube-api-access-qr6n7\") pod \"cluster-proxy-proxy-agent-54c49d578d-wrf2h\" (UID: \"4df8a922-ba01-4b4a-8e71-15439b7e005d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.547792 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.547770    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbb8q\" (UniqueName: \"kubernetes.io/projected/eb50603e-5e95-4271-8dbe-ac433606178d-kube-api-access-hbb8q\") pod \"klusterlet-addon-workmgr-94b9dbc96-kllzv\" (UID: \"eb50603e-5e95-4271-8dbe-ac433606178d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:35.584139 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.584119    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:35.609254 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.609232    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"
Sep 06 00:51:35.887022 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.886947    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"]
Sep 06 00:51:35.889722 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:35.889697    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb50603e_5e95_4271_8dbe_ac433606178d.slice/crio-1675245f046a0e330ed28b63ab0db6250a3c6d3a0fb3d36cdd778edcf62f81c3 WatchSource:0}: Error finding container 1675245f046a0e330ed28b63ab0db6250a3c6d3a0fb3d36cdd778edcf62f81c3: Status 404 returned error can't find the container with id 1675245f046a0e330ed28b63ab0db6250a3c6d3a0fb3d36cdd778edcf62f81c3
Sep 06 00:51:35.930028 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:35.930003    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h"]
Sep 06 00:51:35.934168 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:35.934144    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4df8a922_ba01_4b4a_8e71_15439b7e005d.slice/crio-9fdfc7372e6da8d218779a3f36b809a6236307718981d282da014eb00d481a07 WatchSource:0}: Error finding container 9fdfc7372e6da8d218779a3f36b809a6236307718981d282da014eb00d481a07: Status 404 returned error can't find the container with id 9fdfc7372e6da8d218779a3f36b809a6236307718981d282da014eb00d481a07
Sep 06 00:51:36.451037 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:36.451001    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv" event={"ID":"eb50603e-5e95-4271-8dbe-ac433606178d","Type":"ContainerStarted","Data":"1675245f046a0e330ed28b63ab0db6250a3c6d3a0fb3d36cdd778edcf62f81c3"}
Sep 06 00:51:36.452135 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:36.452111    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h" event={"ID":"4df8a922-ba01-4b4a-8e71-15439b7e005d","Type":"ContainerStarted","Data":"9fdfc7372e6da8d218779a3f36b809a6236307718981d282da014eb00d481a07"}
Sep 06 00:51:38.416493 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:38.416249    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-66gtb"
Sep 06 00:51:40.980599 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:40.980568    2548 scope.go:117] "RemoveContainer" containerID="88274a806c9da7e10da21792e76b7a3dda8c274a8cc71f6356e6257dfbbd876d"
Sep 06 00:51:40.981042 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:51:40.980794    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-pzkqj_openshift-console-operator(487de660-0766-4387-9351-63c22a95dd79)\"" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" podUID="487de660-0766-4387-9351-63c22a95dd79"
Sep 06 00:51:42.486162 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:42.486129    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv" event={"ID":"eb50603e-5e95-4271-8dbe-ac433606178d","Type":"ContainerStarted","Data":"1c628be8b0278f6f72cbb2a00ebd3fd9c34964df4c5c7eea384548a59643097e"}
Sep 06 00:51:42.486634 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:42.486325    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:42.488342 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:42.488317    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv"
Sep 06 00:51:42.488756 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:42.488692    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h" event={"ID":"4df8a922-ba01-4b4a-8e71-15439b7e005d","Type":"ContainerStarted","Data":"64a140aecfd525b24a82cd99b592fc720b19b69ae13c90f3d19a233d25d8c425"}
Sep 06 00:51:42.488756 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:42.488732    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h" event={"ID":"4df8a922-ba01-4b4a-8e71-15439b7e005d","Type":"ContainerStarted","Data":"bce3851f4dd084a51ca14a4a9da74b8e4c575a2cf86fb334eb409e4f6d451c86"}
Sep 06 00:51:42.488756 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:42.488756    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h" event={"ID":"4df8a922-ba01-4b4a-8e71-15439b7e005d","Type":"ContainerStarted","Data":"bd85be9ab76290a751913a413a33edb723b1db4fc0a5f6370f965ad8fb03b110"}
Sep 06 00:51:42.501202 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:42.501159    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-94b9dbc96-kllzv" podStartSLOduration=1.590440016 podStartE2EDuration="7.501145366s" totalImagesPullingTime="5.91070535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:42.500167007 +0000 UTC m=+83.033801336" watchObservedRunningTime="2026-09-06 00:51:42.501145366 +0000 UTC m=+83.034779693"
Sep 06 00:51:42.536982 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:42.536932    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c49d578d-wrf2h" podStartSLOduration=1.66850147 podStartE2EDuration="7.536919324s" totalImagesPullingTime="5.868417854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:42.535176216 +0000 UTC m=+83.068810550" watchObservedRunningTime="2026-09-06 00:51:42.536919324 +0000 UTC m=+83.070553651"
Sep 06 00:51:44.897379 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:44.897338    2548 patch_prober.go:28] interesting pod/image-registry-864659dbbd-wcx7r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 06 00:51:44.897849 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:44.897404    2548 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r" podUID="064e339b-b333-4667-9f51-0af255e62f11" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 00:51:45.424123 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.424090    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j4lzw"]
Sep 06 00:51:45.427686 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.427665    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.433183 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.433163    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 06 00:51:45.433597 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.433579    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 06 00:51:45.433745 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.433726    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 06 00:51:45.433877 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.433652    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pgq27\""
Sep 06 00:51:45.433985 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.433683    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 06 00:51:45.519083 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.519052    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70a74ad3-a00d-4261-98ff-087b229f72dd-sys\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.519083 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.519086    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7f99\" (UniqueName: \"kubernetes.io/projected/70a74ad3-a00d-4261-98ff-087b229f72dd-kube-api-access-k7f99\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.519315 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.519112    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-wtmp\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.519315 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.519144    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.519315 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.519200    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70a74ad3-a00d-4261-98ff-087b229f72dd-metrics-client-ca\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.519315 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.519241    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70a74ad3-a00d-4261-98ff-087b229f72dd-root\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.519315 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.519293    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-textfile\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.519509 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.519333    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-tls\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.519509 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.519366    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.619907 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.619877    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-wtmp\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.619907 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.619911    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620131 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.619932    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70a74ad3-a00d-4261-98ff-087b229f72dd-metrics-client-ca\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620131 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.619952    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70a74ad3-a00d-4261-98ff-087b229f72dd-root\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620131 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.619970    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-textfile\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620131 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.620002    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-tls\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620131 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.620019    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620131 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.620025    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70a74ad3-a00d-4261-98ff-087b229f72dd-root\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620131 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.620067    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70a74ad3-a00d-4261-98ff-087b229f72dd-sys\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620131 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.620059    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-wtmp\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620131 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.620098    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7f99\" (UniqueName: \"kubernetes.io/projected/70a74ad3-a00d-4261-98ff-087b229f72dd-kube-api-access-k7f99\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620604 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.620140    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70a74ad3-a00d-4261-98ff-087b229f72dd-sys\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620604 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.620451    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-textfile\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620729 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.620696    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70a74ad3-a00d-4261-98ff-087b229f72dd-metrics-client-ca\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.620781 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.620731    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.622455 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.622435    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-tls\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.622542 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.622477    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70a74ad3-a00d-4261-98ff-087b229f72dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.629964 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.629942    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7f99\" (UniqueName: \"kubernetes.io/projected/70a74ad3-a00d-4261-98ff-087b229f72dd-kube-api-access-k7f99\") pod \"node-exporter-j4lzw\" (UID: \"70a74ad3-a00d-4261-98ff-087b229f72dd\") " pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.739159 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:45.739127    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j4lzw"
Sep 06 00:51:45.751955 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:51:45.751930    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a74ad3_a00d_4261_98ff_087b229f72dd.slice/crio-a4ec4b26551b4fb7597ac96d12064ac9715f8db0904aad2fa8112d2ffe728041 WatchSource:0}: Error finding container a4ec4b26551b4fb7597ac96d12064ac9715f8db0904aad2fa8112d2ffe728041: Status 404 returned error can't find the container with id a4ec4b26551b4fb7597ac96d12064ac9715f8db0904aad2fa8112d2ffe728041
Sep 06 00:51:46.402123 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:46.401929    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:51:46.506190 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:46.506155    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j4lzw" event={"ID":"70a74ad3-a00d-4261-98ff-087b229f72dd","Type":"ContainerStarted","Data":"a4ec4b26551b4fb7597ac96d12064ac9715f8db0904aad2fa8112d2ffe728041"}
Sep 06 00:51:47.511879 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:47.511842    2548 generic.go:356] "Generic (PLEG): container finished" podID="70a74ad3-a00d-4261-98ff-087b229f72dd" containerID="63a8b84b27a9280c8f1714e2ac152accf7a34d9c3b7fca4b7a27f693e8205f3c" exitCode=0
Sep 06 00:51:47.512246 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:47.511929    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j4lzw" event={"ID":"70a74ad3-a00d-4261-98ff-087b229f72dd","Type":"ContainerDied","Data":"63a8b84b27a9280c8f1714e2ac152accf7a34d9c3b7fca4b7a27f693e8205f3c"}
Sep 06 00:51:48.519001 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:48.518965    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j4lzw" event={"ID":"70a74ad3-a00d-4261-98ff-087b229f72dd","Type":"ContainerStarted","Data":"cf428b983d2c10e8a868e0817feb8c306a0a8c920c20fda7df0a848ac3006a92"}
Sep 06 00:51:48.519402 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:48.519027    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j4lzw" event={"ID":"70a74ad3-a00d-4261-98ff-087b229f72dd","Type":"ContainerStarted","Data":"ae6c6023eeda5103834bd7127de2a07557b4e424de483eb92ee05c56b8bbd3ce"}
Sep 06 00:51:48.538704 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:48.538662    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j4lzw" podStartSLOduration=2.352126565 podStartE2EDuration="3.538647962s" totalImagesPullingTime="1.122947214s" totalInitContainerRuntime="63.574183ms" isStatefulPod=true podCreationTimestamp="2026-09-06 00:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:48.537598218 +0000 UTC m=+89.071232546" watchObservedRunningTime="2026-09-06 00:51:48.538647962 +0000 UTC m=+89.072282288"
Sep 06 00:51:52.981133 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:52.981104    2548 scope.go:117] "RemoveContainer" containerID="88274a806c9da7e10da21792e76b7a3dda8c274a8cc71f6356e6257dfbbd876d"
Sep 06 00:51:53.541059 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:53.541033    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 00:51:53.541248 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:53.541095    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" event={"ID":"487de660-0766-4387-9351-63c22a95dd79","Type":"ContainerStarted","Data":"883f23148f2a63b085efcff4d4b8e191761d820d75d63ed8173a0d98e48fb71d"}
Sep 06 00:51:53.541394 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:53.541374    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:51:53.559214 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:53.559159    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-pzkqj" podStartSLOduration=50.2434008 podStartE2EDuration="55.559144238s" totalImagesPullingTime="5.315743438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:53.557748942 +0000 UTC m=+94.091383268" watchObservedRunningTime="2026-09-06 00:51:53.559144238 +0000 UTC m=+94.092778603"
Sep 06 00:51:53.805875 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:53.805797    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-pzkqj"
Sep 06 00:51:57.671244 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:51:57.671206    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-864659dbbd-wcx7r"]
Sep 06 00:52:22.691809 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:22.691762    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r" podUID="064e339b-b333-4667-9f51-0af255e62f11" containerName="registry" containerID="cri-o://036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f" gracePeriod=30
Sep 06 00:52:22.937414 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:22.937389    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:52:23.025516 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.025483    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/064e339b-b333-4667-9f51-0af255e62f11-ca-trust-extracted\") pod \"064e339b-b333-4667-9f51-0af255e62f11\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") "
Sep 06 00:52:23.025516 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.025519    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-image-registry-private-configuration\") pod \"064e339b-b333-4667-9f51-0af255e62f11\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") "
Sep 06 00:52:23.025756 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.025536    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-bound-sa-token\") pod \"064e339b-b333-4667-9f51-0af255e62f11\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") "
Sep 06 00:52:23.025756 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.025564    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-trusted-ca\") pod \"064e339b-b333-4667-9f51-0af255e62f11\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") "
Sep 06 00:52:23.025756 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.025589    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2bd8\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-kube-api-access-c2bd8\") pod \"064e339b-b333-4667-9f51-0af255e62f11\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") "
Sep 06 00:52:23.025756 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.025633    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-registry-certificates\") pod \"064e339b-b333-4667-9f51-0af255e62f11\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") "
Sep 06 00:52:23.025756 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.025652    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-installation-pull-secrets\") pod \"064e339b-b333-4667-9f51-0af255e62f11\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") "
Sep 06 00:52:23.026004 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.025780    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls\") pod \"064e339b-b333-4667-9f51-0af255e62f11\" (UID: \"064e339b-b333-4667-9f51-0af255e62f11\") "
Sep 06 00:52:23.026058 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.026019    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "064e339b-b333-4667-9f51-0af255e62f11" (UID: "064e339b-b333-4667-9f51-0af255e62f11"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:52:23.026119 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.026073    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "064e339b-b333-4667-9f51-0af255e62f11" (UID: "064e339b-b333-4667-9f51-0af255e62f11"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:52:23.028110 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.028077    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "064e339b-b333-4667-9f51-0af255e62f11" (UID: "064e339b-b333-4667-9f51-0af255e62f11"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:52:23.028460 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.028432    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "064e339b-b333-4667-9f51-0af255e62f11" (UID: "064e339b-b333-4667-9f51-0af255e62f11"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:52:23.028460 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.028445    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-kube-api-access-c2bd8" (OuterVolumeSpecName: "kube-api-access-c2bd8") pod "064e339b-b333-4667-9f51-0af255e62f11" (UID: "064e339b-b333-4667-9f51-0af255e62f11"). InnerVolumeSpecName "kube-api-access-c2bd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:52:23.028597 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.028547    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "064e339b-b333-4667-9f51-0af255e62f11" (UID: "064e339b-b333-4667-9f51-0af255e62f11"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:52:23.028731 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.028696    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "064e339b-b333-4667-9f51-0af255e62f11" (UID: "064e339b-b333-4667-9f51-0af255e62f11"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:52:23.034005 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.033983    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/064e339b-b333-4667-9f51-0af255e62f11-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "064e339b-b333-4667-9f51-0af255e62f11" (UID: "064e339b-b333-4667-9f51-0af255e62f11"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 00:52:23.127339 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.127292    2548 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/064e339b-b333-4667-9f51-0af255e62f11-ca-trust-extracted\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 00:52:23.127339 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.127329    2548 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-image-registry-private-configuration\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 00:52:23.127601 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.127347    2548 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-bound-sa-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 00:52:23.127601 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.127363    2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-trusted-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 00:52:23.127601 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.127374    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2bd8\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-kube-api-access-c2bd8\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 00:52:23.127601 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.127386    2548 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/064e339b-b333-4667-9f51-0af255e62f11-registry-certificates\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 00:52:23.127601 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.127398    2548 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/064e339b-b333-4667-9f51-0af255e62f11-installation-pull-secrets\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 00:52:23.127601 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.127410    2548 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064e339b-b333-4667-9f51-0af255e62f11-registry-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 00:52:23.658683 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.658647    2548 generic.go:356] "Generic (PLEG): container finished" podID="064e339b-b333-4667-9f51-0af255e62f11" containerID="036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f" exitCode=0
Sep 06 00:52:23.658865 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.658706    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r"
Sep 06 00:52:23.658865 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.658732    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r" event={"ID":"064e339b-b333-4667-9f51-0af255e62f11","Type":"ContainerDied","Data":"036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f"}
Sep 06 00:52:23.658865 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.658803    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-864659dbbd-wcx7r" event={"ID":"064e339b-b333-4667-9f51-0af255e62f11","Type":"ContainerDied","Data":"b8630c9cb66fab8921c0985b5f12b85875b157660c09b0e6854d97380b1258e0"}
Sep 06 00:52:23.658865 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.658824    2548 scope.go:117] "RemoveContainer" containerID="036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f"
Sep 06 00:52:23.667580 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.667564    2548 scope.go:117] "RemoveContainer" containerID="036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f"
Sep 06 00:52:23.667866 ip-10-0-130-34 kubenswrapper[2548]: E0906 00:52:23.667846    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f\": container with ID starting with 036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f not found: ID does not exist" containerID="036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f"
Sep 06 00:52:23.667931 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.667879    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f"} err="failed to get container status \"036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f\": rpc error: code = NotFound desc = could not find container \"036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f\": container with ID starting with 036e4ecaeb01bc9b5f7080bb671e1a2b01007680e2055d6293e5e525576f661f not found: ID does not exist"
Sep 06 00:52:23.679772 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.679745    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-864659dbbd-wcx7r"]
Sep 06 00:52:23.683522 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.683481    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-864659dbbd-wcx7r"]
Sep 06 00:52:23.985041 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:23.985011    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="064e339b-b333-4667-9f51-0af255e62f11" path="/var/lib/kubelet/pods/064e339b-b333-4667-9f51-0af255e62f11/volumes"
Sep 06 00:52:27.676690 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:27.676661    2548 generic.go:356] "Generic (PLEG): container finished" podID="b30512c8-a402-4e9f-916d-77c29036c8ed" containerID="292467c01fe1c5eff68b9bb9c2a6fc51756af3de2dac898d110620d3a3fff0a0" exitCode=0
Sep 06 00:52:27.677059 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:27.676736    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kr428" event={"ID":"b30512c8-a402-4e9f-916d-77c29036c8ed","Type":"ContainerDied","Data":"292467c01fe1c5eff68b9bb9c2a6fc51756af3de2dac898d110620d3a3fff0a0"}
Sep 06 00:52:27.677103 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:27.677071    2548 scope.go:117] "RemoveContainer" containerID="292467c01fe1c5eff68b9bb9c2a6fc51756af3de2dac898d110620d3a3fff0a0"
Sep 06 00:52:28.684672 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:28.684629    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kr428" event={"ID":"b30512c8-a402-4e9f-916d-77c29036c8ed","Type":"ContainerStarted","Data":"e45ce12784965ef942f9035dce1c144983974f472ea0869d7492a04c0cac3b44"}
Sep 06 00:52:37.718666 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:37.718631    2548 generic.go:356] "Generic (PLEG): container finished" podID="5b23b0e5-3a15-48a5-843d-e837a905a68b" containerID="5bb149d332f639be08e7621d2f361155df1a1f07bf0d53c453721e280ca6bf2b" exitCode=0
Sep 06 00:52:37.719082 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:37.718703    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674" event={"ID":"5b23b0e5-3a15-48a5-843d-e837a905a68b","Type":"ContainerDied","Data":"5bb149d332f639be08e7621d2f361155df1a1f07bf0d53c453721e280ca6bf2b"}
Sep 06 00:52:37.719082 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:37.719064    2548 scope.go:117] "RemoveContainer" containerID="5bb149d332f639be08e7621d2f361155df1a1f07bf0d53c453721e280ca6bf2b"
Sep 06 00:52:37.720318 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:37.720297    2548 generic.go:356] "Generic (PLEG): container finished" podID="12870d88-2f67-4834-9643-71e9e8547131" containerID="b7ea58ee73b56779b7b4b372c74362b0d288a64eac5fad00eeec2fb665167404" exitCode=0
Sep 06 00:52:37.720418 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:37.720363    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk" event={"ID":"12870d88-2f67-4834-9643-71e9e8547131","Type":"ContainerDied","Data":"b7ea58ee73b56779b7b4b372c74362b0d288a64eac5fad00eeec2fb665167404"}
Sep 06 00:52:37.720613 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:37.720593    2548 scope.go:117] "RemoveContainer" containerID="b7ea58ee73b56779b7b4b372c74362b0d288a64eac5fad00eeec2fb665167404"
Sep 06 00:52:38.730795 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:38.730753    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-6q674" event={"ID":"5b23b0e5-3a15-48a5-843d-e837a905a68b","Type":"ContainerStarted","Data":"7558dba43a2f18ceb583b1bf72b2d46586ee045f1d40037908ec3ec93df6c4cc"}
Sep 06 00:52:38.732622 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:52:38.732598    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-sktdk" event={"ID":"12870d88-2f67-4834-9643-71e9e8547131","Type":"ContainerStarted","Data":"908934ecf20d33e6ab0c4fb7de7672607093d9c94548d2ee0484690124785ef4"}
Sep 06 00:55:19.891844 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:55:19.891818    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 00:55:19.894600 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:55:19.894578    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 00:55:19.908011 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:55:19.907990    2548 kubelet.go:1648] "Image garbage collection succeeded"
Sep 06 00:56:45.205898 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.205857    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"]
Sep 06 00:56:45.206525 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.206294    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064e339b-b333-4667-9f51-0af255e62f11" containerName="registry"
Sep 06 00:56:45.206525 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.206312    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="064e339b-b333-4667-9f51-0af255e62f11" containerName="registry"
Sep 06 00:56:45.206525 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.206412    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="064e339b-b333-4667-9f51-0af255e62f11" containerName="registry"
Sep 06 00:56:45.209574 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.209554    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.212452 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.212431    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fcj4z\""
Sep 06 00:56:45.212577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.212434    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 06 00:56:45.212577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.212461    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 06 00:56:45.212577 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.212569    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 06 00:56:45.212832 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.212817    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 06 00:56:45.226576 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.226554    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"]
Sep 06 00:56:45.327661 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.327628    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50d281dc-2b80-4bfd-95c1-90cd211df890-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.327827 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.327685    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ckt8\" (UniqueName: \"kubernetes.io/projected/50d281dc-2b80-4bfd-95c1-90cd211df890-kube-api-access-6ckt8\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.327827 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.327730    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50d281dc-2b80-4bfd-95c1-90cd211df890-webhook-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.327827 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.327750    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50d281dc-2b80-4bfd-95c1-90cd211df890-manifests\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.327827 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.327800    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50d281dc-2b80-4bfd-95c1-90cd211df890-tmp\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.429080 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.429043    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50d281dc-2b80-4bfd-95c1-90cd211df890-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.429223 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.429097    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ckt8\" (UniqueName: \"kubernetes.io/projected/50d281dc-2b80-4bfd-95c1-90cd211df890-kube-api-access-6ckt8\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.429223 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.429207    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50d281dc-2b80-4bfd-95c1-90cd211df890-webhook-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.429325 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.429249    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50d281dc-2b80-4bfd-95c1-90cd211df890-manifests\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.429325 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.429306    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50d281dc-2b80-4bfd-95c1-90cd211df890-tmp\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.429718 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.429687    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50d281dc-2b80-4bfd-95c1-90cd211df890-manifests\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.431610 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.431585    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50d281dc-2b80-4bfd-95c1-90cd211df890-tmp\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.431737 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.431720    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50d281dc-2b80-4bfd-95c1-90cd211df890-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.431778 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.431728    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50d281dc-2b80-4bfd-95c1-90cd211df890-webhook-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.437451 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.437432    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ckt8\" (UniqueName: \"kubernetes.io/projected/50d281dc-2b80-4bfd-95c1-90cd211df890-kube-api-access-6ckt8\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-wq62m\" (UID: \"50d281dc-2b80-4bfd-95c1-90cd211df890\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.519491 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.519402    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:45.799602 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.799572    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"]
Sep 06 00:56:45.802517 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:56:45.802492    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d281dc_2b80_4bfd_95c1_90cd211df890.slice/crio-2f1bbfeae30aa9a4ae1467609acbe5bc75b11fc72fa97e3d36574f711a82a67b WatchSource:0}: Error finding container 2f1bbfeae30aa9a4ae1467609acbe5bc75b11fc72fa97e3d36574f711a82a67b: Status 404 returned error can't find the container with id 2f1bbfeae30aa9a4ae1467609acbe5bc75b11fc72fa97e3d36574f711a82a67b
Sep 06 00:56:45.804215 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:45.804195    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 00:56:46.631995 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:46.631955    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m" event={"ID":"50d281dc-2b80-4bfd-95c1-90cd211df890","Type":"ContainerStarted","Data":"2f1bbfeae30aa9a4ae1467609acbe5bc75b11fc72fa97e3d36574f711a82a67b"}
Sep 06 00:56:49.648920 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:49.648879    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m" event={"ID":"50d281dc-2b80-4bfd-95c1-90cd211df890","Type":"ContainerStarted","Data":"c3bcd6fb348a8379154188fef125da3478b702ff70765d276f88dd47c4a07515"}
Sep 06 00:56:50.654688 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:50.654652    2548 generic.go:356] "Generic (PLEG): container finished" podID="50d281dc-2b80-4bfd-95c1-90cd211df890" containerID="c3bcd6fb348a8379154188fef125da3478b702ff70765d276f88dd47c4a07515" exitCode=0
Sep 06 00:56:50.655074 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:50.654715    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m" event={"ID":"50d281dc-2b80-4bfd-95c1-90cd211df890","Type":"ContainerDied","Data":"c3bcd6fb348a8379154188fef125da3478b702ff70765d276f88dd47c4a07515"}
Sep 06 00:56:51.660456 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:51.660420    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m" event={"ID":"50d281dc-2b80-4bfd-95c1-90cd211df890","Type":"ContainerStarted","Data":"9570077af685ad13c420b5d805bf23e6b1972d71f7133b5686f1717b8cd573ec"}
Sep 06 00:56:51.660844 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:51.660648    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:56:51.682076 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:56:51.682018    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m" podStartSLOduration=2.423265703 podStartE2EDuration="6.682001976s" totalImagesPullingTime="3.200311695s" totalInitContainerRuntime="1.058424578s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:56:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:56:51.680744424 +0000 UTC m=+392.214378755" watchObservedRunningTime="2026-09-06 00:56:51.682001976 +0000 UTC m=+392.215636304"
Sep 06 00:57:02.666492 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:02.666461    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-wq62m"
Sep 06 00:57:22.641378 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.641342    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"]
Sep 06 00:57:22.645974 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.645957    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.648693 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.648666    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 06 00:57:22.648832 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.648736    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bx6vm\""
Sep 06 00:57:22.648921 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.648909    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 06 00:57:22.648960 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.648943    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 06 00:57:22.649121 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.649103    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 00:57:22.657932 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.657911    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"]
Sep 06 00:57:22.739550 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.739504    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.739550 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.739552    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.739769 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.739584    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.739769 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.739642    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/596e62ff-429d-4787-ad66-39c5be7d28fd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.739769 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.739666    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spw25\" (UniqueName: \"kubernetes.io/projected/596e62ff-429d-4787-ad66-39c5be7d28fd-kube-api-access-spw25\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.739769 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.739683    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.739769 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.739738    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/596e62ff-429d-4787-ad66-39c5be7d28fd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.840597 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.840561    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.840788 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.840614    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.840788 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.840721    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/596e62ff-429d-4787-ad66-39c5be7d28fd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.840788 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.840759    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spw25\" (UniqueName: \"kubernetes.io/projected/596e62ff-429d-4787-ad66-39c5be7d28fd-kube-api-access-spw25\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.840788 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.840785    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.840994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.840824    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/596e62ff-429d-4787-ad66-39c5be7d28fd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.840994 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.840981    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.841642 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.841611    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.843030 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.842996    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/596e62ff-429d-4787-ad66-39c5be7d28fd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.843276 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.843248    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/596e62ff-429d-4787-ad66-39c5be7d28fd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.843325 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.843280    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.843325 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.843252    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.853590 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.849842    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/596e62ff-429d-4787-ad66-39c5be7d28fd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.853590 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.850304    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spw25\" (UniqueName: \"kubernetes.io/projected/596e62ff-429d-4787-ad66-39c5be7d28fd-kube-api-access-spw25\") pod \"istiod-openshift-gateway-5677ccb49b-rxxcs\" (UID: \"596e62ff-429d-4787-ad66-39c5be7d28fd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:22.955380 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:22.955355    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:23.236194 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:23.236100    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"]
Sep 06 00:57:23.244055 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:57:23.244021    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod596e62ff_429d_4787_ad66_39c5be7d28fd.slice/crio-064f35b414072c29d6696ab56f19a53b51af3413666cf41be6b2492499a45701 WatchSource:0}: Error finding container 064f35b414072c29d6696ab56f19a53b51af3413666cf41be6b2492499a45701: Status 404 returned error can't find the container with id 064f35b414072c29d6696ab56f19a53b51af3413666cf41be6b2492499a45701
Sep 06 00:57:23.792628 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:23.792584    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs" event={"ID":"596e62ff-429d-4787-ad66-39c5be7d28fd","Type":"ContainerStarted","Data":"064f35b414072c29d6696ab56f19a53b51af3413666cf41be6b2492499a45701"}
Sep 06 00:57:25.235161 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.235122    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"]
Sep 06 00:57:25.242484 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.242457    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.246414 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.246387    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 06 00:57:25.246553 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.246394    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hxwss\""
Sep 06 00:57:25.246553 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.246454    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 06 00:57:25.246553 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.246497    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 06 00:57:25.246703 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.246677    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 06 00:57:25.246761 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.246741    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 06 00:57:25.259757 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.259731    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"]
Sep 06 00:57:25.268371 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.268061    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m4s8\" (UniqueName: \"kubernetes.io/projected/e08a981f-640f-49df-90f1-dd70f16c08bc-kube-api-access-9m4s8\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.268371 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.268147    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e08a981f-640f-49df-90f1-dd70f16c08bc-cert\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.268371 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.268192    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e08a981f-640f-49df-90f1-dd70f16c08bc-manager-config\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.268371 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.268245    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e08a981f-640f-49df-90f1-dd70f16c08bc-metrics-cert\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.369098 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.369063    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e08a981f-640f-49df-90f1-dd70f16c08bc-metrics-cert\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.369304 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.369115    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m4s8\" (UniqueName: \"kubernetes.io/projected/e08a981f-640f-49df-90f1-dd70f16c08bc-kube-api-access-9m4s8\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.369304 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.369178    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e08a981f-640f-49df-90f1-dd70f16c08bc-cert\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.369304 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.369212    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e08a981f-640f-49df-90f1-dd70f16c08bc-manager-config\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.369972 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.369922    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e08a981f-640f-49df-90f1-dd70f16c08bc-manager-config\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.372098 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.372069    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e08a981f-640f-49df-90f1-dd70f16c08bc-cert\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.372350 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.372327    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e08a981f-640f-49df-90f1-dd70f16c08bc-metrics-cert\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.381930 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.381906    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m4s8\" (UniqueName: \"kubernetes.io/projected/e08a981f-640f-49df-90f1-dd70f16c08bc-kube-api-access-9m4s8\") pod \"lws-controller-manager-c79fd5646-rmk6r\" (UID: \"e08a981f-640f-49df-90f1-dd70f16c08bc\") " pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.554023 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.553940    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:25.636017 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.635536    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 00:57:25.636017 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.635637    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 06 00:57:25.805038 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.804940    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs" event={"ID":"596e62ff-429d-4787-ad66-39c5be7d28fd","Type":"ContainerStarted","Data":"78bfa37f8b3a08e868f0faefb6e673933bc02a8688685d4f4f26cc186d0b3c94"}
Sep 06 00:57:25.805038 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.805029    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:25.839454 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.839430    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"]
Sep 06 00:57:25.842046 ip-10-0-130-34 kubenswrapper[2548]: W0906 00:57:25.842007    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08a981f_640f_49df_90f1_dd70f16c08bc.slice/crio-2e387a55fb16bd32aab8e16d178e73aeaaadb5abb3ab9fdd21ff38c60283ed4c WatchSource:0}: Error finding container 2e387a55fb16bd32aab8e16d178e73aeaaadb5abb3ab9fdd21ff38c60283ed4c: Status 404 returned error can't find the container with id 2e387a55fb16bd32aab8e16d178e73aeaaadb5abb3ab9fdd21ff38c60283ed4c
Sep 06 00:57:25.843159 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:25.843117    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs" podStartSLOduration=1.454276554 podStartE2EDuration="3.843101604s" totalImagesPullingTime="2.38882505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:57:25.841034303 +0000 UTC m=+426.374668631" watchObservedRunningTime="2026-09-06 00:57:25.843101604 +0000 UTC m=+426.376735931"
Sep 06 00:57:26.815328 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:26.815219    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r" event={"ID":"e08a981f-640f-49df-90f1-dd70f16c08bc","Type":"ContainerStarted","Data":"2e387a55fb16bd32aab8e16d178e73aeaaadb5abb3ab9fdd21ff38c60283ed4c"}
Sep 06 00:57:26.817673 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:26.817645    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxxcs"
Sep 06 00:57:28.826598 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:28.826509    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r" event={"ID":"e08a981f-640f-49df-90f1-dd70f16c08bc","Type":"ContainerStarted","Data":"71f3cd5c1f070ad60b09d1a794b8dbb69e6fed66b4f9c0ce88edc6a05edf7d0d"}
Sep 06 00:57:28.827065 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:28.826606    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 00:57:28.862954 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:28.862892    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r" podStartSLOduration=1.22581767 podStartE2EDuration="3.862873086s" totalImagesPullingTime="2.637055416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:57:28.860920742 +0000 UTC m=+429.394555064" watchObservedRunningTime="2026-09-06 00:57:28.862873086 +0000 UTC m=+429.396507417"
Sep 06 00:57:39.833623 ip-10-0-130-34 kubenswrapper[2548]: I0906 00:57:39.833588    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c79fd5646-rmk6r"
Sep 06 01:00:14.874448 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:14.874413    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67b48bfc7b-pnm82"]
Sep 06 01:00:14.877564 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:14.877544    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:14.880362 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:14.880169    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 01:00:14.880362 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:14.880235    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 01:00:14.880362 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:14.880251    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sbh9p\""
Sep 06 01:00:14.880362 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:14.880312    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 01:00:14.893675 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:14.893648    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67b48bfc7b-pnm82"]
Sep 06 01:00:14.993037 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:14.992998    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:14.993037 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:14.993040    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjmkm\" (UniqueName: \"kubernetes.io/projected/398f3f13-8c93-4fca-b86d-4947eebf3d7a-kube-api-access-mjmkm\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:14.993290 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:14.993060    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-metrics-certs\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:15.049722 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.049688    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5545c7878f-x6kxb"]
Sep 06 01:00:15.052910 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.052889    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:15.063545 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.063507    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5545c7878f-x6kxb"]
Sep 06 01:00:15.094275 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.094224    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:15.094474 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.094280    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjmkm\" (UniqueName: \"kubernetes.io/projected/398f3f13-8c93-4fca-b86d-4947eebf3d7a-kube-api-access-mjmkm\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:15.094474 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.094323    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-metrics-certs\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:15.094474 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:15.094415    2548 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 06 01:00:15.094474 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:15.094476    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert podName:398f3f13-8c93-4fca-b86d-4947eebf3d7a nodeName:}" failed. No retries permitted until 2026-09-06 01:00:15.594457031 +0000 UTC m=+596.128091342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert") pod "maas-controller-67b48bfc7b-pnm82" (UID: "398f3f13-8c93-4fca-b86d-4947eebf3d7a") : secret "maas-controller-webhook-cert" not found
Sep 06 01:00:15.094686 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:15.094415    2548 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 06 01:00:15.094686 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:15.094599    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-metrics-certs podName:398f3f13-8c93-4fca-b86d-4947eebf3d7a nodeName:}" failed. No retries permitted until 2026-09-06 01:00:15.594578265 +0000 UTC m=+596.128212586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-metrics-certs") pod "maas-controller-67b48bfc7b-pnm82" (UID: "398f3f13-8c93-4fca-b86d-4947eebf3d7a") : secret "maas-controller-metrics-tls" not found
Sep 06 01:00:15.102841 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.102809    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjmkm\" (UniqueName: \"kubernetes.io/projected/398f3f13-8c93-4fca-b86d-4947eebf3d7a-kube-api-access-mjmkm\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:15.195541 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.195460    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwwx4\" (UniqueName: \"kubernetes.io/projected/5a771160-dc88-4ddc-97f4-7c79baccfd62-kube-api-access-qwwx4\") pod \"maas-controller-5545c7878f-x6kxb\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") " pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:15.195541 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.195497    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-metrics-certs\") pod \"maas-controller-5545c7878f-x6kxb\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") " pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:15.195724 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.195626    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-webhook-cert\") pod \"maas-controller-5545c7878f-x6kxb\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") " pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:15.296124 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.296082    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-webhook-cert\") pod \"maas-controller-5545c7878f-x6kxb\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") " pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:15.296364 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.296136    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwwx4\" (UniqueName: \"kubernetes.io/projected/5a771160-dc88-4ddc-97f4-7c79baccfd62-kube-api-access-qwwx4\") pod \"maas-controller-5545c7878f-x6kxb\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") " pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:15.296364 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.296165    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-metrics-certs\") pod \"maas-controller-5545c7878f-x6kxb\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") " pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:15.296364 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:15.296233    2548 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 06 01:00:15.296364 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:15.296336    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-webhook-cert podName:5a771160-dc88-4ddc-97f4-7c79baccfd62 nodeName:}" failed. No retries permitted until 2026-09-06 01:00:15.796317078 +0000 UTC m=+596.329951406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-webhook-cert") pod "maas-controller-5545c7878f-x6kxb" (UID: "5a771160-dc88-4ddc-97f4-7c79baccfd62") : secret "maas-controller-webhook-cert" not found
Sep 06 01:00:15.298726 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.298702    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-metrics-certs\") pod \"maas-controller-5545c7878f-x6kxb\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") " pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:15.307377 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.307348    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwwx4\" (UniqueName: \"kubernetes.io/projected/5a771160-dc88-4ddc-97f4-7c79baccfd62-kube-api-access-qwwx4\") pod \"maas-controller-5545c7878f-x6kxb\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") " pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:15.599527 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.599489    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:15.599527 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.599530    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-metrics-certs\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:15.599757 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:15.599643    2548 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 06 01:00:15.599757 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:15.599707    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert podName:398f3f13-8c93-4fca-b86d-4947eebf3d7a nodeName:}" failed. No retries permitted until 2026-09-06 01:00:16.599691033 +0000 UTC m=+597.133325344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert") pod "maas-controller-67b48bfc7b-pnm82" (UID: "398f3f13-8c93-4fca-b86d-4947eebf3d7a") : secret "maas-controller-webhook-cert" not found
Sep 06 01:00:15.602046 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.602017    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-metrics-certs\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:15.801599 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.801553    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-webhook-cert\") pod \"maas-controller-5545c7878f-x6kxb\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") " pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:15.803995 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.803975    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-webhook-cert\") pod \"maas-controller-5545c7878f-x6kxb\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") " pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:15.965088 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:15.965050    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:16.236735 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:16.236540    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5545c7878f-x6kxb"]
Sep 06 01:00:16.239391 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:00:16.239358    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a771160_dc88_4ddc_97f4_7c79baccfd62.slice/crio-833eed3d8793681611e849f563dcdaa6e7ff2e4ab75bf8df0ad6451ed0fac505 WatchSource:0}: Error finding container 833eed3d8793681611e849f563dcdaa6e7ff2e4ab75bf8df0ad6451ed0fac505: Status 404 returned error can't find the container with id 833eed3d8793681611e849f563dcdaa6e7ff2e4ab75bf8df0ad6451ed0fac505
Sep 06 01:00:16.542755 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:16.542672    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5545c7878f-x6kxb" event={"ID":"5a771160-dc88-4ddc-97f4-7c79baccfd62","Type":"ContainerStarted","Data":"833eed3d8793681611e849f563dcdaa6e7ff2e4ab75bf8df0ad6451ed0fac505"}
Sep 06 01:00:16.608863 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:16.608820    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:16.611344 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:16.611319    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert\") pod \"maas-controller-67b48bfc7b-pnm82\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") " pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:16.692454 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:16.692414    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:16.963368 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:16.963341    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67b48bfc7b-pnm82"]
Sep 06 01:00:16.965016 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:00:16.964986    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398f3f13_8c93_4fca_b86d_4947eebf3d7a.slice/crio-e69492ede317d56a748e55a05ea025f478b8977745ee3054044540d77cc719ef WatchSource:0}: Error finding container e69492ede317d56a748e55a05ea025f478b8977745ee3054044540d77cc719ef: Status 404 returned error can't find the container with id e69492ede317d56a748e55a05ea025f478b8977745ee3054044540d77cc719ef
Sep 06 01:00:17.551098 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:17.551005    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67b48bfc7b-pnm82" event={"ID":"398f3f13-8c93-4fca-b86d-4947eebf3d7a","Type":"ContainerStarted","Data":"e69492ede317d56a748e55a05ea025f478b8977745ee3054044540d77cc719ef"}
Sep 06 01:00:19.561405 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:19.561361    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5545c7878f-x6kxb" event={"ID":"5a771160-dc88-4ddc-97f4-7c79baccfd62","Type":"ContainerStarted","Data":"2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d"}
Sep 06 01:00:19.561845 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:19.561523    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:19.563001 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:19.562972    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67b48bfc7b-pnm82" event={"ID":"398f3f13-8c93-4fca-b86d-4947eebf3d7a","Type":"ContainerStarted","Data":"099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141"}
Sep 06 01:00:19.563111 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:19.563026    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:19.609921 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:19.609865    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5545c7878f-x6kxb" podStartSLOduration=1.673085565 podStartE2EDuration="4.609848398s" totalImagesPullingTime="2.936762833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:00:19.601788434 +0000 UTC m=+600.135422762" watchObservedRunningTime="2026-09-06 01:00:19.609848398 +0000 UTC m=+600.143482774"
Sep 06 01:00:19.650026 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:19.649966    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67b48bfc7b-pnm82" podStartSLOduration=3.428360318 podStartE2EDuration="5.649945027s" totalImagesPullingTime="2.221584709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:00:19.64898526 +0000 UTC m=+600.182619588" watchObservedRunningTime="2026-09-06 01:00:19.649945027 +0000 UTC m=+600.183579356"
Sep 06 01:00:19.924075 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:19.923989    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:00:19.924958 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:19.924934    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:00:30.570610 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:30.570572    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:00:30.571038 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:30.570655    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:30.636590 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:30.636553    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67b48bfc7b-pnm82"]
Sep 06 01:00:30.636808 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:30.636785    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-67b48bfc7b-pnm82" podUID="398f3f13-8c93-4fca-b86d-4947eebf3d7a" containerName="manager" containerID="cri-o://099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141" gracePeriod=30
Sep 06 01:00:30.885952 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:30.885915    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:30.942462 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:30.942422    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-metrics-certs\") pod \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") "
Sep 06 01:00:30.942657 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:30.942473    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert\") pod \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") "
Sep 06 01:00:30.942657 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:30.942511    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjmkm\" (UniqueName: \"kubernetes.io/projected/398f3f13-8c93-4fca-b86d-4947eebf3d7a-kube-api-access-mjmkm\") pod \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\" (UID: \"398f3f13-8c93-4fca-b86d-4947eebf3d7a\") "
Sep 06 01:00:30.944777 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:30.944745    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "398f3f13-8c93-4fca-b86d-4947eebf3d7a" (UID: "398f3f13-8c93-4fca-b86d-4947eebf3d7a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:00:30.944908 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:30.944841    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398f3f13-8c93-4fca-b86d-4947eebf3d7a-kube-api-access-mjmkm" (OuterVolumeSpecName: "kube-api-access-mjmkm") pod "398f3f13-8c93-4fca-b86d-4947eebf3d7a" (UID: "398f3f13-8c93-4fca-b86d-4947eebf3d7a"). InnerVolumeSpecName "kube-api-access-mjmkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:00:30.944908 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:30.944877    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "398f3f13-8c93-4fca-b86d-4947eebf3d7a" (UID: "398f3f13-8c93-4fca-b86d-4947eebf3d7a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:00:31.043640 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.043591    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:00:31.043640 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.043628    2548 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/398f3f13-8c93-4fca-b86d-4947eebf3d7a-webhook-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:00:31.043640 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.043640    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjmkm\" (UniqueName: \"kubernetes.io/projected/398f3f13-8c93-4fca-b86d-4947eebf3d7a-kube-api-access-mjmkm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:00:31.616294 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.616247    2548 generic.go:356] "Generic (PLEG): container finished" podID="398f3f13-8c93-4fca-b86d-4947eebf3d7a" containerID="099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141" exitCode=0
Sep 06 01:00:31.616693 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.616308    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67b48bfc7b-pnm82"
Sep 06 01:00:31.616693 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.616344    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67b48bfc7b-pnm82" event={"ID":"398f3f13-8c93-4fca-b86d-4947eebf3d7a","Type":"ContainerDied","Data":"099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141"}
Sep 06 01:00:31.616693 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.616411    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67b48bfc7b-pnm82" event={"ID":"398f3f13-8c93-4fca-b86d-4947eebf3d7a","Type":"ContainerDied","Data":"e69492ede317d56a748e55a05ea025f478b8977745ee3054044540d77cc719ef"}
Sep 06 01:00:31.616693 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.616444    2548 scope.go:117] "RemoveContainer" containerID="099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141"
Sep 06 01:00:31.625462 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.625441    2548 scope.go:117] "RemoveContainer" containerID="099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141"
Sep 06 01:00:31.625781 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:31.625763    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141\": container with ID starting with 099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141 not found: ID does not exist" containerID="099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141"
Sep 06 01:00:31.625846 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.625789    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141"} err="failed to get container status \"099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141\": rpc error: code = NotFound desc = could not find container \"099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141\": container with ID starting with 099f05e0a1b3efeebc36ff7f5c8b672baf9f6180cd9cec18f4638bc847304141 not found: ID does not exist"
Sep 06 01:00:31.641403 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.641367    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67b48bfc7b-pnm82"]
Sep 06 01:00:31.644016 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.643984    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67b48bfc7b-pnm82"]
Sep 06 01:00:31.654927 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:31.654893    2548 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398f3f13_8c93_4fca_b86d_4947eebf3d7a.slice/crio-e69492ede317d56a748e55a05ea025f478b8977745ee3054044540d77cc719ef\": RecentStats: unable to find data in memory cache]"
Sep 06 01:00:31.986209 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:31.986171    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="398f3f13-8c93-4fca-b86d-4947eebf3d7a" path="/var/lib/kubelet/pods/398f3f13-8c93-4fca-b86d-4947eebf3d7a/volumes"
Sep 06 01:00:50.355426 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.355350    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"]
Sep 06 01:00:50.355884 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.355672    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398f3f13-8c93-4fca-b86d-4947eebf3d7a" containerName="manager"
Sep 06 01:00:50.355884 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.355684    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="398f3f13-8c93-4fca-b86d-4947eebf3d7a" containerName="manager"
Sep 06 01:00:50.355884 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.355759    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="398f3f13-8c93-4fca-b86d-4947eebf3d7a" containerName="manager"
Sep 06 01:00:50.358720 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.358699    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:50.362083 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.362058    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 06 01:00:50.362861 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.362839    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 06 01:00:50.362971 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.362862    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:00:50.362971 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.362903    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 06 01:00:50.362971 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.362911    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vb24r\""
Sep 06 01:00:50.368838 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.368815    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"]
Sep 06 01:00:50.405480 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.405436    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc42c3d4-a0d4-4537-88c5-94f097328384-openshift-service-ca\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:50.405668 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.405510    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjlsk\" (UniqueName: \"kubernetes.io/projected/dc42c3d4-a0d4-4537-88c5-94f097328384-kube-api-access-jjlsk\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:50.405668 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.405536    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:50.405668 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.405565    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-maas-api-tls\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:50.506342 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.506303    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlsk\" (UniqueName: \"kubernetes.io/projected/dc42c3d4-a0d4-4537-88c5-94f097328384-kube-api-access-jjlsk\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:50.506536 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.506349    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:50.506536 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:50.506455    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 06 01:00:50.506536 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:50.506521    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs podName:dc42c3d4-a0d4-4537-88c5-94f097328384 nodeName:}" failed. No retries permitted until 2026-09-06 01:00:51.006502183 +0000 UTC m=+631.540136512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs") pod "maas-api-7b97c6dbfb-gtgq2" (UID: "dc42c3d4-a0d4-4537-88c5-94f097328384") : secret "maas-api-metrics-tls" not found
Sep 06 01:00:50.506536 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.506536    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-maas-api-tls\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:50.506744 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.506608    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc42c3d4-a0d4-4537-88c5-94f097328384-openshift-service-ca\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:50.507276 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.507239    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc42c3d4-a0d4-4537-88c5-94f097328384-openshift-service-ca\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:50.509137 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.509109    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-maas-api-tls\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:50.514992 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:50.514962    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjlsk\" (UniqueName: \"kubernetes.io/projected/dc42c3d4-a0d4-4537-88c5-94f097328384-kube-api-access-jjlsk\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:51.011976 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:51.011936    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:51.012196 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:51.012097    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 06 01:00:51.012196 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:00:51.012166    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs podName:dc42c3d4-a0d4-4537-88c5-94f097328384 nodeName:}" failed. No retries permitted until 2026-09-06 01:00:52.012149835 +0000 UTC m=+632.545784146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs") pod "maas-api-7b97c6dbfb-gtgq2" (UID: "dc42c3d4-a0d4-4537-88c5-94f097328384") : secret "maas-api-metrics-tls" not found
Sep 06 01:00:52.019217 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:52.019177    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:52.021738 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:52.021713    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs\") pod \"maas-api-7b97c6dbfb-gtgq2\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:52.172826 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:52.172793    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:52.451606 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:52.451583    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"]
Sep 06 01:00:52.453921 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:00:52.453885    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc42c3d4_a0d4_4537_88c5_94f097328384.slice/crio-5520b9ddd36458d6eba5f658047b112cdea0ec647179af391983d3ae23c09e9c WatchSource:0}: Error finding container 5520b9ddd36458d6eba5f658047b112cdea0ec647179af391983d3ae23c09e9c: Status 404 returned error can't find the container with id 5520b9ddd36458d6eba5f658047b112cdea0ec647179af391983d3ae23c09e9c
Sep 06 01:00:52.710807 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:52.710772    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2" event={"ID":"dc42c3d4-a0d4-4537-88c5-94f097328384","Type":"ContainerStarted","Data":"5520b9ddd36458d6eba5f658047b112cdea0ec647179af391983d3ae23c09e9c"}
Sep 06 01:00:54.720880 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:54.720838    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2" event={"ID":"dc42c3d4-a0d4-4537-88c5-94f097328384","Type":"ContainerStarted","Data":"4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9"}
Sep 06 01:00:54.721355 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:54.720917    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:00:54.741829 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:00:54.741776    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2" podStartSLOduration=3.328769382 podStartE2EDuration="4.741760222s" totalImagesPullingTime="1.41299084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:00:54.739400297 +0000 UTC m=+635.273034641" watchObservedRunningTime="2026-09-06 01:00:54.741760222 +0000 UTC m=+635.275394552"
Sep 06 01:01:00.731910 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:00.731879    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:01:10.358285 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.358233    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"]
Sep 06 01:01:10.361572 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.361554    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.365003 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.364979    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 06 01:01:10.365177 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.365091    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 06 01:01:10.365251 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.365221    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pg77g\""
Sep 06 01:01:10.365251 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.365110    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 06 01:01:10.372180 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.372158    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"]
Sep 06 01:01:10.487254 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.487197    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.487455 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.487300    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.487455 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.487334    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.487455 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.487373    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.487455 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.487406    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.487455 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.487425    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhspw\" (UniqueName: \"kubernetes.io/projected/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-kube-api-access-rhspw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.588690 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.588640    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.588897 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.588709    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.588897 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.588732    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhspw\" (UniqueName: \"kubernetes.io/projected/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-kube-api-access-rhspw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.588897 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.588761    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.588897 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.588802    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.588897 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.588831    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.589346 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.589326    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.589421 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.589361    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.589421 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.589391    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.591050 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.591028    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.591183 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.591166    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.601040 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.601008    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhspw\" (UniqueName: \"kubernetes.io/projected/08218d28-a5a8-4fe6-a406-fb4ca3b201c2-kube-api-access-rhspw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf\" (UID: \"08218d28-a5a8-4fe6-a406-fb4ca3b201c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.672552 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.672468    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:10.946481 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:10.946454    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"]
Sep 06 01:01:10.948692 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:01:10.948659    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08218d28_a5a8_4fe6_a406_fb4ca3b201c2.slice/crio-77729b9484d831c7d637520539fb3903feb115ca862a7f9c8a45446c6a49108f WatchSource:0}: Error finding container 77729b9484d831c7d637520539fb3903feb115ca862a7f9c8a45446c6a49108f: Status 404 returned error can't find the container with id 77729b9484d831c7d637520539fb3903feb115ca862a7f9c8a45446c6a49108f
Sep 06 01:01:11.800663 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:11.800626    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf" event={"ID":"08218d28-a5a8-4fe6-a406-fb4ca3b201c2","Type":"ContainerStarted","Data":"77729b9484d831c7d637520539fb3903feb115ca862a7f9c8a45446c6a49108f"}
Sep 06 01:01:12.807049 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:12.806992    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf" event={"ID":"08218d28-a5a8-4fe6-a406-fb4ca3b201c2","Type":"ContainerStarted","Data":"037a362891d0769ece1266379f5374e3eb6bb1b0ce2246590e4d5ecc0fd0fa4a"}
Sep 06 01:01:12.825877 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:12.825824    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf" podStartSLOduration=1.775402876 podStartE2EDuration="2.825808121s" totalImagesPullingTime="1.050405245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:01:12.823315392 +0000 UTC m=+653.356949719" watchObservedRunningTime="2026-09-06 01:01:12.825808121 +0000 UTC m=+653.359442449"
Sep 06 01:01:20.672760 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:20.672718    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:20.673170 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:20.672787    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:20.685234 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:20.685198    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:20.856057 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:20.856027    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf"
Sep 06 01:01:41.653371 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.653338    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"]
Sep 06 01:01:41.658158 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.658134    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.660607 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.660571    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 06 01:01:41.667791 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.667767    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"]
Sep 06 01:01:41.763760 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.763718    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.763949 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.763776    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.763949 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.763828    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.763949 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.763870    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e56f53fb-42ee-4d9c-8472-90f275b2465d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.763949 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.763896    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thfsl\" (UniqueName: \"kubernetes.io/projected/e56f53fb-42ee-4d9c-8472-90f275b2465d-kube-api-access-thfsl\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.763949 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.763917    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.864833 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.864801    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.865020 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.864848    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e56f53fb-42ee-4d9c-8472-90f275b2465d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.865020 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.864871    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thfsl\" (UniqueName: \"kubernetes.io/projected/e56f53fb-42ee-4d9c-8472-90f275b2465d-kube-api-access-thfsl\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.865020 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.864887    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.865020 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.864915    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.865020 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.864944    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.865309 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.865239    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.865309 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.865298    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.867479 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.865823    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.870509 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.870485    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e56f53fb-42ee-4d9c-8472-90f275b2465d-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.870919 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.870893    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e56f53fb-42ee-4d9c-8472-90f275b2465d-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.877723 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.877699    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thfsl\" (UniqueName: \"kubernetes.io/projected/e56f53fb-42ee-4d9c-8472-90f275b2465d-kube-api-access-thfsl\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg\" (UID: \"e56f53fb-42ee-4d9c-8472-90f275b2465d\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:41.970929 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:41.970889    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:42.245195 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:42.245166    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"]
Sep 06 01:01:42.247799 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:01:42.247775    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode56f53fb_42ee_4d9c_8472_90f275b2465d.slice/crio-bed4e547fc293a947a2810b3596542129d93911c3266882ce318381576701e4e WatchSource:0}: Error finding container bed4e547fc293a947a2810b3596542129d93911c3266882ce318381576701e4e: Status 404 returned error can't find the container with id bed4e547fc293a947a2810b3596542129d93911c3266882ce318381576701e4e
Sep 06 01:01:42.942896 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:42.942855    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg" event={"ID":"e56f53fb-42ee-4d9c-8472-90f275b2465d","Type":"ContainerStarted","Data":"3b16e21d51eb381528dfb129258b100de5c0ca54008c2eb20365b1e7d2220ced"}
Sep 06 01:01:42.943382 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:42.942927    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg" event={"ID":"e56f53fb-42ee-4d9c-8472-90f275b2465d","Type":"ContainerStarted","Data":"bed4e547fc293a947a2810b3596542129d93911c3266882ce318381576701e4e"}
Sep 06 01:01:42.961163 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:42.961106    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg" podStartSLOduration=1.7866117670000001 podStartE2EDuration="1.961088661s" totalImagesPullingTime="174.476894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:01:42.959215383 +0000 UTC m=+683.492849710" watchObservedRunningTime="2026-09-06 01:01:42.961088661 +0000 UTC m=+683.494722989"
Sep 06 01:01:51.971217 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:51.971179    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:51.971630 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:51.971255    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:51.985916 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:51.985887    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:01:51.997216 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:01:51.997190    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg"
Sep 06 01:04:30.530659 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.530622    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"]
Sep 06 01:04:30.534691 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.534665    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:30.537371 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.537336    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-701b5b-serving-cert\""
Sep 06 01:04:30.543975 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.543948    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"]
Sep 06 01:04:30.624546 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.624503    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mzjm\" (UniqueName: \"kubernetes.io/projected/a5561830-66cd-48a3-b5fe-91bf1642075e-kube-api-access-4mzjm\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:30.624732 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.624555    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:30.624732 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.624630    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5561830-66cd-48a3-b5fe-91bf1642075e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:30.624732 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.624680    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-metrics-certs\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:30.725278 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.725221    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mzjm\" (UniqueName: \"kubernetes.io/projected/a5561830-66cd-48a3-b5fe-91bf1642075e-kube-api-access-4mzjm\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:30.725278 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.725277    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:30.725550 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.725331    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5561830-66cd-48a3-b5fe-91bf1642075e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:30.725550 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.725351    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-metrics-certs\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:30.725550 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:04:30.725463    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-serving-cert: secret "maas-api-e2e-inf-a-701b5b-serving-cert" not found
Sep 06 01:04:30.725699 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:04:30.725556    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls podName:a5561830-66cd-48a3-b5fe-91bf1642075e nodeName:}" failed. No retries permitted until 2026-09-06 01:04:31.225531994 +0000 UTC m=+851.759166318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls") pod "maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6" (UID: "a5561830-66cd-48a3-b5fe-91bf1642075e") : secret "maas-api-e2e-inf-a-701b5b-serving-cert" not found
Sep 06 01:04:30.726234 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.726202    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5561830-66cd-48a3-b5fe-91bf1642075e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:30.728275 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.728230    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-metrics-certs\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:30.734155 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:30.734126    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mzjm\" (UniqueName: \"kubernetes.io/projected/a5561830-66cd-48a3-b5fe-91bf1642075e-kube-api-access-4mzjm\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:31.229659 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:31.229626    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:31.229860 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:04:31.229783    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-serving-cert: secret "maas-api-e2e-inf-a-701b5b-serving-cert" not found
Sep 06 01:04:31.229860 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:04:31.229847    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls podName:a5561830-66cd-48a3-b5fe-91bf1642075e nodeName:}" failed. No retries permitted until 2026-09-06 01:04:32.229832568 +0000 UTC m=+852.763466874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls") pod "maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6" (UID: "a5561830-66cd-48a3-b5fe-91bf1642075e") : secret "maas-api-e2e-inf-a-701b5b-serving-cert" not found
Sep 06 01:04:32.239661 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:32.239613    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:32.242112 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:32.242089    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls\") pod \"maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:32.348435 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:32.348392    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:32.636413 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:32.636378    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"]
Sep 06 01:04:32.638162 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:04:32.638136    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5561830_66cd_48a3_b5fe_91bf1642075e.slice/crio-823376505afd507209ca2b8d2ef897f62807b93781c6b70566e39adfa0ea8174 WatchSource:0}: Error finding container 823376505afd507209ca2b8d2ef897f62807b93781c6b70566e39adfa0ea8174: Status 404 returned error can't find the container with id 823376505afd507209ca2b8d2ef897f62807b93781c6b70566e39adfa0ea8174
Sep 06 01:04:32.639414 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:32.639396    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:04:32.698350 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:32.698308    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6" event={"ID":"a5561830-66cd-48a3-b5fe-91bf1642075e","Type":"ContainerStarted","Data":"823376505afd507209ca2b8d2ef897f62807b93781c6b70566e39adfa0ea8174"}
Sep 06 01:04:33.704102 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:33.704068    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6" event={"ID":"a5561830-66cd-48a3-b5fe-91bf1642075e","Type":"ContainerStarted","Data":"1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4"}
Sep 06 01:04:33.704538 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:33.704243    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:33.738109 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:33.738050    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6" podStartSLOduration=3.215525296 podStartE2EDuration="3.7380329s" totalImagesPullingTime="522.507604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:04:33.736793413 +0000 UTC m=+854.270427742" watchObservedRunningTime="2026-09-06 01:04:33.7380329 +0000 UTC m=+854.271667227"
Sep 06 01:04:39.714139 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:39.714102    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:04:40.046660 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.046566    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"]
Sep 06 01:04:40.051442 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.051416    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.065541 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.065519    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d3f8b122-serving-cert\""
Sep 06 01:04:40.067469 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.067435    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"]
Sep 06 01:04:40.210203 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.210166    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-metrics-certs\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.210203 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.210214    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-maas-api-tls\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.210484 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.210289    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef6482f9-2749-4234-9811-ffcefce4f9d0-openshift-service-ca\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.210484 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.210328    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkzx8\" (UniqueName: \"kubernetes.io/projected/ef6482f9-2749-4234-9811-ffcefce4f9d0-kube-api-access-xkzx8\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.311613 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.311533    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-metrics-certs\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.311613 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.311577    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-maas-api-tls\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.311838 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.311619    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef6482f9-2749-4234-9811-ffcefce4f9d0-openshift-service-ca\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.311838 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.311657    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkzx8\" (UniqueName: \"kubernetes.io/projected/ef6482f9-2749-4234-9811-ffcefce4f9d0-kube-api-access-xkzx8\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.311838 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:04:40.311753    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-serving-cert: secret "maas-api-e2e-ait-d3f8b122-serving-cert" not found
Sep 06 01:04:40.311838 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:04:40.311825    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-maas-api-tls podName:ef6482f9-2749-4234-9811-ffcefce4f9d0 nodeName:}" failed. No retries permitted until 2026-09-06 01:04:40.811804666 +0000 UTC m=+861.345438976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-maas-api-tls") pod "maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb" (UID: "ef6482f9-2749-4234-9811-ffcefce4f9d0") : secret "maas-api-e2e-ait-d3f8b122-serving-cert" not found
Sep 06 01:04:40.312383 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.312358    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef6482f9-2749-4234-9811-ffcefce4f9d0-openshift-service-ca\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.314023 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.314000    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-metrics-certs\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.322856 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.322832    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkzx8\" (UniqueName: \"kubernetes.io/projected/ef6482f9-2749-4234-9811-ffcefce4f9d0-kube-api-access-xkzx8\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.814854 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.814815    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-maas-api-tls\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.817405 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.817379    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-maas-api-tls\") pod \"maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:40.962976 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:40.962936    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:41.243874 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.243848    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"]
Sep 06 01:04:41.246391 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:04:41.246357    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6482f9_2749_4234_9811_ffcefce4f9d0.slice/crio-f81dd03e9f4ecdd5d510709dc68a5c59b3ed120c5edfd3d7136ef22ae9ebbd8d WatchSource:0}: Error finding container f81dd03e9f4ecdd5d510709dc68a5c59b3ed120c5edfd3d7136ef22ae9ebbd8d: Status 404 returned error can't find the container with id f81dd03e9f4ecdd5d510709dc68a5c59b3ed120c5edfd3d7136ef22ae9ebbd8d
Sep 06 01:04:41.445785 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.445749    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"]
Sep 06 01:04:41.450955 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.450903    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.454461 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.454440    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-639343-serving-cert\""
Sep 06 01:04:41.465713 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.465681    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"]
Sep 06 01:04:41.622779 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.622688    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-metrics-certs\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.622779 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.622735    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-maas-api-tls\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.622779 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.622772    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wmfk\" (UniqueName: \"kubernetes.io/projected/812347e6-951d-4fe8-b78b-094886784463-kube-api-access-6wmfk\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.623000 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.622895    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/812347e6-951d-4fe8-b78b-094886784463-openshift-service-ca\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.723639 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.723610    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/812347e6-951d-4fe8-b78b-094886784463-openshift-service-ca\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.723749 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.723669    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-metrics-certs\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.723749 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.723701    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-maas-api-tls\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.723838 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.723746    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wmfk\" (UniqueName: \"kubernetes.io/projected/812347e6-951d-4fe8-b78b-094886784463-kube-api-access-6wmfk\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.724343 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.724320    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/812347e6-951d-4fe8-b78b-094886784463-openshift-service-ca\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.726049 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.726030    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-maas-api-tls\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.726300 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.726259    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-metrics-certs\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.743717 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.743682    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb" event={"ID":"ef6482f9-2749-4234-9811-ffcefce4f9d0","Type":"ContainerStarted","Data":"751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d"}
Sep 06 01:04:41.743860 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.743743    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb" event={"ID":"ef6482f9-2749-4234-9811-ffcefce4f9d0","Type":"ContainerStarted","Data":"f81dd03e9f4ecdd5d510709dc68a5c59b3ed120c5edfd3d7136ef22ae9ebbd8d"}
Sep 06 01:04:41.743919 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.743884    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:41.745792 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.745770    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wmfk\" (UniqueName: \"kubernetes.io/projected/812347e6-951d-4fe8-b78b-094886784463-kube-api-access-6wmfk\") pod \"maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.762744 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.762722    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:41.849278 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:41.849209    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb" podStartSLOduration=1.444025041 podStartE2EDuration="1.849193406s" totalImagesPullingTime="405.168365ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:04:41.841176169 +0000 UTC m=+862.374810498" watchObservedRunningTime="2026-09-06 01:04:41.849193406 +0000 UTC m=+862.382827733"
Sep 06 01:04:42.064566 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:42.064528    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"]
Sep 06 01:04:42.067472 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:04:42.067443    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812347e6_951d_4fe8_b78b_094886784463.slice/crio-813536441c44235aef9c956235f9fd6c0463f96e8f135dc37c51b3192fe34d5f WatchSource:0}: Error finding container 813536441c44235aef9c956235f9fd6c0463f96e8f135dc37c51b3192fe34d5f: Status 404 returned error can't find the container with id 813536441c44235aef9c956235f9fd6c0463f96e8f135dc37c51b3192fe34d5f
Sep 06 01:04:42.750210 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:42.750172    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9" event={"ID":"812347e6-951d-4fe8-b78b-094886784463","Type":"ContainerStarted","Data":"20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0"}
Sep 06 01:04:42.750412 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:42.750227    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9" event={"ID":"812347e6-951d-4fe8-b78b-094886784463","Type":"ContainerStarted","Data":"813536441c44235aef9c956235f9fd6c0463f96e8f135dc37c51b3192fe34d5f"}
Sep 06 01:04:42.750412 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:42.750368    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:42.785574 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:42.785518    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9" podStartSLOduration=1.450752595 podStartE2EDuration="1.785499286s" totalImagesPullingTime="334.746691ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:04:42.782931635 +0000 UTC m=+863.316565963" watchObservedRunningTime="2026-09-06 01:04:42.785499286 +0000 UTC m=+863.319133613"
Sep 06 01:04:45.562188 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.562157    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"]
Sep 06 01:04:45.565809 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.565788    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.570033 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.570013    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-fbcd50d1-kserve-self-signed-certs\""
Sep 06 01:04:45.577699 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.577658    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"]
Sep 06 01:04:45.662711 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.662673    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2sqs\" (UniqueName: \"kubernetes.io/projected/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-kube-api-access-p2sqs\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.662925 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.662723    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tls-certs\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.662925 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.662824    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-dshm\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.662925 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.662862    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tmp-dir\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.662925 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.662914    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-model-cache\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.663112 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.663003    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-home\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.763507 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.763476    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-home\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.763678 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.763523    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2sqs\" (UniqueName: \"kubernetes.io/projected/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-kube-api-access-p2sqs\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.763678 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.763571    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tls-certs\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.763678 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.763615    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-dshm\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.763678 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.763637    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tmp-dir\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.763678 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.763669    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-model-cache\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.763961 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.763938    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-home\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.764029 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.763958    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-model-cache\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.764164 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.764142    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tmp-dir\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.766021 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.766003    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-dshm\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.766115 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.766096    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tls-certs\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.774003 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.773978    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2sqs\" (UniqueName: \"kubernetes.io/projected/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-kube-api-access-p2sqs\") pod \"e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") " pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:45.876126 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:45.876042    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:46.152097 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:46.152067    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"]
Sep 06 01:04:46.154751 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:04:46.154714    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bc8ec94_d8f9_4ede_b3da_f79d1e3386f4.slice/crio-413227a704105cd8a6d1626307c3b26943a09c299d15e6644f1f96866268ad1e WatchSource:0}: Error finding container 413227a704105cd8a6d1626307c3b26943a09c299d15e6644f1f96866268ad1e: Status 404 returned error can't find the container with id 413227a704105cd8a6d1626307c3b26943a09c299d15e6644f1f96866268ad1e
Sep 06 01:04:46.770162 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:46.770112    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj" event={"ID":"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4","Type":"ContainerStarted","Data":"859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d"}
Sep 06 01:04:46.770162 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:46.770167    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj" event={"ID":"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4","Type":"ContainerStarted","Data":"413227a704105cd8a6d1626307c3b26943a09c299d15e6644f1f96866268ad1e"}
Sep 06 01:04:46.802423 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:46.802322    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj" podStartSLOduration=1.802304777 podStartE2EDuration="1.802304777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:04:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:04:46.79966317 +0000 UTC m=+867.333297498" watchObservedRunningTime="2026-09-06 01:04:46.802304777 +0000 UTC m=+867.335939105"
Sep 06 01:04:47.756614 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:47.756584    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:04:48.760758 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:48.760727    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:04:55.876512 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:55.876466    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:55.876512 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:55.876520    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:55.889082 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:55.889053    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:56.831473 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:56.831444    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:04:59.611061 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.611029    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"]
Sep 06 01:04:59.614165 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.614148    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:04:59.617494 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.617462    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-8d5457-serving-cert\""
Sep 06 01:04:59.635493 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.635456    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"]
Sep 06 01:04:59.681031 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.681000    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-metrics-certs\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:04:59.681195 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.681037    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4njhj\" (UniqueName: \"kubernetes.io/projected/03c44a33-2116-48af-9f5c-c1a31b0902e6-kube-api-access-4njhj\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:04:59.681195 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.681129    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-maas-api-tls\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:04:59.681195 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.681187    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c44a33-2116-48af-9f5c-c1a31b0902e6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:04:59.782215 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.782170    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-metrics-certs\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:04:59.782436 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.782227    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4njhj\" (UniqueName: \"kubernetes.io/projected/03c44a33-2116-48af-9f5c-c1a31b0902e6-kube-api-access-4njhj\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:04:59.782436 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.782352    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-maas-api-tls\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:04:59.782436 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.782408    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c44a33-2116-48af-9f5c-c1a31b0902e6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:04:59.782612 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:04:59.782478    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-serving-cert: secret "maas-api-e2e-inf-b-8d5457-serving-cert" not found
Sep 06 01:04:59.782612 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:04:59.782551    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-maas-api-tls podName:03c44a33-2116-48af-9f5c-c1a31b0902e6 nodeName:}" failed. No retries permitted until 2026-09-06 01:05:00.282534638 +0000 UTC m=+880.816168948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-maas-api-tls") pod "maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft" (UID: "03c44a33-2116-48af-9f5c-c1a31b0902e6") : secret "maas-api-e2e-inf-b-8d5457-serving-cert" not found
Sep 06 01:04:59.783142 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.783121    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c44a33-2116-48af-9f5c-c1a31b0902e6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:04:59.784787 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.784763    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-metrics-certs\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:04:59.798801 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:04:59.798777    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4njhj\" (UniqueName: \"kubernetes.io/projected/03c44a33-2116-48af-9f5c-c1a31b0902e6-kube-api-access-4njhj\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:05:00.286040 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:00.286009    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-maas-api-tls\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:05:00.288413 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:00.288388    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-maas-api-tls\") pod \"maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:05:00.527299 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:00.527245    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:05:00.823318 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:00.823288    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"]
Sep 06 01:05:00.824324 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:05:00.824298    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c44a33_2116_48af_9f5c_c1a31b0902e6.slice/crio-4216a4cbf01e70f6c2efd8649ed806b6484410755fbbeed65fc494d6c62b41f3 WatchSource:0}: Error finding container 4216a4cbf01e70f6c2efd8649ed806b6484410755fbbeed65fc494d6c62b41f3: Status 404 returned error can't find the container with id 4216a4cbf01e70f6c2efd8649ed806b6484410755fbbeed65fc494d6c62b41f3
Sep 06 01:05:00.840185 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:00.840156    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft" event={"ID":"03c44a33-2116-48af-9f5c-c1a31b0902e6","Type":"ContainerStarted","Data":"4216a4cbf01e70f6c2efd8649ed806b6484410755fbbeed65fc494d6c62b41f3"}
Sep 06 01:05:01.846385 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:01.846351    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft" event={"ID":"03c44a33-2116-48af-9f5c-c1a31b0902e6","Type":"ContainerStarted","Data":"07965aedcda2058744240f73fd97b232b41179b5c71f5f02a91c138a5dfc3db5"}
Sep 06 01:05:01.846766 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:01.846470    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:05:01.866988 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:01.866925    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft" podStartSLOduration=2.369102011 podStartE2EDuration="2.866910252s" totalImagesPullingTime="497.808241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:05:01.864461371 +0000 UTC m=+882.398095698" watchObservedRunningTime="2026-09-06 01:05:01.866910252 +0000 UTC m=+882.400544580"
Sep 06 01:05:07.856628 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:07.856596    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:05:19.956112 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:19.956042    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:05:19.956679 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:19.956114    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:05:21.900352 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:21.900311    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"]
Sep 06 01:05:21.901008 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:21.900974    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb" podUID="ef6482f9-2749-4234-9811-ffcefce4f9d0" containerName="maas-api" containerID="cri-o://751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d" gracePeriod=30
Sep 06 01:05:22.157970 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.157903    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:05:22.293375 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.293337    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-metrics-certs\") pod \"ef6482f9-2749-4234-9811-ffcefce4f9d0\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") "
Sep 06 01:05:22.293558 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.293386    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkzx8\" (UniqueName: \"kubernetes.io/projected/ef6482f9-2749-4234-9811-ffcefce4f9d0-kube-api-access-xkzx8\") pod \"ef6482f9-2749-4234-9811-ffcefce4f9d0\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") "
Sep 06 01:05:22.293558 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.293426    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef6482f9-2749-4234-9811-ffcefce4f9d0-openshift-service-ca\") pod \"ef6482f9-2749-4234-9811-ffcefce4f9d0\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") "
Sep 06 01:05:22.293558 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.293453    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-maas-api-tls\") pod \"ef6482f9-2749-4234-9811-ffcefce4f9d0\" (UID: \"ef6482f9-2749-4234-9811-ffcefce4f9d0\") "
Sep 06 01:05:22.294052 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.294007    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef6482f9-2749-4234-9811-ffcefce4f9d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef6482f9-2749-4234-9811-ffcefce4f9d0" (UID: "ef6482f9-2749-4234-9811-ffcefce4f9d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:05:22.296227 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.296132    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef6482f9-2749-4234-9811-ffcefce4f9d0" (UID: "ef6482f9-2749-4234-9811-ffcefce4f9d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:05:22.296227 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.296185    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ef6482f9-2749-4234-9811-ffcefce4f9d0" (UID: "ef6482f9-2749-4234-9811-ffcefce4f9d0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:05:22.296414 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.296362    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef6482f9-2749-4234-9811-ffcefce4f9d0-kube-api-access-xkzx8" (OuterVolumeSpecName: "kube-api-access-xkzx8") pod "ef6482f9-2749-4234-9811-ffcefce4f9d0" (UID: "ef6482f9-2749-4234-9811-ffcefce4f9d0"). InnerVolumeSpecName "kube-api-access-xkzx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:05:22.394146 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.394112    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:05:22.394146 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.394151    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkzx8\" (UniqueName: \"kubernetes.io/projected/ef6482f9-2749-4234-9811-ffcefce4f9d0-kube-api-access-xkzx8\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:05:22.394367 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.394164    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef6482f9-2749-4234-9811-ffcefce4f9d0-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:05:22.394367 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.394176    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef6482f9-2749-4234-9811-ffcefce4f9d0-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:05:22.944165 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.944127    2548 generic.go:356] "Generic (PLEG): container finished" podID="ef6482f9-2749-4234-9811-ffcefce4f9d0" containerID="751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d" exitCode=0
Sep 06 01:05:22.944596 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.944181    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"
Sep 06 01:05:22.944596 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.944212    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb" event={"ID":"ef6482f9-2749-4234-9811-ffcefce4f9d0","Type":"ContainerDied","Data":"751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d"}
Sep 06 01:05:22.944596 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.944276    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb" event={"ID":"ef6482f9-2749-4234-9811-ffcefce4f9d0","Type":"ContainerDied","Data":"f81dd03e9f4ecdd5d510709dc68a5c59b3ed120c5edfd3d7136ef22ae9ebbd8d"}
Sep 06 01:05:22.944596 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.944303    2548 scope.go:117] "RemoveContainer" containerID="751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d"
Sep 06 01:05:22.954803 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.954783    2548 scope.go:117] "RemoveContainer" containerID="751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d"
Sep 06 01:05:22.955086 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:05:22.955066    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d\": container with ID starting with 751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d not found: ID does not exist" containerID="751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d"
Sep 06 01:05:22.955134 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.955096    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d"} err="failed to get container status \"751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d\": rpc error: code = NotFound desc = could not find container \"751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d\": container with ID starting with 751c2253f3774a18b649b4e3089c3fa0b34ae769b2093041a5f7a6493ca0666d not found: ID does not exist"
Sep 06 01:05:22.971727 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.971697    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"]
Sep 06 01:05:22.977367 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:22.977339    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d3f8b122-55775bc8c5-zvfwb"]
Sep 06 01:05:23.986915 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:23.986878    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef6482f9-2749-4234-9811-ffcefce4f9d0" path="/var/lib/kubelet/pods/ef6482f9-2749-4234-9811-ffcefce4f9d0/volumes"
Sep 06 01:05:27.423391 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.423353    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"]
Sep 06 01:05:27.423957 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.423935    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef6482f9-2749-4234-9811-ffcefce4f9d0" containerName="maas-api"
Sep 06 01:05:27.424039 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.423960    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef6482f9-2749-4234-9811-ffcefce4f9d0" containerName="maas-api"
Sep 06 01:05:27.424096 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.424053    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef6482f9-2749-4234-9811-ffcefce4f9d0" containerName="maas-api"
Sep 06 01:05:27.428984 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.428954    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:27.432063 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.432037    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-2460bb62-serving-cert\""
Sep 06 01:05:27.440915 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.440882    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"]
Sep 06 01:05:27.542119 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.542075    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9sl\" (UniqueName: \"kubernetes.io/projected/86b67a10-70df-4287-9c63-5ec053821ff5-kube-api-access-6l9sl\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:27.542119 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.542122    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b67a10-70df-4287-9c63-5ec053821ff5-openshift-service-ca\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:27.542394 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.542255    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-maas-api-tls\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:27.542394 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.542296    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-metrics-certs\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:27.643403 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.643365    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-maas-api-tls\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:27.643597 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.643414    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-metrics-certs\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:27.643597 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.643481    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9sl\" (UniqueName: \"kubernetes.io/projected/86b67a10-70df-4287-9c63-5ec053821ff5-kube-api-access-6l9sl\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:27.643597 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.643538    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b67a10-70df-4287-9c63-5ec053821ff5-openshift-service-ca\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:27.643805 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:05:27.643541    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-serving-cert: secret "maas-api-e2e-migrate-2460bb62-serving-cert" not found
Sep 06 01:05:27.643805 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:05:27.643669    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-maas-api-tls podName:86b67a10-70df-4287-9c63-5ec053821ff5 nodeName:}" failed. No retries permitted until 2026-09-06 01:05:28.143652734 +0000 UTC m=+908.677287046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-maas-api-tls") pod "maas-api-e2e-migrate-2460bb62-766744f95d-jwj29" (UID: "86b67a10-70df-4287-9c63-5ec053821ff5") : secret "maas-api-e2e-migrate-2460bb62-serving-cert" not found
Sep 06 01:05:27.644178 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.644155    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b67a10-70df-4287-9c63-5ec053821ff5-openshift-service-ca\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:27.646043 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.646023    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-metrics-certs\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:27.652043 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:27.652016    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9sl\" (UniqueName: \"kubernetes.io/projected/86b67a10-70df-4287-9c63-5ec053821ff5-kube-api-access-6l9sl\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:28.148565 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:28.148519    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-maas-api-tls\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:28.151149 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:28.151111    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-maas-api-tls\") pod \"maas-api-e2e-migrate-2460bb62-766744f95d-jwj29\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:28.342392 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:28.342348    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:28.631659 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:28.631587    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"]
Sep 06 01:05:28.634092 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:05:28.634060    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b67a10_70df_4287_9c63_5ec053821ff5.slice/crio-c09cc07bfcd425eb2fd4d18209eb25fe62aa8a284e48dfa4252810afb14969d9 WatchSource:0}: Error finding container c09cc07bfcd425eb2fd4d18209eb25fe62aa8a284e48dfa4252810afb14969d9: Status 404 returned error can't find the container with id c09cc07bfcd425eb2fd4d18209eb25fe62aa8a284e48dfa4252810afb14969d9
Sep 06 01:05:28.983521 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:28.983488    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29" event={"ID":"86b67a10-70df-4287-9c63-5ec053821ff5","Type":"ContainerStarted","Data":"c09cc07bfcd425eb2fd4d18209eb25fe62aa8a284e48dfa4252810afb14969d9"}
Sep 06 01:05:29.989429 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:29.989396    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29" event={"ID":"86b67a10-70df-4287-9c63-5ec053821ff5","Type":"ContainerStarted","Data":"e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9"}
Sep 06 01:05:29.989862 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:29.989519    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:30.009912 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:30.009847    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29" podStartSLOduration=2.677932847 podStartE2EDuration="3.009828072s" totalImagesPullingTime="331.895225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:05:30.007434476 +0000 UTC m=+910.541068805" watchObservedRunningTime="2026-09-06 01:05:30.009828072 +0000 UTC m=+910.543462399"
Sep 06 01:05:35.999681 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:35.999643    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:58.684890 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:58.684839    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"]
Sep 06 01:05:58.685497 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:58.685153    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29" podUID="86b67a10-70df-4287-9c63-5ec053821ff5" containerName="maas-api" containerID="cri-o://e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9" gracePeriod=30
Sep 06 01:05:58.940111 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:58.940043    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:59.019227 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.019188    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l9sl\" (UniqueName: \"kubernetes.io/projected/86b67a10-70df-4287-9c63-5ec053821ff5-kube-api-access-6l9sl\") pod \"86b67a10-70df-4287-9c63-5ec053821ff5\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") "
Sep 06 01:05:59.019543 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.019521    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b67a10-70df-4287-9c63-5ec053821ff5-openshift-service-ca\") pod \"86b67a10-70df-4287-9c63-5ec053821ff5\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") "
Sep 06 01:05:59.019781 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.019763    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-metrics-certs\") pod \"86b67a10-70df-4287-9c63-5ec053821ff5\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") "
Sep 06 01:05:59.019998 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.019853    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b67a10-70df-4287-9c63-5ec053821ff5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "86b67a10-70df-4287-9c63-5ec053821ff5" (UID: "86b67a10-70df-4287-9c63-5ec053821ff5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:05:59.020142 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.020125    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-maas-api-tls\") pod \"86b67a10-70df-4287-9c63-5ec053821ff5\" (UID: \"86b67a10-70df-4287-9c63-5ec053821ff5\") "
Sep 06 01:05:59.020902 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.020877    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86b67a10-70df-4287-9c63-5ec053821ff5-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:05:59.022759 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.022730    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "86b67a10-70df-4287-9c63-5ec053821ff5" (UID: "86b67a10-70df-4287-9c63-5ec053821ff5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:05:59.022874 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.022767    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b67a10-70df-4287-9c63-5ec053821ff5-kube-api-access-6l9sl" (OuterVolumeSpecName: "kube-api-access-6l9sl") pod "86b67a10-70df-4287-9c63-5ec053821ff5" (UID: "86b67a10-70df-4287-9c63-5ec053821ff5"). InnerVolumeSpecName "kube-api-access-6l9sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:05:59.023044 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.023008    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "86b67a10-70df-4287-9c63-5ec053821ff5" (UID: "86b67a10-70df-4287-9c63-5ec053821ff5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:05:59.121911 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.121875    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l9sl\" (UniqueName: \"kubernetes.io/projected/86b67a10-70df-4287-9c63-5ec053821ff5-kube-api-access-6l9sl\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:05:59.121911 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.121907    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:05:59.121911 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.121918    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86b67a10-70df-4287-9c63-5ec053821ff5-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:05:59.127128 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.127097    2548 generic.go:356] "Generic (PLEG): container finished" podID="86b67a10-70df-4287-9c63-5ec053821ff5" containerID="e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9" exitCode=0
Sep 06 01:05:59.127317 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.127142    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"
Sep 06 01:05:59.127317 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.127184    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29" event={"ID":"86b67a10-70df-4287-9c63-5ec053821ff5","Type":"ContainerDied","Data":"e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9"}
Sep 06 01:05:59.127317 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.127249    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29" event={"ID":"86b67a10-70df-4287-9c63-5ec053821ff5","Type":"ContainerDied","Data":"c09cc07bfcd425eb2fd4d18209eb25fe62aa8a284e48dfa4252810afb14969d9"}
Sep 06 01:05:59.127317 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.127295    2548 scope.go:117] "RemoveContainer" containerID="e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9"
Sep 06 01:05:59.137596 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.137578    2548 scope.go:117] "RemoveContainer" containerID="e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9"
Sep 06 01:05:59.137858 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:05:59.137837    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9\": container with ID starting with e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9 not found: ID does not exist" containerID="e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9"
Sep 06 01:05:59.137924 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.137866    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9"} err="failed to get container status \"e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9\": rpc error: code = NotFound desc = could not find container \"e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9\": container with ID starting with e18a7e7ee6da5035d30394e11b39f1e2df3d4a7a2f3b0b7fcea476346f7d94e9 not found: ID does not exist"
Sep 06 01:05:59.151374 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.151215    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"]
Sep 06 01:05:59.153450 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.153424    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2460bb62-766744f95d-jwj29"]
Sep 06 01:05:59.986845 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:05:59.986811    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86b67a10-70df-4287-9c63-5ec053821ff5" path="/var/lib/kubelet/pods/86b67a10-70df-4287-9c63-5ec053821ff5/volumes"
Sep 06 01:06:03.402817 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.402781    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"]
Sep 06 01:06:03.403432 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.403410    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b67a10-70df-4287-9c63-5ec053821ff5" containerName="maas-api"
Sep 06 01:06:03.403486 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.403435    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b67a10-70df-4287-9c63-5ec053821ff5" containerName="maas-api"
Sep 06 01:06:03.403564 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.403552    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="86b67a10-70df-4287-9c63-5ec053821ff5" containerName="maas-api"
Sep 06 01:06:03.408483 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.408458    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:03.410910 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.410885    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6cee6e60-serving-cert\""
Sep 06 01:06:03.419125 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.419098    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"]
Sep 06 01:06:03.466367 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.466329    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-metrics-certs\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:03.466548 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.466383    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-maas-api-tls\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:03.466548 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.466478    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef60544-edf0-4067-8675-7ca6d8b4c4d5-openshift-service-ca\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:03.466548 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.466538    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbkhx\" (UniqueName: \"kubernetes.io/projected/eef60544-edf0-4067-8675-7ca6d8b4c4d5-kube-api-access-lbkhx\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:03.567487 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.567445    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-maas-api-tls\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:03.567487 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.567494    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef60544-edf0-4067-8675-7ca6d8b4c4d5-openshift-service-ca\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:03.567750 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.567535    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbkhx\" (UniqueName: \"kubernetes.io/projected/eef60544-edf0-4067-8675-7ca6d8b4c4d5-kube-api-access-lbkhx\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:03.567750 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.567582    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-metrics-certs\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:03.567750 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:06:03.567602    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-serving-cert: secret "maas-api-e2e-ait-6cee6e60-serving-cert" not found
Sep 06 01:06:03.567750 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:06:03.567684    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-maas-api-tls podName:eef60544-edf0-4067-8675-7ca6d8b4c4d5 nodeName:}" failed. No retries permitted until 2026-09-06 01:06:04.067665899 +0000 UTC m=+944.601300205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-maas-api-tls") pod "maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6" (UID: "eef60544-edf0-4067-8675-7ca6d8b4c4d5") : secret "maas-api-e2e-ait-6cee6e60-serving-cert" not found
Sep 06 01:06:03.568369 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.568342    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef60544-edf0-4067-8675-7ca6d8b4c4d5-openshift-service-ca\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:03.570129 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.570109    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-metrics-certs\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:03.576073 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:03.576050    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbkhx\" (UniqueName: \"kubernetes.io/projected/eef60544-edf0-4067-8675-7ca6d8b4c4d5-kube-api-access-lbkhx\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:04.072493 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:04.072446    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-maas-api-tls\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:04.074901 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:04.074876    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-maas-api-tls\") pod \"maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:04.322867 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:04.322780    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:04.613061 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:04.612981    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"]
Sep 06 01:06:04.616444 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:06:04.616416    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef60544_edf0_4067_8675_7ca6d8b4c4d5.slice/crio-cf216fd23fcbc950c886b61e0766bac4b54bed21ae314a4855bc9ef6d284eadb WatchSource:0}: Error finding container cf216fd23fcbc950c886b61e0766bac4b54bed21ae314a4855bc9ef6d284eadb: Status 404 returned error can't find the container with id cf216fd23fcbc950c886b61e0766bac4b54bed21ae314a4855bc9ef6d284eadb
Sep 06 01:06:05.162803 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:05.162771    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6" event={"ID":"eef60544-edf0-4067-8675-7ca6d8b4c4d5","Type":"ContainerStarted","Data":"cf216fd23fcbc950c886b61e0766bac4b54bed21ae314a4855bc9ef6d284eadb"}
Sep 06 01:06:06.169450 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:06.169409    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6" event={"ID":"eef60544-edf0-4067-8675-7ca6d8b4c4d5","Type":"ContainerStarted","Data":"8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58"}
Sep 06 01:06:06.169847 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:06.169533    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:06.210853 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:06.210797    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6" podStartSLOduration=2.736179934 podStartE2EDuration="3.210780045s" totalImagesPullingTime="474.600111ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:06:06.20815412 +0000 UTC m=+946.741788462" watchObservedRunningTime="2026-09-06 01:06:06.210780045 +0000 UTC m=+946.744414406"
Sep 06 01:06:12.178613 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:12.178581    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:22.542464 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:22.542427    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"]
Sep 06 01:06:28.653891 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:28.653851    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"]
Sep 06 01:06:28.654412 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:28.654141    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9" podUID="812347e6-951d-4fe8-b78b-094886784463" containerName="maas-api" containerID="cri-o://20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0" gracePeriod=30
Sep 06 01:06:28.755791 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:28.755743    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9" podUID="812347e6-951d-4fe8-b78b-094886784463" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.34:8443/health\": dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 06 01:06:28.923473 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:28.923445    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:06:29.010567 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.010533    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/812347e6-951d-4fe8-b78b-094886784463-openshift-service-ca\") pod \"812347e6-951d-4fe8-b78b-094886784463\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") "
Sep 06 01:06:29.010743 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.010578    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-metrics-certs\") pod \"812347e6-951d-4fe8-b78b-094886784463\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") "
Sep 06 01:06:29.010743 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.010655    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wmfk\" (UniqueName: \"kubernetes.io/projected/812347e6-951d-4fe8-b78b-094886784463-kube-api-access-6wmfk\") pod \"812347e6-951d-4fe8-b78b-094886784463\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") "
Sep 06 01:06:29.010743 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.010685    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-maas-api-tls\") pod \"812347e6-951d-4fe8-b78b-094886784463\" (UID: \"812347e6-951d-4fe8-b78b-094886784463\") "
Sep 06 01:06:29.010979 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.010947    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/812347e6-951d-4fe8-b78b-094886784463-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "812347e6-951d-4fe8-b78b-094886784463" (UID: "812347e6-951d-4fe8-b78b-094886784463"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:06:29.012976 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.012949    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812347e6-951d-4fe8-b78b-094886784463-kube-api-access-6wmfk" (OuterVolumeSpecName: "kube-api-access-6wmfk") pod "812347e6-951d-4fe8-b78b-094886784463" (UID: "812347e6-951d-4fe8-b78b-094886784463"). InnerVolumeSpecName "kube-api-access-6wmfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:06:29.013110 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.012978    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "812347e6-951d-4fe8-b78b-094886784463" (UID: "812347e6-951d-4fe8-b78b-094886784463"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:06:29.013110 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.012998    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "812347e6-951d-4fe8-b78b-094886784463" (UID: "812347e6-951d-4fe8-b78b-094886784463"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:06:29.112219 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.112183    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:29.112219 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.112214    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/812347e6-951d-4fe8-b78b-094886784463-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:29.112219 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.112224    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/812347e6-951d-4fe8-b78b-094886784463-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:29.112477 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.112232    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wmfk\" (UniqueName: \"kubernetes.io/projected/812347e6-951d-4fe8-b78b-094886784463-kube-api-access-6wmfk\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:29.279955 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.279915    2548 generic.go:356] "Generic (PLEG): container finished" podID="812347e6-951d-4fe8-b78b-094886784463" containerID="20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0" exitCode=0
Sep 06 01:06:29.280130 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.279969    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"
Sep 06 01:06:29.280130 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.280011    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9" event={"ID":"812347e6-951d-4fe8-b78b-094886784463","Type":"ContainerDied","Data":"20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0"}
Sep 06 01:06:29.280130 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.280066    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9" event={"ID":"812347e6-951d-4fe8-b78b-094886784463","Type":"ContainerDied","Data":"813536441c44235aef9c956235f9fd6c0463f96e8f135dc37c51b3192fe34d5f"}
Sep 06 01:06:29.280130 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.280089    2548 scope.go:117] "RemoveContainer" containerID="20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0"
Sep 06 01:06:29.289604 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.289584    2548 scope.go:117] "RemoveContainer" containerID="20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0"
Sep 06 01:06:29.289869 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:06:29.289849    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0\": container with ID starting with 20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0 not found: ID does not exist" containerID="20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0"
Sep 06 01:06:29.289943 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.289882    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0"} err="failed to get container status \"20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0\": rpc error: code = NotFound desc = could not find container \"20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0\": container with ID starting with 20694452ed79241440d50c9354a11090f9087e13f685095158aca9c9d6c797d0 not found: ID does not exist"
Sep 06 01:06:29.302065 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.302038    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"]
Sep 06 01:06:29.306576 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.306551    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-639343-cdf5cc6fd-6pgl9"]
Sep 06 01:06:29.986866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:29.986833    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="812347e6-951d-4fe8-b78b-094886784463" path="/var/lib/kubelet/pods/812347e6-951d-4fe8-b78b-094886784463/volumes"
Sep 06 01:06:33.930098 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:33.930051    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"]
Sep 06 01:06:33.930628 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:33.930336    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6" podUID="eef60544-edf0-4067-8675-7ca6d8b4c4d5" containerName="maas-api" containerID="cri-o://8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58" gracePeriod=30
Sep 06 01:06:34.176746 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.176719    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:34.260087 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.260050    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbkhx\" (UniqueName: \"kubernetes.io/projected/eef60544-edf0-4067-8675-7ca6d8b4c4d5-kube-api-access-lbkhx\") pod \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") "
Sep 06 01:06:34.260313 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.260164    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-metrics-certs\") pod \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") "
Sep 06 01:06:34.260313 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.260220    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-maas-api-tls\") pod \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") "
Sep 06 01:06:34.260313 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.260247    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef60544-edf0-4067-8675-7ca6d8b4c4d5-openshift-service-ca\") pod \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\" (UID: \"eef60544-edf0-4067-8675-7ca6d8b4c4d5\") "
Sep 06 01:06:34.260665 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.260642    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef60544-edf0-4067-8675-7ca6d8b4c4d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eef60544-edf0-4067-8675-7ca6d8b4c4d5" (UID: "eef60544-edf0-4067-8675-7ca6d8b4c4d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:06:34.262238 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.262203    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef60544-edf0-4067-8675-7ca6d8b4c4d5-kube-api-access-lbkhx" (OuterVolumeSpecName: "kube-api-access-lbkhx") pod "eef60544-edf0-4067-8675-7ca6d8b4c4d5" (UID: "eef60544-edf0-4067-8675-7ca6d8b4c4d5"). InnerVolumeSpecName "kube-api-access-lbkhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:06:34.262394 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.262322    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "eef60544-edf0-4067-8675-7ca6d8b4c4d5" (UID: "eef60544-edf0-4067-8675-7ca6d8b4c4d5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:06:34.262394 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.262352    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eef60544-edf0-4067-8675-7ca6d8b4c4d5" (UID: "eef60544-edf0-4067-8675-7ca6d8b4c4d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:06:34.311253 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.311213    2548 generic.go:356] "Generic (PLEG): container finished" podID="eef60544-edf0-4067-8675-7ca6d8b4c4d5" containerID="8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58" exitCode=0
Sep 06 01:06:34.311253 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.311240    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6" event={"ID":"eef60544-edf0-4067-8675-7ca6d8b4c4d5","Type":"ContainerDied","Data":"8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58"}
Sep 06 01:06:34.311506 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.311286    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"
Sep 06 01:06:34.311506 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.311321    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6" event={"ID":"eef60544-edf0-4067-8675-7ca6d8b4c4d5","Type":"ContainerDied","Data":"cf216fd23fcbc950c886b61e0766bac4b54bed21ae314a4855bc9ef6d284eadb"}
Sep 06 01:06:34.311506 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.311353    2548 scope.go:117] "RemoveContainer" containerID="8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58"
Sep 06 01:06:34.321124 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.321107    2548 scope.go:117] "RemoveContainer" containerID="8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58"
Sep 06 01:06:34.321430 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:06:34.321412    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58\": container with ID starting with 8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58 not found: ID does not exist" containerID="8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58"
Sep 06 01:06:34.321501 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.321440    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58"} err="failed to get container status \"8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58\": rpc error: code = NotFound desc = could not find container \"8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58\": container with ID starting with 8bcc26a383830d2543971784083621897703e327eaa0bbde54f0b3eb5cc50a58 not found: ID does not exist"
Sep 06 01:06:34.333916 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.333894    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"]
Sep 06 01:06:34.339546 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.339521    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6cee6e60-db4d96f6c-n5sc6"]
Sep 06 01:06:34.361194 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.361169    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:34.361194 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.361193    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eef60544-edf0-4067-8675-7ca6d8b4c4d5-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:34.361373 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.361202    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eef60544-edf0-4067-8675-7ca6d8b4c4d5-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:34.361373 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:34.361212    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbkhx\" (UniqueName: \"kubernetes.io/projected/eef60544-edf0-4067-8675-7ca6d8b4c4d5-kube-api-access-lbkhx\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:35.987053 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:35.987013    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef60544-edf0-4067-8675-7ca6d8b4c4d5" path="/var/lib/kubelet/pods/eef60544-edf0-4067-8675-7ca6d8b4c4d5/volumes"
Sep 06 01:06:37.564259 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.564193    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj" podUID="0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" containerName="main" containerID="cri-o://859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d" gracePeriod=45
Sep 06 01:06:37.819691 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.819625    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:06:37.892261 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.892225    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2sqs\" (UniqueName: \"kubernetes.io/projected/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-kube-api-access-p2sqs\") pod \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") "
Sep 06 01:06:37.892454 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.892318    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tls-certs\") pod \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") "
Sep 06 01:06:37.892454 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.892337    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-home\") pod \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") "
Sep 06 01:06:37.892454 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.892354    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-dshm\") pod \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") "
Sep 06 01:06:37.892616 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.892468    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-model-cache\") pod \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") "
Sep 06 01:06:37.892616 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.892516    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tmp-dir\") pod \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\" (UID: \"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4\") "
Sep 06 01:06:37.892724 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.892646    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-home" (OuterVolumeSpecName: "home") pod "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" (UID: "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:06:37.892799 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.892742    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-model-cache" (OuterVolumeSpecName: "model-cache") pod "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" (UID: "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:06:37.892799 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.892776    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" (UID: "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:06:37.892905 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.892842    2548 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:37.894637 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.894612    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-dshm" (OuterVolumeSpecName: "dshm") pod "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" (UID: "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:06:37.894746 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.894675    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-kube-api-access-p2sqs" (OuterVolumeSpecName: "kube-api-access-p2sqs") pod "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" (UID: "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4"). InnerVolumeSpecName "kube-api-access-p2sqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:06:37.894746 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.894699    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" (UID: "0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:06:37.993619 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.993442    2548 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:37.993619 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.993471    2548 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:37.993619 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.993486    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2sqs\" (UniqueName: \"kubernetes.io/projected/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-kube-api-access-p2sqs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:37.993619 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.993499    2548 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:37.993619 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:37.993514    2548 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:06:38.341833 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:38.341792    2548 generic.go:356] "Generic (PLEG): container finished" podID="0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" containerID="859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d" exitCode=0
Sep 06 01:06:38.341833 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:38.341834    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"
Sep 06 01:06:38.342059 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:38.341894    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj" event={"ID":"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4","Type":"ContainerDied","Data":"859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d"}
Sep 06 01:06:38.342059 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:38.341938    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj" event={"ID":"0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4","Type":"ContainerDied","Data":"413227a704105cd8a6d1626307c3b26943a09c299d15e6644f1f96866268ad1e"}
Sep 06 01:06:38.342059 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:38.341958    2548 scope.go:117] "RemoveContainer" containerID="859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d"
Sep 06 01:06:38.350970 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:38.350950    2548 scope.go:117] "RemoveContainer" containerID="859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d"
Sep 06 01:06:38.351344 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:06:38.351321    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d\": container with ID starting with 859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d not found: ID does not exist" containerID="859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d"
Sep 06 01:06:38.351451 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:38.351351    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d"} err="failed to get container status \"859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d\": rpc error: code = NotFound desc = could not find container \"859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d\": container with ID starting with 859e397b2c8030f8733ad95100953b516a3131ac625c0eb7493b6bc16bb0386d not found: ID does not exist"
Sep 06 01:06:38.362541 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:38.362508    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"]
Sep 06 01:06:38.368090 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:38.368065    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-fbcd50d1-kserve-f4bbbc674-qgfsj"]
Sep 06 01:06:39.915327 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.915294    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"]
Sep 06 01:06:39.915835 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.915815    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812347e6-951d-4fe8-b78b-094886784463" containerName="maas-api"
Sep 06 01:06:39.915952 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.915840    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="812347e6-951d-4fe8-b78b-094886784463" containerName="maas-api"
Sep 06 01:06:39.915952 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.915854    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" containerName="main"
Sep 06 01:06:39.915952 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.915863    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" containerName="main"
Sep 06 01:06:39.915952 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.915893    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef60544-edf0-4067-8675-7ca6d8b4c4d5" containerName="maas-api"
Sep 06 01:06:39.915952 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.915903    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef60544-edf0-4067-8675-7ca6d8b4c4d5" containerName="maas-api"
Sep 06 01:06:39.916189 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.915988    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="eef60544-edf0-4067-8675-7ca6d8b4c4d5" containerName="maas-api"
Sep 06 01:06:39.916189 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.916003    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" containerName="main"
Sep 06 01:06:39.916189 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.916017    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="812347e6-951d-4fe8-b78b-094886784463" containerName="maas-api"
Sep 06 01:06:39.920619 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.920599    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:39.923672 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.923651    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8a9d2066-serving-cert\""
Sep 06 01:06:39.932049 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.931986    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"]
Sep 06 01:06:39.986964 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:39.986929    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4" path="/var/lib/kubelet/pods/0bc8ec94-d8f9-4ede-b3da-f79d1e3386f4/volumes"
Sep 06 01:06:40.012681 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.012640    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc96f\" (UniqueName: \"kubernetes.io/projected/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-kube-api-access-kc96f\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.012909 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.012698    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-openshift-service-ca\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.012909 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.012852    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-maas-api-tls\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.013033 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.012912    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-metrics-certs\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.113975 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.113934    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-openshift-service-ca\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.114183 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.114000    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-maas-api-tls\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.114183 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.114029    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-metrics-certs\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.114183 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.114070    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc96f\" (UniqueName: \"kubernetes.io/projected/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-kube-api-access-kc96f\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.114395 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:06:40.114188    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-serving-cert: secret "maas-api-e2e-derive-8a9d2066-serving-cert" not found
Sep 06 01:06:40.114395 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:06:40.114280    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-maas-api-tls podName:ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619 nodeName:}" failed. No retries permitted until 2026-09-06 01:06:40.614243629 +0000 UTC m=+981.147877949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-maas-api-tls") pod "maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j" (UID: "ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619") : secret "maas-api-e2e-derive-8a9d2066-serving-cert" not found
Sep 06 01:06:40.114756 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.114734    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-openshift-service-ca\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.116515 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.116489    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-metrics-certs\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.127455 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.127434    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc96f\" (UniqueName: \"kubernetes.io/projected/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-kube-api-access-kc96f\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.618961 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.618923    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-maas-api-tls\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.621488 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.621464    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-maas-api-tls\") pod \"maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:40.832906 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:40.832873    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:41.122849 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:41.122823    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"]
Sep 06 01:06:41.358543 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:41.358503    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j" event={"ID":"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619","Type":"ContainerStarted","Data":"273b9a474e16619935bec11bb605d60ce6db8bcb47793644f979772e739c0054"}
Sep 06 01:06:42.024853 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.024814    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"]
Sep 06 01:06:42.028730 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.028706    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.032200 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.032168    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-1fc789-serving-cert\""
Sep 06 01:06:42.045424 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.045398    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"]
Sep 06 01:06:42.144486 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.144394    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57t2s\" (UniqueName: \"kubernetes.io/projected/88f2defe-8dda-4805-a747-af62c4b0a609-kube-api-access-57t2s\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.144486 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.144474    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-maas-api-tls\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.144947 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.144511    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-metrics-certs\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.144947 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.144625    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88f2defe-8dda-4805-a747-af62c4b0a609-openshift-service-ca\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.245388 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.245338    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-metrics-certs\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.245388 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.245402    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88f2defe-8dda-4805-a747-af62c4b0a609-openshift-service-ca\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.245662 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.245464    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57t2s\" (UniqueName: \"kubernetes.io/projected/88f2defe-8dda-4805-a747-af62c4b0a609-kube-api-access-57t2s\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.245662 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.245506    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-maas-api-tls\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.245662 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:06:42.245602    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-serving-cert: secret "maas-api-e2e-explicit-1fc789-serving-cert" not found
Sep 06 01:06:42.245662 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:06:42.245658    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-maas-api-tls podName:88f2defe-8dda-4805-a747-af62c4b0a609 nodeName:}" failed. No retries permitted until 2026-09-06 01:06:42.745642495 +0000 UTC m=+983.279276800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-maas-api-tls") pod "maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7" (UID: "88f2defe-8dda-4805-a747-af62c4b0a609") : secret "maas-api-e2e-explicit-1fc789-serving-cert" not found
Sep 06 01:06:42.246150 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.246128    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88f2defe-8dda-4805-a747-af62c4b0a609-openshift-service-ca\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.248128 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.248103    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-metrics-certs\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.257893 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.257868    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57t2s\" (UniqueName: \"kubernetes.io/projected/88f2defe-8dda-4805-a747-af62c4b0a609-kube-api-access-57t2s\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.365597 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.365493    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j" event={"ID":"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619","Type":"ContainerStarted","Data":"dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086"}
Sep 06 01:06:42.365597 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.365575    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:42.386526 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.386432    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j" podStartSLOduration=2.977882954 podStartE2EDuration="3.386411632s" totalImagesPullingTime="408.528678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:06:42.38561871 +0000 UTC m=+982.919253040" watchObservedRunningTime="2026-09-06 01:06:42.386411632 +0000 UTC m=+982.920045961"
Sep 06 01:06:42.749216 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.749185    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-maas-api-tls\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.751953 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.751927    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-maas-api-tls\") pod \"maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:42.940733 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:42.940697    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:43.218644 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:43.218609    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"]
Sep 06 01:06:43.222575 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:06:43.222546    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f2defe_8dda_4805_a747_af62c4b0a609.slice/crio-af50e1814cb5190aa9843496585ead542221cfb79d849bbad8e2d67e2bf7b2c4 WatchSource:0}: Error finding container af50e1814cb5190aa9843496585ead542221cfb79d849bbad8e2d67e2bf7b2c4: Status 404 returned error can't find the container with id af50e1814cb5190aa9843496585ead542221cfb79d849bbad8e2d67e2bf7b2c4
Sep 06 01:06:43.372435 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:43.372393    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7" event={"ID":"88f2defe-8dda-4805-a747-af62c4b0a609","Type":"ContainerStarted","Data":"af50e1814cb5190aa9843496585ead542221cfb79d849bbad8e2d67e2bf7b2c4"}
Sep 06 01:06:44.380209 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:44.380172    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7" event={"ID":"88f2defe-8dda-4805-a747-af62c4b0a609","Type":"ContainerStarted","Data":"63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b"}
Sep 06 01:06:44.380636 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:44.380379    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:06:44.399058 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:44.399011    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7" podStartSLOduration=2.070416103 podStartE2EDuration="2.3989951s" totalImagesPullingTime="328.578997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:06:44.397090263 +0000 UTC m=+984.930724616" watchObservedRunningTime="2026-09-06 01:06:44.3989951 +0000 UTC m=+984.932629429"
Sep 06 01:06:48.378687 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:48.378653    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:06:50.392543 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:06:50.392514    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:07:10.644596 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.644565    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"]
Sep 06 01:07:10.645046 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.644778    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j" podUID="ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619" containerName="maas-api" containerID="cri-o://dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086" gracePeriod=30
Sep 06 01:07:10.890085 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.890060    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:07:10.891127 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.891109    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-metrics-certs\") pod \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") "
Sep 06 01:07:10.891182 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.891137    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc96f\" (UniqueName: \"kubernetes.io/projected/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-kube-api-access-kc96f\") pod \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") "
Sep 06 01:07:10.891182 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.891156    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-openshift-service-ca\") pod \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") "
Sep 06 01:07:10.891271 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.891202    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-maas-api-tls\") pod \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\" (UID: \"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619\") "
Sep 06 01:07:10.891573 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.891547    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619" (UID: "ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:07:10.893462 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.893424    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619" (UID: "ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:07:10.893604 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.893576    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-kube-api-access-kc96f" (OuterVolumeSpecName: "kube-api-access-kc96f") pod "ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619" (UID: "ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619"). InnerVolumeSpecName "kube-api-access-kc96f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:07:10.893688 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.893671    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619" (UID: "ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:07:10.992992 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.992889    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:07:10.992992 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.992928    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc96f\" (UniqueName: \"kubernetes.io/projected/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-kube-api-access-kc96f\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:07:10.992992 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.992943    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:07:10.992992 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:10.992959    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:07:11.511684 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:11.511649    2548 generic.go:356] "Generic (PLEG): container finished" podID="ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619" containerID="dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086" exitCode=0
Sep 06 01:07:11.511835 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:11.511706    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"
Sep 06 01:07:11.511835 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:11.511735    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j" event={"ID":"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619","Type":"ContainerDied","Data":"dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086"}
Sep 06 01:07:11.511835 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:11.511822    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j" event={"ID":"ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619","Type":"ContainerDied","Data":"273b9a474e16619935bec11bb605d60ce6db8bcb47793644f979772e739c0054"}
Sep 06 01:07:11.511971 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:11.511849    2548 scope.go:117] "RemoveContainer" containerID="dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086"
Sep 06 01:07:11.521728 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:11.521708    2548 scope.go:117] "RemoveContainer" containerID="dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086"
Sep 06 01:07:11.522067 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:07:11.522045    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086\": container with ID starting with dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086 not found: ID does not exist" containerID="dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086"
Sep 06 01:07:11.522146 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:11.522077    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086"} err="failed to get container status \"dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086\": rpc error: code = NotFound desc = could not find container \"dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086\": container with ID starting with dd901d312988a5bdaaae4ff18dd03d0b6cbe95d81b9d16db067dd87b7d968086 not found: ID does not exist"
Sep 06 01:07:11.534407 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:11.534379    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"]
Sep 06 01:07:11.540692 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:11.540664    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a9d2066-5d88cffc6-jtp2j"]
Sep 06 01:07:11.988332 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:11.988284    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619" path="/var/lib/kubelet/pods/ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619/volumes"
Sep 06 01:07:43.344688 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.344652    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"]
Sep 06 01:07:43.345505 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.344903    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7" podUID="88f2defe-8dda-4805-a747-af62c4b0a609" containerName="maas-api" containerID="cri-o://63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b" gracePeriod=30
Sep 06 01:07:43.602473 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.602418    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:07:43.658642 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.658609    2548 generic.go:356] "Generic (PLEG): container finished" podID="88f2defe-8dda-4805-a747-af62c4b0a609" containerID="63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b" exitCode=0
Sep 06 01:07:43.658813 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.658657    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"
Sep 06 01:07:43.658813 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.658663    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7" event={"ID":"88f2defe-8dda-4805-a747-af62c4b0a609","Type":"ContainerDied","Data":"63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b"}
Sep 06 01:07:43.658813 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.658788    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7" event={"ID":"88f2defe-8dda-4805-a747-af62c4b0a609","Type":"ContainerDied","Data":"af50e1814cb5190aa9843496585ead542221cfb79d849bbad8e2d67e2bf7b2c4"}
Sep 06 01:07:43.658920 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.658821    2548 scope.go:117] "RemoveContainer" containerID="63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b"
Sep 06 01:07:43.667740 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.667723    2548 scope.go:117] "RemoveContainer" containerID="63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b"
Sep 06 01:07:43.668009 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:07:43.667987    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b\": container with ID starting with 63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b not found: ID does not exist" containerID="63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b"
Sep 06 01:07:43.668109 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.668019    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b"} err="failed to get container status \"63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b\": rpc error: code = NotFound desc = could not find container \"63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b\": container with ID starting with 63b8d26a65d9dfcefb7f148560e7926cbfa59d858703910e28224eae3b7e6c1b not found: ID does not exist"
Sep 06 01:07:43.680322 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.680302    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-metrics-certs\") pod \"88f2defe-8dda-4805-a747-af62c4b0a609\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") "
Sep 06 01:07:43.680408 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.680332    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88f2defe-8dda-4805-a747-af62c4b0a609-openshift-service-ca\") pod \"88f2defe-8dda-4805-a747-af62c4b0a609\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") "
Sep 06 01:07:43.680408 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.680352    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-maas-api-tls\") pod \"88f2defe-8dda-4805-a747-af62c4b0a609\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") "
Sep 06 01:07:43.680480 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.680446    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57t2s\" (UniqueName: \"kubernetes.io/projected/88f2defe-8dda-4805-a747-af62c4b0a609-kube-api-access-57t2s\") pod \"88f2defe-8dda-4805-a747-af62c4b0a609\" (UID: \"88f2defe-8dda-4805-a747-af62c4b0a609\") "
Sep 06 01:07:43.680707 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.680686    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88f2defe-8dda-4805-a747-af62c4b0a609-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88f2defe-8dda-4805-a747-af62c4b0a609" (UID: "88f2defe-8dda-4805-a747-af62c4b0a609"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:07:43.682501 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.682475    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f2defe-8dda-4805-a747-af62c4b0a609-kube-api-access-57t2s" (OuterVolumeSpecName: "kube-api-access-57t2s") pod "88f2defe-8dda-4805-a747-af62c4b0a609" (UID: "88f2defe-8dda-4805-a747-af62c4b0a609"). InnerVolumeSpecName "kube-api-access-57t2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:07:43.682588 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.682568    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88f2defe-8dda-4805-a747-af62c4b0a609" (UID: "88f2defe-8dda-4805-a747-af62c4b0a609"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:07:43.682628 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.682605    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "88f2defe-8dda-4805-a747-af62c4b0a609" (UID: "88f2defe-8dda-4805-a747-af62c4b0a609"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:07:43.782051 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.782012    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:07:43.782051 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.782044    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88f2defe-8dda-4805-a747-af62c4b0a609-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:07:43.782051 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.782053    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88f2defe-8dda-4805-a747-af62c4b0a609-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:07:43.782308 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.782062    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57t2s\" (UniqueName: \"kubernetes.io/projected/88f2defe-8dda-4805-a747-af62c4b0a609-kube-api-access-57t2s\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:07:43.986648 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.986620    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"]
Sep 06 01:07:43.986648 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:43.986653    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-1fc789-69ccddfbc7-smgp7"]
Sep 06 01:07:45.986394 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:07:45.986361    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88f2defe-8dda-4805-a747-af62c4b0a609" path="/var/lib/kubelet/pods/88f2defe-8dda-4805-a747-af62c4b0a609/volumes"
Sep 06 01:08:52.355768 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.354767    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"]
Sep 06 01:08:52.355768 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.355201    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f2defe-8dda-4805-a747-af62c4b0a609" containerName="maas-api"
Sep 06 01:08:52.355768 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.355216    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f2defe-8dda-4805-a747-af62c4b0a609" containerName="maas-api"
Sep 06 01:08:52.355768 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.355280    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619" containerName="maas-api"
Sep 06 01:08:52.355768 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.355289    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619" containerName="maas-api"
Sep 06 01:08:52.355768 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.355364    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae9dff04-e0ad-4ea4-b7ea-fd481fa8b619" containerName="maas-api"
Sep 06 01:08:52.355768 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.355379    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f2defe-8dda-4805-a747-af62c4b0a609" containerName="maas-api"
Sep 06 01:08:52.358585 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.358566    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:52.360904 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.360882    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-40d55b26-serving-cert\""
Sep 06 01:08:52.371422 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.371395    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"]
Sep 06 01:08:52.455029 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.454993    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-openshift-service-ca\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:52.455029 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.455031    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-metrics-certs\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:52.455325 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.455071    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7f46\" (UniqueName: \"kubernetes.io/projected/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-kube-api-access-z7f46\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:52.455325 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.455096    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-maas-api-tls\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:52.556169 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.556127    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-openshift-service-ca\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:52.556169 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.556169    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-metrics-certs\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:52.556454 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.556230    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7f46\" (UniqueName: \"kubernetes.io/projected/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-kube-api-access-z7f46\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:52.556454 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.556258    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-maas-api-tls\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:52.556529 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:08:52.556448    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-serving-cert: secret "maas-api-e2e-mt-40d55b26-serving-cert" not found
Sep 06 01:08:52.556574 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:08:52.556527    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-maas-api-tls podName:88ef0edc-bb53-4500-b6f8-f2e4eed34c3c nodeName:}" failed. No retries permitted until 2026-09-06 01:08:53.056503769 +0000 UTC m=+1113.590138088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-maas-api-tls") pod "maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv" (UID: "88ef0edc-bb53-4500-b6f8-f2e4eed34c3c") : secret "maas-api-e2e-mt-40d55b26-serving-cert" not found
Sep 06 01:08:52.556883 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.556849    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-openshift-service-ca\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:52.558680 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.558664    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-metrics-certs\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:52.564567 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:52.564548    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7f46\" (UniqueName: \"kubernetes.io/projected/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-kube-api-access-z7f46\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:53.061627 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:53.061588    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-maas-api-tls\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:53.064130 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:53.064094    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-maas-api-tls\") pod \"maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:53.270142 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:53.270109    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:53.542585 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:53.542551    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"]
Sep 06 01:08:53.544437 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:08:53.544406    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ef0edc_bb53_4500_b6f8_f2e4eed34c3c.slice/crio-acc0fb3528c1d268bd484d851f75e528beb8e1ed6b412fd588de3b2f884c0fb6 WatchSource:0}: Error finding container acc0fb3528c1d268bd484d851f75e528beb8e1ed6b412fd588de3b2f884c0fb6: Status 404 returned error can't find the container with id acc0fb3528c1d268bd484d851f75e528beb8e1ed6b412fd588de3b2f884c0fb6
Sep 06 01:08:53.974807 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:53.974777    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv" event={"ID":"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c","Type":"ContainerStarted","Data":"acc0fb3528c1d268bd484d851f75e528beb8e1ed6b412fd588de3b2f884c0fb6"}
Sep 06 01:08:54.981061 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:54.981025    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv" event={"ID":"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c","Type":"ContainerStarted","Data":"0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071"}
Sep 06 01:08:54.981549 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:54.981144    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:08:55.006880 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:55.006836    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv" podStartSLOduration=2.607081283 podStartE2EDuration="3.006823931s" totalImagesPullingTime="399.742648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:08:55.005717312 +0000 UTC m=+1115.539351639" watchObservedRunningTime="2026-09-06 01:08:55.006823931 +0000 UTC m=+1115.540458257"
Sep 06 01:08:56.164067 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.164031    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"]
Sep 06 01:08:56.164547 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.164345    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6" podUID="a5561830-66cd-48a3-b5fe-91bf1642075e" containerName="maas-api" containerID="cri-o://1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4" gracePeriod=30
Sep 06 01:08:56.424380 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.424325    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:08:56.593107 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.593076    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls\") pod \"a5561830-66cd-48a3-b5fe-91bf1642075e\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") "
Sep 06 01:08:56.593315 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.593130    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5561830-66cd-48a3-b5fe-91bf1642075e-openshift-service-ca\") pod \"a5561830-66cd-48a3-b5fe-91bf1642075e\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") "
Sep 06 01:08:56.593315 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.593157    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mzjm\" (UniqueName: \"kubernetes.io/projected/a5561830-66cd-48a3-b5fe-91bf1642075e-kube-api-access-4mzjm\") pod \"a5561830-66cd-48a3-b5fe-91bf1642075e\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") "
Sep 06 01:08:56.593315 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.593211    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-metrics-certs\") pod \"a5561830-66cd-48a3-b5fe-91bf1642075e\" (UID: \"a5561830-66cd-48a3-b5fe-91bf1642075e\") "
Sep 06 01:08:56.593550 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.593526    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5561830-66cd-48a3-b5fe-91bf1642075e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5561830-66cd-48a3-b5fe-91bf1642075e" (UID: "a5561830-66cd-48a3-b5fe-91bf1642075e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:08:56.595252 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.595202    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5561830-66cd-48a3-b5fe-91bf1642075e" (UID: "a5561830-66cd-48a3-b5fe-91bf1642075e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:08:56.595252 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.595237    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a5561830-66cd-48a3-b5fe-91bf1642075e" (UID: "a5561830-66cd-48a3-b5fe-91bf1642075e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:08:56.595418 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.595261    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5561830-66cd-48a3-b5fe-91bf1642075e-kube-api-access-4mzjm" (OuterVolumeSpecName: "kube-api-access-4mzjm") pod "a5561830-66cd-48a3-b5fe-91bf1642075e" (UID: "a5561830-66cd-48a3-b5fe-91bf1642075e"). InnerVolumeSpecName "kube-api-access-4mzjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:08:56.694869 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.694799    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:08:56.694869 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.694828    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5561830-66cd-48a3-b5fe-91bf1642075e-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:08:56.694869 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.694838    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mzjm\" (UniqueName: \"kubernetes.io/projected/a5561830-66cd-48a3-b5fe-91bf1642075e-kube-api-access-4mzjm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:08:56.694869 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.694846    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5561830-66cd-48a3-b5fe-91bf1642075e-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:08:56.993995 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.993961    2548 generic.go:356] "Generic (PLEG): container finished" podID="a5561830-66cd-48a3-b5fe-91bf1642075e" containerID="1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4" exitCode=0
Sep 06 01:08:56.994174 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.994002    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"
Sep 06 01:08:56.994174 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.994001    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6" event={"ID":"a5561830-66cd-48a3-b5fe-91bf1642075e","Type":"ContainerDied","Data":"1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4"}
Sep 06 01:08:56.994174 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.994141    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6" event={"ID":"a5561830-66cd-48a3-b5fe-91bf1642075e","Type":"ContainerDied","Data":"823376505afd507209ca2b8d2ef897f62807b93781c6b70566e39adfa0ea8174"}
Sep 06 01:08:56.994364 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:56.994174    2548 scope.go:117] "RemoveContainer" containerID="1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4"
Sep 06 01:08:57.003490 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:57.003473    2548 scope.go:117] "RemoveContainer" containerID="1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4"
Sep 06 01:08:57.003741 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:08:57.003721    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4\": container with ID starting with 1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4 not found: ID does not exist" containerID="1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4"
Sep 06 01:08:57.003803 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:57.003750    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4"} err="failed to get container status \"1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4\": rpc error: code = NotFound desc = could not find container \"1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4\": container with ID starting with 1d33f1a1692c20b241a9b2e287265fae2b977e73ec58c0078c23dd54d33d87d4 not found: ID does not exist"
Sep 06 01:08:57.016676 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:57.016652    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"]
Sep 06 01:08:57.020668 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:57.020644    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-701b5b-7c958d95f5-n2mx6"]
Sep 06 01:08:57.986095 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:08:57.986065    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5561830-66cd-48a3-b5fe-91bf1642075e" path="/var/lib/kubelet/pods/a5561830-66cd-48a3-b5fe-91bf1642075e/volumes"
Sep 06 01:09:00.991379 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:00.991350    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:09:13.844530 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:13.844495    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"]
Sep 06 01:09:13.844990 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:13.844752    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft" podUID="03c44a33-2116-48af-9f5c-c1a31b0902e6" containerName="maas-api" containerID="cri-o://07965aedcda2058744240f73fd97b232b41179b5c71f5f02a91c138a5dfc3db5" gracePeriod=30
Sep 06 01:09:14.074749 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.074721    2548 generic.go:356] "Generic (PLEG): container finished" podID="03c44a33-2116-48af-9f5c-c1a31b0902e6" containerID="07965aedcda2058744240f73fd97b232b41179b5c71f5f02a91c138a5dfc3db5" exitCode=0
Sep 06 01:09:14.074870 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.074790    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft" event={"ID":"03c44a33-2116-48af-9f5c-c1a31b0902e6","Type":"ContainerDied","Data":"07965aedcda2058744240f73fd97b232b41179b5c71f5f02a91c138a5dfc3db5"}
Sep 06 01:09:14.092472 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.092450    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:09:14.136532 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.136471    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-metrics-certs\") pod \"03c44a33-2116-48af-9f5c-c1a31b0902e6\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") "
Sep 06 01:09:14.136532 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.136513    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4njhj\" (UniqueName: \"kubernetes.io/projected/03c44a33-2116-48af-9f5c-c1a31b0902e6-kube-api-access-4njhj\") pod \"03c44a33-2116-48af-9f5c-c1a31b0902e6\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") "
Sep 06 01:09:14.136704 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.136560    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-maas-api-tls\") pod \"03c44a33-2116-48af-9f5c-c1a31b0902e6\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") "
Sep 06 01:09:14.136704 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.136630    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c44a33-2116-48af-9f5c-c1a31b0902e6-openshift-service-ca\") pod \"03c44a33-2116-48af-9f5c-c1a31b0902e6\" (UID: \"03c44a33-2116-48af-9f5c-c1a31b0902e6\") "
Sep 06 01:09:14.137045 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.137020    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03c44a33-2116-48af-9f5c-c1a31b0902e6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03c44a33-2116-48af-9f5c-c1a31b0902e6" (UID: "03c44a33-2116-48af-9f5c-c1a31b0902e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:09:14.138590 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.138561    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03c44a33-2116-48af-9f5c-c1a31b0902e6" (UID: "03c44a33-2116-48af-9f5c-c1a31b0902e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:09:14.138964 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.138940    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "03c44a33-2116-48af-9f5c-c1a31b0902e6" (UID: "03c44a33-2116-48af-9f5c-c1a31b0902e6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:09:14.139024 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.138948    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03c44a33-2116-48af-9f5c-c1a31b0902e6-kube-api-access-4njhj" (OuterVolumeSpecName: "kube-api-access-4njhj") pod "03c44a33-2116-48af-9f5c-c1a31b0902e6" (UID: "03c44a33-2116-48af-9f5c-c1a31b0902e6"). InnerVolumeSpecName "kube-api-access-4njhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:09:14.237595 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.237556    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c44a33-2116-48af-9f5c-c1a31b0902e6-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:09:14.237595 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.237582    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:09:14.237595 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.237591    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4njhj\" (UniqueName: \"kubernetes.io/projected/03c44a33-2116-48af-9f5c-c1a31b0902e6-kube-api-access-4njhj\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:09:14.237595 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:14.237599    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03c44a33-2116-48af-9f5c-c1a31b0902e6-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:09:15.080956 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:15.080925    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"
Sep 06 01:09:15.080956 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:15.080952    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft" event={"ID":"03c44a33-2116-48af-9f5c-c1a31b0902e6","Type":"ContainerDied","Data":"4216a4cbf01e70f6c2efd8649ed806b6484410755fbbeed65fc494d6c62b41f3"}
Sep 06 01:09:15.081502 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:15.081012    2548 scope.go:117] "RemoveContainer" containerID="07965aedcda2058744240f73fd97b232b41179b5c71f5f02a91c138a5dfc3db5"
Sep 06 01:09:15.107584 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:15.107563    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"]
Sep 06 01:09:15.114410 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:15.114386    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8d5457-c57c4bcd4-dwmft"]
Sep 06 01:09:15.985603 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:15.985573    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03c44a33-2116-48af-9f5c-c1a31b0902e6" path="/var/lib/kubelet/pods/03c44a33-2116-48af-9f5c-c1a31b0902e6/volumes"
Sep 06 01:09:26.298857 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.298820    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"]
Sep 06 01:09:26.299574 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.299249    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c44a33-2116-48af-9f5c-c1a31b0902e6" containerName="maas-api"
Sep 06 01:09:26.299574 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.299281    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c44a33-2116-48af-9f5c-c1a31b0902e6" containerName="maas-api"
Sep 06 01:09:26.299574 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.299298    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5561830-66cd-48a3-b5fe-91bf1642075e" containerName="maas-api"
Sep 06 01:09:26.299574 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.299307    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5561830-66cd-48a3-b5fe-91bf1642075e" containerName="maas-api"
Sep 06 01:09:26.299574 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.299427    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5561830-66cd-48a3-b5fe-91bf1642075e" containerName="maas-api"
Sep 06 01:09:26.299574 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.299444    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="03c44a33-2116-48af-9f5c-c1a31b0902e6" containerName="maas-api"
Sep 06 01:09:26.303724 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.303702    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:26.306223 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.306202    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-5844a8-serving-cert\""
Sep 06 01:09:26.316290 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.316247    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"]
Sep 06 01:09:26.442479 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.442453    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:26.442633 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.442488    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:26.442633 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.442521    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g56jj\" (UniqueName: \"kubernetes.io/projected/b80c6364-3c30-4054-8512-101fcaba706f-kube-api-access-g56jj\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:26.442633 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.442570    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80c6364-3c30-4054-8512-101fcaba706f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:26.543770 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.543741    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:26.543941 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.543777    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:26.543941 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.543806    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g56jj\" (UniqueName: \"kubernetes.io/projected/b80c6364-3c30-4054-8512-101fcaba706f-kube-api-access-g56jj\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:26.543941 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.543837    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80c6364-3c30-4054-8512-101fcaba706f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:26.543941 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:09:26.543903    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-serving-cert: secret "maas-api-e2e-shared-a-w3-5844a8-serving-cert" not found
Sep 06 01:09:26.544148 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:09:26.543987    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-maas-api-tls podName:b80c6364-3c30-4054-8512-101fcaba706f nodeName:}" failed. No retries permitted until 2026-09-06 01:09:27.043967611 +0000 UTC m=+1147.577601923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-maas-api-tls") pod "maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc" (UID: "b80c6364-3c30-4054-8512-101fcaba706f") : secret "maas-api-e2e-shared-a-w3-5844a8-serving-cert" not found
Sep 06 01:09:26.544637 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.544614    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80c6364-3c30-4054-8512-101fcaba706f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:26.546177 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.546157    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:26.557826 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:26.557774    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g56jj\" (UniqueName: \"kubernetes.io/projected/b80c6364-3c30-4054-8512-101fcaba706f-kube-api-access-g56jj\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:27.049203 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:27.049166    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:27.051594 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:27.051567    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:27.215727 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:27.215690    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:27.484798 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:27.484775    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"]
Sep 06 01:09:27.487107 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:09:27.487062    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80c6364_3c30_4054_8512_101fcaba706f.slice/crio-ff16bf49663760faec6a24c7dbb822c6a563b324b203f05bc78e1d42d3d05e7c WatchSource:0}: Error finding container ff16bf49663760faec6a24c7dbb822c6a563b324b203f05bc78e1d42d3d05e7c: Status 404 returned error can't find the container with id ff16bf49663760faec6a24c7dbb822c6a563b324b203f05bc78e1d42d3d05e7c
Sep 06 01:09:28.150088 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:28.150002    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc" event={"ID":"b80c6364-3c30-4054-8512-101fcaba706f","Type":"ContainerStarted","Data":"1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488"}
Sep 06 01:09:28.150304 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:28.150259    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc" event={"ID":"b80c6364-3c30-4054-8512-101fcaba706f","Type":"ContainerStarted","Data":"ff16bf49663760faec6a24c7dbb822c6a563b324b203f05bc78e1d42d3d05e7c"}
Sep 06 01:09:28.170375 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:28.170324    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc" podStartSLOduration=1.779790701 podStartE2EDuration="2.170305939s" totalImagesPullingTime="390.515238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:28.168691599 +0000 UTC m=+1148.702325936" watchObservedRunningTime="2026-09-06 01:09:28.170305939 +0000 UTC m=+1148.703940263"
Sep 06 01:09:29.155030 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:29.154991    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:34.670385 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:34.670353    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"]
Sep 06 01:09:34.670781 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:34.670582    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv" podUID="88ef0edc-bb53-4500-b6f8-f2e4eed34c3c" containerName="maas-api" containerID="cri-o://0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071" gracePeriod=30
Sep 06 01:09:34.915783 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:34.915759    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:09:35.008885 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.008859    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-openshift-service-ca\") pod \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") "
Sep 06 01:09:35.009037 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.008906    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7f46\" (UniqueName: \"kubernetes.io/projected/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-kube-api-access-z7f46\") pod \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") "
Sep 06 01:09:35.009037 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.008967    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-metrics-certs\") pod \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") "
Sep 06 01:09:35.009037 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.008997    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-maas-api-tls\") pod \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\" (UID: \"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c\") "
Sep 06 01:09:35.009289 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.009251    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88ef0edc-bb53-4500-b6f8-f2e4eed34c3c" (UID: "88ef0edc-bb53-4500-b6f8-f2e4eed34c3c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:09:35.011115 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.011083    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "88ef0edc-bb53-4500-b6f8-f2e4eed34c3c" (UID: "88ef0edc-bb53-4500-b6f8-f2e4eed34c3c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:09:35.011563 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.011528    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88ef0edc-bb53-4500-b6f8-f2e4eed34c3c" (UID: "88ef0edc-bb53-4500-b6f8-f2e4eed34c3c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:09:35.011563 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.011545    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-kube-api-access-z7f46" (OuterVolumeSpecName: "kube-api-access-z7f46") pod "88ef0edc-bb53-4500-b6f8-f2e4eed34c3c" (UID: "88ef0edc-bb53-4500-b6f8-f2e4eed34c3c"). InnerVolumeSpecName "kube-api-access-z7f46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:09:35.109620 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.109585    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7f46\" (UniqueName: \"kubernetes.io/projected/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-kube-api-access-z7f46\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:09:35.109620 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.109618    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:09:35.109788 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.109631    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:09:35.109788 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.109643    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:09:35.164282 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.164244    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:09:35.181726 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.181702    2548 generic.go:356] "Generic (PLEG): container finished" podID="88ef0edc-bb53-4500-b6f8-f2e4eed34c3c" containerID="0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071" exitCode=0
Sep 06 01:09:35.181868 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.181727    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv" event={"ID":"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c","Type":"ContainerDied","Data":"0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071"}
Sep 06 01:09:35.181868 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.181767    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"
Sep 06 01:09:35.181868 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.181778    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv" event={"ID":"88ef0edc-bb53-4500-b6f8-f2e4eed34c3c","Type":"ContainerDied","Data":"acc0fb3528c1d268bd484d851f75e528beb8e1ed6b412fd588de3b2f884c0fb6"}
Sep 06 01:09:35.181868 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.181807    2548 scope.go:117] "RemoveContainer" containerID="0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071"
Sep 06 01:09:35.192671 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.192650    2548 scope.go:117] "RemoveContainer" containerID="0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071"
Sep 06 01:09:35.193243 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:09:35.193214    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071\": container with ID starting with 0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071 not found: ID does not exist" containerID="0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071"
Sep 06 01:09:35.193449 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.193425    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071"} err="failed to get container status \"0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071\": rpc error: code = NotFound desc = could not find container \"0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071\": container with ID starting with 0865b91edee05c222241236886fca98cc55f314b97ad09aa8cceaed99f237071 not found: ID does not exist"
Sep 06 01:09:35.216052 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.216011    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"]
Sep 06 01:09:35.218679 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.218653    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-40d55b26-7f6976bfd-8rltv"]
Sep 06 01:09:35.987601 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:35.987571    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88ef0edc-bb53-4500-b6f8-f2e4eed34c3c" path="/var/lib/kubelet/pods/88ef0edc-bb53-4500-b6f8-f2e4eed34c3c/volumes"
Sep 06 01:09:55.509522 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.509438    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"]
Sep 06 01:09:55.510559 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.510527    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88ef0edc-bb53-4500-b6f8-f2e4eed34c3c" containerName="maas-api"
Sep 06 01:09:55.510559 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.510557    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="88ef0edc-bb53-4500-b6f8-f2e4eed34c3c" containerName="maas-api"
Sep 06 01:09:55.510704 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.510645    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="88ef0edc-bb53-4500-b6f8-f2e4eed34c3c" containerName="maas-api"
Sep 06 01:09:55.514054 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.514035    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.516378 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.516355    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-470346-serving-cert\""
Sep 06 01:09:55.523071 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.523010    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"]
Sep 06 01:09:55.688515 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.688461    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.688515 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.688520    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52cb733c-b3c0-4684-8001-036cad62796b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.688821 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.688608    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.688821 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.688644    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64z8f\" (UniqueName: \"kubernetes.io/projected/52cb733c-b3c0-4684-8001-036cad62796b-kube-api-access-64z8f\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.789306 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.789201    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.789306 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.789238    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64z8f\" (UniqueName: \"kubernetes.io/projected/52cb733c-b3c0-4684-8001-036cad62796b-kube-api-access-64z8f\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.789548 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.789350    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.789548 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.789380    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52cb733c-b3c0-4684-8001-036cad62796b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.790011 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.789989    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52cb733c-b3c0-4684-8001-036cad62796b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.791714 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.791693    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.791800 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.791768    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.798158 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.798133    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64z8f\" (UniqueName: \"kubernetes.io/projected/52cb733c-b3c0-4684-8001-036cad62796b-kube-api-access-64z8f\") pod \"maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:55.828321 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:55.828284    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:56.099643 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:56.099613    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"]
Sep 06 01:09:56.102313 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:09:56.102284    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52cb733c_b3c0_4684_8001_036cad62796b.slice/crio-92696ca656c861de79a5e6e282036b959486bfe5ff7d703966727d26c5cb5dd7 WatchSource:0}: Error finding container 92696ca656c861de79a5e6e282036b959486bfe5ff7d703966727d26c5cb5dd7: Status 404 returned error can't find the container with id 92696ca656c861de79a5e6e282036b959486bfe5ff7d703966727d26c5cb5dd7
Sep 06 01:09:56.103734 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:56.103713    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:09:56.285147 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:56.285102    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq" event={"ID":"52cb733c-b3c0-4684-8001-036cad62796b","Type":"ContainerStarted","Data":"92696ca656c861de79a5e6e282036b959486bfe5ff7d703966727d26c5cb5dd7"}
Sep 06 01:09:57.291700 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:57.291660    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq" event={"ID":"52cb733c-b3c0-4684-8001-036cad62796b","Type":"ContainerStarted","Data":"79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87"}
Sep 06 01:09:57.292182 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:57.291786    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:09:57.311423 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:57.311369    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq" podStartSLOduration=1.942016161 podStartE2EDuration="2.311353698s" totalImagesPullingTime="369.337537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:57.310152265 +0000 UTC m=+1177.843786593" watchObservedRunningTime="2026-09-06 01:09:57.311353698 +0000 UTC m=+1177.844988027"
Sep 06 01:09:59.807467 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.807434    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"]
Sep 06 01:09:59.810957 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.810935    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:09:59.813389 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.813361    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-e6b4e2-serving-cert\""
Sep 06 01:09:59.821373 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.821342    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:09:59.821505 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.821421    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7kdv\" (UniqueName: \"kubernetes.io/projected/a918b220-6890-459f-9735-c6a566a508c6-kube-api-access-j7kdv\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:09:59.821505 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.821470    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a918b220-6890-459f-9735-c6a566a508c6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:09:59.821505 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.821498    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:09:59.824636 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.824611    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"]
Sep 06 01:09:59.922531 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.922498    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:09:59.922720 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.922550    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7kdv\" (UniqueName: \"kubernetes.io/projected/a918b220-6890-459f-9735-c6a566a508c6-kube-api-access-j7kdv\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:09:59.922720 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.922587    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a918b220-6890-459f-9735-c6a566a508c6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:09:59.922720 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.922604    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:09:59.922720 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:09:59.922709    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-serving-cert: secret "maas-api-e2e-shared-a-w2-e6b4e2-serving-cert" not found
Sep 06 01:09:59.922914 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:09:59.922773    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-maas-api-tls podName:a918b220-6890-459f-9735-c6a566a508c6 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:00.422753551 +0000 UTC m=+1180.956387869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-maas-api-tls") pod "maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z" (UID: "a918b220-6890-459f-9735-c6a566a508c6") : secret "maas-api-e2e-shared-a-w2-e6b4e2-serving-cert" not found
Sep 06 01:09:59.923369 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.923340    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a918b220-6890-459f-9735-c6a566a508c6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:09:59.925198 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.925174    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:09:59.939539 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:09:59.939507    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7kdv\" (UniqueName: \"kubernetes.io/projected/a918b220-6890-459f-9735-c6a566a508c6-kube-api-access-j7kdv\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:10:00.428102 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:00.428057    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:10:00.430844 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:00.430815    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:10:00.726124 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:00.726090    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:10:01.009947 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:01.009802    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"]
Sep 06 01:10:01.012675 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:10:01.012647    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda918b220_6890_459f_9735_c6a566a508c6.slice/crio-f58fb5179a241bbc6bdac3bb4322fe905aba745061967a3a9d6ff25892039c7b WatchSource:0}: Error finding container f58fb5179a241bbc6bdac3bb4322fe905aba745061967a3a9d6ff25892039c7b: Status 404 returned error can't find the container with id f58fb5179a241bbc6bdac3bb4322fe905aba745061967a3a9d6ff25892039c7b
Sep 06 01:10:01.311759 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:01.311675    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z" event={"ID":"a918b220-6890-459f-9735-c6a566a508c6","Type":"ContainerStarted","Data":"f58fb5179a241bbc6bdac3bb4322fe905aba745061967a3a9d6ff25892039c7b"}
Sep 06 01:10:02.317772 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:02.317737    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z" event={"ID":"a918b220-6890-459f-9735-c6a566a508c6","Type":"ContainerStarted","Data":"ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5"}
Sep 06 01:10:02.318146 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:02.317831    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:10:02.336171 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:02.336125    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z" podStartSLOduration=2.769951842 podStartE2EDuration="3.33611135s" totalImagesPullingTime="566.159508ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:02.334321419 +0000 UTC m=+1182.867955747" watchObservedRunningTime="2026-09-06 01:10:02.33611135 +0000 UTC m=+1182.869745678"
Sep 06 01:10:03.301567 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:03.301537    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:10:08.328348 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:08.328318    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:10:19.992972 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:19.992944    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:10:19.995212 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:19.995185    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:10:28.644006 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.643945    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"]
Sep 06 01:10:28.649647 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.649625    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.652199 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.652170    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-812148-serving-cert\""
Sep 06 01:10:28.659946 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.659915    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"]
Sep 06 01:10:28.783708 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.783664    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dprr8\" (UniqueName: \"kubernetes.io/projected/e8870360-2449-4a3f-a632-8b471e5c29a4-kube-api-access-dprr8\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.783882 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.783752    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8870360-2449-4a3f-a632-8b471e5c29a4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.783882 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.783787    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.783882 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.783856    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.884481 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.884448    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.884664 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.884590    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dprr8\" (UniqueName: \"kubernetes.io/projected/e8870360-2449-4a3f-a632-8b471e5c29a4-kube-api-access-dprr8\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.884664 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.884620    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8870360-2449-4a3f-a632-8b471e5c29a4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.884664 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.884646    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.885229 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.885201    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8870360-2449-4a3f-a632-8b471e5c29a4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.887144 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.887121    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.887261 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.887121    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.896414 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.896360    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dprr8\" (UniqueName: \"kubernetes.io/projected/e8870360-2449-4a3f-a632-8b471e5c29a4-kube-api-access-dprr8\") pod \"maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:28.962082 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:28.962050    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:29.245724 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:29.245699    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"]
Sep 06 01:10:29.248322 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:10:29.248296    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8870360_2449_4a3f_a632_8b471e5c29a4.slice/crio-8d7bebeec739f2cbac1f71a0c8210728a17aeaab1dbbcc4bc4578e578a67f307 WatchSource:0}: Error finding container 8d7bebeec739f2cbac1f71a0c8210728a17aeaab1dbbcc4bc4578e578a67f307: Status 404 returned error can't find the container with id 8d7bebeec739f2cbac1f71a0c8210728a17aeaab1dbbcc4bc4578e578a67f307
Sep 06 01:10:29.445046 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:29.445006    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq" event={"ID":"e8870360-2449-4a3f-a632-8b471e5c29a4","Type":"ContainerStarted","Data":"8d7bebeec739f2cbac1f71a0c8210728a17aeaab1dbbcc4bc4578e578a67f307"}
Sep 06 01:10:30.451633 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:30.451590    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq" event={"ID":"e8870360-2449-4a3f-a632-8b471e5c29a4","Type":"ContainerStarted","Data":"6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7"}
Sep 06 01:10:30.452027 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:30.451733    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:10:30.470127 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:30.470072    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq" podStartSLOduration=2.123166721 podStartE2EDuration="2.47005651s" totalImagesPullingTime="346.889789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:30.468546718 +0000 UTC m=+1211.002181044" watchObservedRunningTime="2026-09-06 01:10:30.47005651 +0000 UTC m=+1211.003690837"
Sep 06 01:10:36.462630 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:10:36.462602    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:11:11.112497 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.112459    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"]
Sep 06 01:11:11.116704 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.116682    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.123046 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.123026    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7534e03d-serving-cert\""
Sep 06 01:11:11.131088 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.131062    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"]
Sep 06 01:11:11.262831 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.262792    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-metrics-certs\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.263009 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.262853    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/994a4503-2f1b-49f8-84f7-a7815577326b-openshift-service-ca\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.263009 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.262922    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-maas-api-tls\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.263009 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.262983    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qppjr\" (UniqueName: \"kubernetes.io/projected/994a4503-2f1b-49f8-84f7-a7815577326b-kube-api-access-qppjr\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.363521 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.363423    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qppjr\" (UniqueName: \"kubernetes.io/projected/994a4503-2f1b-49f8-84f7-a7815577326b-kube-api-access-qppjr\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.363521 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.363500    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-metrics-certs\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.363768 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.363551    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/994a4503-2f1b-49f8-84f7-a7815577326b-openshift-service-ca\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.363768 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.363583    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-maas-api-tls\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.364221 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.364193    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/994a4503-2f1b-49f8-84f7-a7815577326b-openshift-service-ca\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.365972 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.365942    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-maas-api-tls\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.366070 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.365991    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-metrics-certs\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.372721 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.372700    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qppjr\" (UniqueName: \"kubernetes.io/projected/994a4503-2f1b-49f8-84f7-a7815577326b-kube-api-access-qppjr\") pod \"maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.427512 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.427479    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:11.700993 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:11.700970    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"]
Sep 06 01:11:11.703203 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:11:11.703181    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994a4503_2f1b_49f8_84f7_a7815577326b.slice/crio-042dc5504c21655fe81e5bd092d996079d1789bda5d91e6d3f9e9b0b5127ecaf WatchSource:0}: Error finding container 042dc5504c21655fe81e5bd092d996079d1789bda5d91e6d3f9e9b0b5127ecaf: Status 404 returned error can't find the container with id 042dc5504c21655fe81e5bd092d996079d1789bda5d91e6d3f9e9b0b5127ecaf
Sep 06 01:11:12.638812 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:12.638726    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5" event={"ID":"994a4503-2f1b-49f8-84f7-a7815577326b","Type":"ContainerStarted","Data":"9c8307d0b19217dbba915154333d835f8bf3b3400b1b209fa5a1c1be52903389"}
Sep 06 01:11:12.638812 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:12.638777    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5" event={"ID":"994a4503-2f1b-49f8-84f7-a7815577326b","Type":"ContainerStarted","Data":"042dc5504c21655fe81e5bd092d996079d1789bda5d91e6d3f9e9b0b5127ecaf"}
Sep 06 01:11:12.639238 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:12.638853    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:11:12.655956 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:12.655910    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5" podStartSLOduration=1.151209486 podStartE2EDuration="1.655895363s" totalImagesPullingTime="504.685877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:11:12.654053075 +0000 UTC m=+1253.187687437" watchObservedRunningTime="2026-09-06 01:11:12.655895363 +0000 UTC m=+1253.189529690"
Sep 06 01:11:18.650948 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:11:18.650915    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:12:29.774136 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:29.774095    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"]
Sep 06 01:12:29.774952 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:29.774897    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5" podUID="994a4503-2f1b-49f8-84f7-a7815577326b" containerName="maas-api" containerID="cri-o://9c8307d0b19217dbba915154333d835f8bf3b3400b1b209fa5a1c1be52903389" gracePeriod=30
Sep 06 01:12:29.997537 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:29.997502    2548 generic.go:356] "Generic (PLEG): container finished" podID="994a4503-2f1b-49f8-84f7-a7815577326b" containerID="9c8307d0b19217dbba915154333d835f8bf3b3400b1b209fa5a1c1be52903389" exitCode=0
Sep 06 01:12:29.997676 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:29.997556    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5" event={"ID":"994a4503-2f1b-49f8-84f7-a7815577326b","Type":"ContainerDied","Data":"9c8307d0b19217dbba915154333d835f8bf3b3400b1b209fa5a1c1be52903389"}
Sep 06 01:12:30.019994 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.019972    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:12:30.031085 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.031033    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-metrics-certs\") pod \"994a4503-2f1b-49f8-84f7-a7815577326b\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") "
Sep 06 01:12:30.031189 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.031102    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-maas-api-tls\") pod \"994a4503-2f1b-49f8-84f7-a7815577326b\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") "
Sep 06 01:12:30.031335 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.031314    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/994a4503-2f1b-49f8-84f7-a7815577326b-openshift-service-ca\") pod \"994a4503-2f1b-49f8-84f7-a7815577326b\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") "
Sep 06 01:12:30.031440 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.031427    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qppjr\" (UniqueName: \"kubernetes.io/projected/994a4503-2f1b-49f8-84f7-a7815577326b-kube-api-access-qppjr\") pod \"994a4503-2f1b-49f8-84f7-a7815577326b\" (UID: \"994a4503-2f1b-49f8-84f7-a7815577326b\") "
Sep 06 01:12:30.031608 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.031577    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/994a4503-2f1b-49f8-84f7-a7815577326b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "994a4503-2f1b-49f8-84f7-a7815577326b" (UID: "994a4503-2f1b-49f8-84f7-a7815577326b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:12:30.031752 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.031737    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/994a4503-2f1b-49f8-84f7-a7815577326b-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:12:30.033409 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.033383    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/994a4503-2f1b-49f8-84f7-a7815577326b-kube-api-access-qppjr" (OuterVolumeSpecName: "kube-api-access-qppjr") pod "994a4503-2f1b-49f8-84f7-a7815577326b" (UID: "994a4503-2f1b-49f8-84f7-a7815577326b"). InnerVolumeSpecName "kube-api-access-qppjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:12:30.033630 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.033606    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "994a4503-2f1b-49f8-84f7-a7815577326b" (UID: "994a4503-2f1b-49f8-84f7-a7815577326b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:12:30.033630 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.033618    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "994a4503-2f1b-49f8-84f7-a7815577326b" (UID: "994a4503-2f1b-49f8-84f7-a7815577326b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:12:30.132183 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.132155    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:12:30.132183 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.132180    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/994a4503-2f1b-49f8-84f7-a7815577326b-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:12:30.132183 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:30.132190    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qppjr\" (UniqueName: \"kubernetes.io/projected/994a4503-2f1b-49f8-84f7-a7815577326b-kube-api-access-qppjr\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:12:31.003616 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:31.003588    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"
Sep 06 01:12:31.004023 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:31.003637    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5" event={"ID":"994a4503-2f1b-49f8-84f7-a7815577326b","Type":"ContainerDied","Data":"042dc5504c21655fe81e5bd092d996079d1789bda5d91e6d3f9e9b0b5127ecaf"}
Sep 06 01:12:31.004023 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:31.003693    2548 scope.go:117] "RemoveContainer" containerID="9c8307d0b19217dbba915154333d835f8bf3b3400b1b209fa5a1c1be52903389"
Sep 06 01:12:31.028868 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:31.028841    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"]
Sep 06 01:12:31.032580 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:31.032560    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7534e03d-664d8c56df-rdqt5"]
Sep 06 01:12:31.986200 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:12:31.986167    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="994a4503-2f1b-49f8-84f7-a7815577326b" path="/var/lib/kubelet/pods/994a4503-2f1b-49f8-84f7-a7815577326b/volumes"
Sep 06 01:14:08.492876 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:08.492842    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7781-088a79"]
Sep 06 01:14:08.493303 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:08.493196    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994a4503-2f1b-49f8-84f7-a7815577326b" containerName="maas-api"
Sep 06 01:14:08.493303 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:08.493208    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="994a4503-2f1b-49f8-84f7-a7815577326b" containerName="maas-api"
Sep 06 01:14:08.493303 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:08.493282    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="994a4503-2f1b-49f8-84f7-a7815577326b" containerName="maas-api"
Sep 06 01:14:08.496213 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:08.496198    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-088a79"
Sep 06 01:14:08.498474 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:08.498453    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tmqsk\""
Sep 06 01:14:08.501853 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:08.501829    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7781-088a79"]
Sep 06 01:14:08.652843 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:08.652810    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l85mh\" (UniqueName: \"kubernetes.io/projected/26044312-90fe-445a-94cf-9bb63c23a95c-kube-api-access-l85mh\") pod \"mt-curl-7781-088a79\" (UID: \"26044312-90fe-445a-94cf-9bb63c23a95c\") " pod="opendatahub/mt-curl-7781-088a79"
Sep 06 01:14:08.754141 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:08.754072    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l85mh\" (UniqueName: \"kubernetes.io/projected/26044312-90fe-445a-94cf-9bb63c23a95c-kube-api-access-l85mh\") pod \"mt-curl-7781-088a79\" (UID: \"26044312-90fe-445a-94cf-9bb63c23a95c\") " pod="opendatahub/mt-curl-7781-088a79"
Sep 06 01:14:08.762069 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:08.762046    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l85mh\" (UniqueName: \"kubernetes.io/projected/26044312-90fe-445a-94cf-9bb63c23a95c-kube-api-access-l85mh\") pod \"mt-curl-7781-088a79\" (UID: \"26044312-90fe-445a-94cf-9bb63c23a95c\") " pod="opendatahub/mt-curl-7781-088a79"
Sep 06 01:14:08.805821 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:08.805795    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-088a79"
Sep 06 01:14:09.073366 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:09.073343    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7781-088a79"]
Sep 06 01:14:09.075568 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:14:09.075541    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26044312_90fe_445a_94cf_9bb63c23a95c.slice/crio-9ffedd4df45d90605cd78256e8f78258702d0a71d2a3e502644eadd6fea09248 WatchSource:0}: Error finding container 9ffedd4df45d90605cd78256e8f78258702d0a71d2a3e502644eadd6fea09248: Status 404 returned error can't find the container with id 9ffedd4df45d90605cd78256e8f78258702d0a71d2a3e502644eadd6fea09248
Sep 06 01:14:09.446159 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:09.446074    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7781-088a79" event={"ID":"26044312-90fe-445a-94cf-9bb63c23a95c","Type":"ContainerStarted","Data":"9ffedd4df45d90605cd78256e8f78258702d0a71d2a3e502644eadd6fea09248"}
Sep 06 01:14:10.452212 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:10.452180    2548 generic.go:356] "Generic (PLEG): container finished" podID="26044312-90fe-445a-94cf-9bb63c23a95c" containerID="5428b6addfb872083504b175c9dcf2dcc8723973d1f7e62dcaa71e554449d3f4" exitCode=0
Sep 06 01:14:10.452586 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:10.452219    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7781-088a79" event={"ID":"26044312-90fe-445a-94cf-9bb63c23a95c","Type":"ContainerDied","Data":"5428b6addfb872083504b175c9dcf2dcc8723973d1f7e62dcaa71e554449d3f4"}
Sep 06 01:14:11.581666 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.581643    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-088a79"
Sep 06 01:14:11.614634 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.614609    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7781-088a79_26044312-90fe-445a-94cf-9bb63c23a95c/mt-curl-7781-088a79/0.log"
Sep 06 01:14:11.637747 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.637722    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7781-088a79"]
Sep 06 01:14:11.641294 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.641251    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7781-088a79"]
Sep 06 01:14:11.777842 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.777765    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l85mh\" (UniqueName: \"kubernetes.io/projected/26044312-90fe-445a-94cf-9bb63c23a95c-kube-api-access-l85mh\") pod \"26044312-90fe-445a-94cf-9bb63c23a95c\" (UID: \"26044312-90fe-445a-94cf-9bb63c23a95c\") "
Sep 06 01:14:11.780103 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.780070    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26044312-90fe-445a-94cf-9bb63c23a95c-kube-api-access-l85mh" (OuterVolumeSpecName: "kube-api-access-l85mh") pod "26044312-90fe-445a-94cf-9bb63c23a95c" (UID: "26044312-90fe-445a-94cf-9bb63c23a95c"). InnerVolumeSpecName "kube-api-access-l85mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:14:11.782712 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.782689    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7781-33054d"]
Sep 06 01:14:11.783201 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.783185    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26044312-90fe-445a-94cf-9bb63c23a95c" containerName="mt-curl-7781-088a79"
Sep 06 01:14:11.783237 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.783205    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="26044312-90fe-445a-94cf-9bb63c23a95c" containerName="mt-curl-7781-088a79"
Sep 06 01:14:11.783355 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.783342    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="26044312-90fe-445a-94cf-9bb63c23a95c" containerName="mt-curl-7781-088a79"
Sep 06 01:14:11.786551 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.786537    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-33054d"
Sep 06 01:14:11.790921 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.790898    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7781-33054d"]
Sep 06 01:14:11.878582 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.878554    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l85mh\" (UniqueName: \"kubernetes.io/projected/26044312-90fe-445a-94cf-9bb63c23a95c-kube-api-access-l85mh\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:14:11.979125 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.979102    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn7pn\" (UniqueName: \"kubernetes.io/projected/ce5c900a-96c7-4040-bfbb-a08a1566cece-kube-api-access-dn7pn\") pod \"mt-curl-7781-33054d\" (UID: \"ce5c900a-96c7-4040-bfbb-a08a1566cece\") " pod="opendatahub/mt-curl-7781-33054d"
Sep 06 01:14:11.987242 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:11.987220    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26044312-90fe-445a-94cf-9bb63c23a95c" path="/var/lib/kubelet/pods/26044312-90fe-445a-94cf-9bb63c23a95c/volumes"
Sep 06 01:14:12.080289 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:12.080189    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7pn\" (UniqueName: \"kubernetes.io/projected/ce5c900a-96c7-4040-bfbb-a08a1566cece-kube-api-access-dn7pn\") pod \"mt-curl-7781-33054d\" (UID: \"ce5c900a-96c7-4040-bfbb-a08a1566cece\") " pod="opendatahub/mt-curl-7781-33054d"
Sep 06 01:14:12.088903 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:12.088884    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7pn\" (UniqueName: \"kubernetes.io/projected/ce5c900a-96c7-4040-bfbb-a08a1566cece-kube-api-access-dn7pn\") pod \"mt-curl-7781-33054d\" (UID: \"ce5c900a-96c7-4040-bfbb-a08a1566cece\") " pod="opendatahub/mt-curl-7781-33054d"
Sep 06 01:14:12.097346 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:12.097328    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-33054d"
Sep 06 01:14:12.366509 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:12.366487    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7781-33054d"]
Sep 06 01:14:12.368419 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:14:12.368396    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce5c900a_96c7_4040_bfbb_a08a1566cece.slice/crio-163d6c4027726bc8ceb385de4322d57a3816381459e2d7eb55576c1a1293d004 WatchSource:0}: Error finding container 163d6c4027726bc8ceb385de4322d57a3816381459e2d7eb55576c1a1293d004: Status 404 returned error can't find the container with id 163d6c4027726bc8ceb385de4322d57a3816381459e2d7eb55576c1a1293d004
Sep 06 01:14:12.462215 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:12.462191    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-088a79"
Sep 06 01:14:12.462330 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:12.462199    2548 scope.go:117] "RemoveContainer" containerID="5428b6addfb872083504b175c9dcf2dcc8723973d1f7e62dcaa71e554449d3f4"
Sep 06 01:14:12.463552 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:12.463450    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7781-33054d" event={"ID":"ce5c900a-96c7-4040-bfbb-a08a1566cece","Type":"ContainerStarted","Data":"163d6c4027726bc8ceb385de4322d57a3816381459e2d7eb55576c1a1293d004"}
Sep 06 01:14:13.469958 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:13.469922    2548 generic.go:356] "Generic (PLEG): container finished" podID="ce5c900a-96c7-4040-bfbb-a08a1566cece" containerID="26f60af8442ad2abf1d6eac07b1ac57df09cce6703e54045c19568d2c8996882" exitCode=0
Sep 06 01:14:13.470340 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:13.470005    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7781-33054d" event={"ID":"ce5c900a-96c7-4040-bfbb-a08a1566cece","Type":"ContainerDied","Data":"26f60af8442ad2abf1d6eac07b1ac57df09cce6703e54045c19568d2c8996882"}
Sep 06 01:14:14.609767 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:14.609745    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-33054d"
Sep 06 01:14:14.632370 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:14.632337    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7781-33054d_ce5c900a-96c7-4040-bfbb-a08a1566cece/mt-curl-7781-33054d/0.log"
Sep 06 01:14:14.656663 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:14.656641    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7781-33054d"]
Sep 06 01:14:14.661415 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:14.661393    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7781-33054d"]
Sep 06 01:14:14.700166 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:14.700149    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn7pn\" (UniqueName: \"kubernetes.io/projected/ce5c900a-96c7-4040-bfbb-a08a1566cece-kube-api-access-dn7pn\") pod \"ce5c900a-96c7-4040-bfbb-a08a1566cece\" (UID: \"ce5c900a-96c7-4040-bfbb-a08a1566cece\") "
Sep 06 01:14:14.702198 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:14.702168    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce5c900a-96c7-4040-bfbb-a08a1566cece-kube-api-access-dn7pn" (OuterVolumeSpecName: "kube-api-access-dn7pn") pod "ce5c900a-96c7-4040-bfbb-a08a1566cece" (UID: "ce5c900a-96c7-4040-bfbb-a08a1566cece"). InnerVolumeSpecName "kube-api-access-dn7pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:14:14.801789 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:14.801741    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn7pn\" (UniqueName: \"kubernetes.io/projected/ce5c900a-96c7-4040-bfbb-a08a1566cece-kube-api-access-dn7pn\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:14:15.480824 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:15.480793    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-33054d"
Sep 06 01:14:15.480987 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:15.480829    2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="163d6c4027726bc8ceb385de4322d57a3816381459e2d7eb55576c1a1293d004"
Sep 06 01:14:15.490674 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:14:15.490645    2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7781-33054d\" is forbidden: User \"system:node:ip-10-0-130-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-34.ec2.internal' and this object" podUID="ce5c900a-96c7-4040-bfbb-a08a1566cece" pod="opendatahub/mt-curl-7781-33054d"
Sep 06 01:14:15.986133 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:15.986103    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce5c900a-96c7-4040-bfbb-a08a1566cece" path="/var/lib/kubelet/pods/ce5c900a-96c7-4040-bfbb-a08a1566cece/volumes"
Sep 06 01:14:26.032530 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.032497    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"]
Sep 06 01:14:26.032873 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.032857    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5c900a-96c7-4040-bfbb-a08a1566cece" containerName="mt-curl-7781-33054d"
Sep 06 01:14:26.032873 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.032869    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5c900a-96c7-4040-bfbb-a08a1566cece" containerName="mt-curl-7781-33054d"
Sep 06 01:14:26.032947 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.032940    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5c900a-96c7-4040-bfbb-a08a1566cece" containerName="mt-curl-7781-33054d"
Sep 06 01:14:26.037116 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.037091    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.040045 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.040021    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2d5f29-serving-cert\""
Sep 06 01:14:26.060154 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.060130    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"]
Sep 06 01:14:26.089107 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.089071    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-maas-api-tls\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.089107 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.089106    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-openshift-service-ca\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.089300 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.089148    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6fsv\" (UniqueName: \"kubernetes.io/projected/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-kube-api-access-p6fsv\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.089366 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.089297    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-metrics-certs\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.190525 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.190485    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-maas-api-tls\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.190665 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.190533    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-openshift-service-ca\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.190665 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.190574    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fsv\" (UniqueName: \"kubernetes.io/projected/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-kube-api-access-p6fsv\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.190665 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:14:26.190629    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-serving-cert: secret "maas-api-e2e-api-a-2d5f29-serving-cert" not found
Sep 06 01:14:26.190842 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:14:26.190706    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-maas-api-tls podName:ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29 nodeName:}" failed. No retries permitted until 2026-09-06 01:14:26.690685876 +0000 UTC m=+1447.224320184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-maas-api-tls") pod "maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7" (UID: "ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29") : secret "maas-api-e2e-api-a-2d5f29-serving-cert" not found
Sep 06 01:14:26.190842 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.190639    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-metrics-certs\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.191211 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.191194    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-openshift-service-ca\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.193080 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.193058    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-metrics-certs\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.201087 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.201070    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6fsv\" (UniqueName: \"kubernetes.io/projected/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-kube-api-access-p6fsv\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.694542 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.694510    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-maas-api-tls\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.696781 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.696757    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-maas-api-tls\") pod \"maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:26.947310 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:26.947195    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:27.222757 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:27.222732    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"]
Sep 06 01:14:27.224835 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:14:27.224806    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba04ffe7_5721_4b6c_b2cc_6bf4ff31ea29.slice/crio-6c64cab432dcffca3e4efd206b69c28a0662bfef0ff506c463f724f5320e3602 WatchSource:0}: Error finding container 6c64cab432dcffca3e4efd206b69c28a0662bfef0ff506c463f724f5320e3602: Status 404 returned error can't find the container with id 6c64cab432dcffca3e4efd206b69c28a0662bfef0ff506c463f724f5320e3602
Sep 06 01:14:27.536647 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:27.536564    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7" event={"ID":"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29","Type":"ContainerStarted","Data":"6c64cab432dcffca3e4efd206b69c28a0662bfef0ff506c463f724f5320e3602"}
Sep 06 01:14:28.542768 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:28.542719    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7" event={"ID":"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29","Type":"ContainerStarted","Data":"9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919"}
Sep 06 01:14:28.543148 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:28.542836    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:28.562944 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:28.562896    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7" podStartSLOduration=2.982285672 podStartE2EDuration="3.562879653s" totalImagesPullingTime="580.593981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:28.561603258 +0000 UTC m=+1449.095237577" watchObservedRunningTime="2026-09-06 01:14:28.562879653 +0000 UTC m=+1449.096513980"
Sep 06 01:14:34.552470 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:34.552441    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:14:54.512405 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.512374    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"]
Sep 06 01:14:54.516070 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.516050    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:54.518734 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.518715    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-1f7961-serving-cert\""
Sep 06 01:14:54.533172 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.533148    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"]
Sep 06 01:14:54.627949 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.627909    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-maas-api-tls\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:54.628141 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.627963    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-metrics-certs\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:54.628214 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.628125    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4830facf-2328-490d-b6c3-7b2025682503-openshift-service-ca\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:54.628214 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.628164    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sf2b\" (UniqueName: \"kubernetes.io/projected/4830facf-2328-490d-b6c3-7b2025682503-kube-api-access-7sf2b\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:54.729015 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.728983    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4830facf-2328-490d-b6c3-7b2025682503-openshift-service-ca\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:54.729015 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.729015    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sf2b\" (UniqueName: \"kubernetes.io/projected/4830facf-2328-490d-b6c3-7b2025682503-kube-api-access-7sf2b\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:54.729199 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.729045    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-maas-api-tls\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:54.729199 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.729066    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-metrics-certs\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:54.729199 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:14:54.729149    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-serving-cert: secret "maas-api-e2e-api-b-1f7961-serving-cert" not found
Sep 06 01:14:54.729358 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:14:54.729230    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-maas-api-tls podName:4830facf-2328-490d-b6c3-7b2025682503 nodeName:}" failed. No retries permitted until 2026-09-06 01:14:55.22920986 +0000 UTC m=+1475.762844178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-maas-api-tls") pod "maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf" (UID: "4830facf-2328-490d-b6c3-7b2025682503") : secret "maas-api-e2e-api-b-1f7961-serving-cert" not found
Sep 06 01:14:54.729730 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.729707    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4830facf-2328-490d-b6c3-7b2025682503-openshift-service-ca\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:54.731491 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.731472    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-metrics-certs\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:54.738226 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:54.738183    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sf2b\" (UniqueName: \"kubernetes.io/projected/4830facf-2328-490d-b6c3-7b2025682503-kube-api-access-7sf2b\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:55.233802 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:55.233764    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-maas-api-tls\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:55.236082 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:55.236061    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-maas-api-tls\") pod \"maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:55.427743 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:55.427705    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:55.697083 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:55.697060    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"]
Sep 06 01:14:55.699358 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:14:55.699335    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4830facf_2328_490d_b6c3_7b2025682503.slice/crio-48aa4a3921b0907c1e2d24e5908a4d2a56fc78f3d200f0a4b240c8e367b9fde5 WatchSource:0}: Error finding container 48aa4a3921b0907c1e2d24e5908a4d2a56fc78f3d200f0a4b240c8e367b9fde5: Status 404 returned error can't find the container with id 48aa4a3921b0907c1e2d24e5908a4d2a56fc78f3d200f0a4b240c8e367b9fde5
Sep 06 01:14:56.672897 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:56.672864    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf" event={"ID":"4830facf-2328-490d-b6c3-7b2025682503","Type":"ContainerStarted","Data":"1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482"}
Sep 06 01:14:56.673068 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:56.672914    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf" event={"ID":"4830facf-2328-490d-b6c3-7b2025682503","Type":"ContainerStarted","Data":"48aa4a3921b0907c1e2d24e5908a4d2a56fc78f3d200f0a4b240c8e367b9fde5"}
Sep 06 01:14:56.673068 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:56.672986    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:14:56.690800 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:14:56.690750    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf" podStartSLOduration=2.323967332 podStartE2EDuration="2.690738219s" totalImagesPullingTime="366.770887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:56.689842792 +0000 UTC m=+1477.223477135" watchObservedRunningTime="2026-09-06 01:14:56.690738219 +0000 UTC m=+1477.224372592"
Sep 06 01:15:02.682980 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:02.682950    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:15:20.027311 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:20.027255    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:15:20.030749 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:20.030725    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:15:37.169785 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.169749    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"]
Sep 06 01:15:37.170232 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.170016    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7" podUID="ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29" containerName="maas-api" containerID="cri-o://9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919" gracePeriod=30
Sep 06 01:15:37.403009 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.402985    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:15:37.503044 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.503017    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-metrics-certs\") pod \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") "
Sep 06 01:15:37.503211 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.503075    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-maas-api-tls\") pod \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") "
Sep 06 01:15:37.503211 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.503123    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-openshift-service-ca\") pod \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") "
Sep 06 01:15:37.503211 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.503146    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6fsv\" (UniqueName: \"kubernetes.io/projected/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-kube-api-access-p6fsv\") pod \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\" (UID: \"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29\") "
Sep 06 01:15:37.503507 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.503486    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29" (UID: "ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:15:37.505130 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.505085    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29" (UID: "ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:15:37.505233 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.505175    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29" (UID: "ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:15:37.505233 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.505183    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-kube-api-access-p6fsv" (OuterVolumeSpecName: "kube-api-access-p6fsv") pod "ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29" (UID: "ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29"). InnerVolumeSpecName "kube-api-access-p6fsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:37.604402 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.604372    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:15:37.604402 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.604401    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:15:37.604584 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.604414    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:15:37.604584 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.604424    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6fsv\" (UniqueName: \"kubernetes.io/projected/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29-kube-api-access-p6fsv\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:15:37.870397 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.870316    2548 generic.go:356] "Generic (PLEG): container finished" podID="ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29" containerID="9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919" exitCode=0
Sep 06 01:15:37.870397 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.870366    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"
Sep 06 01:15:37.870397 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.870389    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7" event={"ID":"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29","Type":"ContainerDied","Data":"9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919"}
Sep 06 01:15:37.870605 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.870438    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7" event={"ID":"ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29","Type":"ContainerDied","Data":"6c64cab432dcffca3e4efd206b69c28a0662bfef0ff506c463f724f5320e3602"}
Sep 06 01:15:37.870605 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.870467    2548 scope.go:117] "RemoveContainer" containerID="9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919"
Sep 06 01:15:37.882165 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.882146    2548 scope.go:117] "RemoveContainer" containerID="9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919"
Sep 06 01:15:37.882428 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:15:37.882409    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919\": container with ID starting with 9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919 not found: ID does not exist" containerID="9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919"
Sep 06 01:15:37.882493 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.882436    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919"} err="failed to get container status \"9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919\": rpc error: code = NotFound desc = could not find container \"9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919\": container with ID starting with 9e2338651544760563ade6fb4aea627e775302bc7aa792f4c6e4c09b5ef9b919 not found: ID does not exist"
Sep 06 01:15:37.895156 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.895131    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"]
Sep 06 01:15:37.903282 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.903248    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2d5f29-d75bc8b89-nvln7"]
Sep 06 01:15:37.992657 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:37.992626    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29" path="/var/lib/kubelet/pods/ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29/volumes"
Sep 06 01:15:50.803774 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:50.803697    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"]
Sep 06 01:15:50.804201 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:50.804127    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29" containerName="maas-api"
Sep 06 01:15:50.804201 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:50.804143    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29" containerName="maas-api"
Sep 06 01:15:50.804295 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:50.804213    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba04ffe7-5721-4b6c-b2cc-6bf4ff31ea29" containerName="maas-api"
Sep 06 01:15:50.807103 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:50.807082    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:50.809489 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:50.809466    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-b2e4f6-serving-cert\""
Sep 06 01:15:50.817646 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:50.817591    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"]
Sep 06 01:15:50.913824 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:50.913794    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4902aba-de36-4c69-b3c1-91482ff86d81-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:50.914009 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:50.913863    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjv8v\" (UniqueName: \"kubernetes.io/projected/b4902aba-de36-4c69-b3c1-91482ff86d81-kube-api-access-kjv8v\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:50.914009 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:50.913930    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:50.914009 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:50.914001    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-metrics-certs\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:51.014866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.014834    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4902aba-de36-4c69-b3c1-91482ff86d81-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:51.015021 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.014875    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv8v\" (UniqueName: \"kubernetes.io/projected/b4902aba-de36-4c69-b3c1-91482ff86d81-kube-api-access-kjv8v\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:51.015021 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.014906    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:51.015021 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.014936    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-metrics-certs\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:51.015618 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.015596    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4902aba-de36-4c69-b3c1-91482ff86d81-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:51.017300 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.017254    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:51.017393 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.017373    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-metrics-certs\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:51.023292 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.023251    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjv8v\" (UniqueName: \"kubernetes.io/projected/b4902aba-de36-4c69-b3c1-91482ff86d81-kube-api-access-kjv8v\") pod \"maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:51.121051 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.121004    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:51.410725 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.410700    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"]
Sep 06 01:15:51.413590 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:15:51.413558    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4902aba_de36_4c69_b3c1_91482ff86d81.slice/crio-df33327e15ec3d3afa84af73e756a7fa2d419e73d074a3bae0c42e6f5f6fd471 WatchSource:0}: Error finding container df33327e15ec3d3afa84af73e756a7fa2d419e73d074a3bae0c42e6f5f6fd471: Status 404 returned error can't find the container with id df33327e15ec3d3afa84af73e756a7fa2d419e73d074a3bae0c42e6f5f6fd471
Sep 06 01:15:51.415290 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.415249    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:15:51.936944 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.936916    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb" event={"ID":"b4902aba-de36-4c69-b3c1-91482ff86d81","Type":"ContainerStarted","Data":"8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f"}
Sep 06 01:15:51.937365 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.936965    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb" event={"ID":"b4902aba-de36-4c69-b3c1-91482ff86d81","Type":"ContainerStarted","Data":"df33327e15ec3d3afa84af73e756a7fa2d419e73d074a3bae0c42e6f5f6fd471"}
Sep 06 01:15:51.937365 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.936989    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:15:51.956469 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:51.956422    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb" podStartSLOduration=1.533011876 podStartE2EDuration="1.956406265s" totalImagesPullingTime="423.394389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:51.955006715 +0000 UTC m=+1532.488641043" watchObservedRunningTime="2026-09-06 01:15:51.956406265 +0000 UTC m=+1532.490040592"
Sep 06 01:15:57.948807 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:15:57.948772    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:16:00.575970 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.575938    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"]
Sep 06 01:16:00.576438 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.576186    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf" podUID="4830facf-2328-490d-b6c3-7b2025682503" containerName="maas-api" containerID="cri-o://1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482" gracePeriod=30
Sep 06 01:16:00.823089 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.823068    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:16:00.898011 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.897953    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4830facf-2328-490d-b6c3-7b2025682503-openshift-service-ca\") pod \"4830facf-2328-490d-b6c3-7b2025682503\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") "
Sep 06 01:16:00.898135 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.898023    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-metrics-certs\") pod \"4830facf-2328-490d-b6c3-7b2025682503\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") "
Sep 06 01:16:00.898222 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.898200    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sf2b\" (UniqueName: \"kubernetes.io/projected/4830facf-2328-490d-b6c3-7b2025682503-kube-api-access-7sf2b\") pod \"4830facf-2328-490d-b6c3-7b2025682503\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") "
Sep 06 01:16:00.898301 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.898289    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-maas-api-tls\") pod \"4830facf-2328-490d-b6c3-7b2025682503\" (UID: \"4830facf-2328-490d-b6c3-7b2025682503\") "
Sep 06 01:16:00.898362 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.898290    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4830facf-2328-490d-b6c3-7b2025682503-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4830facf-2328-490d-b6c3-7b2025682503" (UID: "4830facf-2328-490d-b6c3-7b2025682503"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:16:00.898576 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.898556    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4830facf-2328-490d-b6c3-7b2025682503-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:00.900029 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.900008    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4830facf-2328-490d-b6c3-7b2025682503" (UID: "4830facf-2328-490d-b6c3-7b2025682503"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:16:00.900207 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.900181    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4830facf-2328-490d-b6c3-7b2025682503-kube-api-access-7sf2b" (OuterVolumeSpecName: "kube-api-access-7sf2b") pod "4830facf-2328-490d-b6c3-7b2025682503" (UID: "4830facf-2328-490d-b6c3-7b2025682503"). InnerVolumeSpecName "kube-api-access-7sf2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:16:00.900207 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.900185    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4830facf-2328-490d-b6c3-7b2025682503" (UID: "4830facf-2328-490d-b6c3-7b2025682503"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:16:00.983102 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.983066    2548 generic.go:356] "Generic (PLEG): container finished" podID="4830facf-2328-490d-b6c3-7b2025682503" containerID="1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482" exitCode=0
Sep 06 01:16:00.983375 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.983141    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"
Sep 06 01:16:00.983375 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.983147    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf" event={"ID":"4830facf-2328-490d-b6c3-7b2025682503","Type":"ContainerDied","Data":"1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482"}
Sep 06 01:16:00.983375 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.983213    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf" event={"ID":"4830facf-2328-490d-b6c3-7b2025682503","Type":"ContainerDied","Data":"48aa4a3921b0907c1e2d24e5908a4d2a56fc78f3d200f0a4b240c8e367b9fde5"}
Sep 06 01:16:00.983375 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.983246    2548 scope.go:117] "RemoveContainer" containerID="1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482"
Sep 06 01:16:00.994135 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.994119    2548 scope.go:117] "RemoveContainer" containerID="1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482"
Sep 06 01:16:00.994479 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:16:00.994459    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482\": container with ID starting with 1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482 not found: ID does not exist" containerID="1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482"
Sep 06 01:16:00.994563 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.994486    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482"} err="failed to get container status \"1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482\": rpc error: code = NotFound desc = could not find container \"1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482\": container with ID starting with 1c77260d5cbec84b23860097397a39fe5b845e6e0596760e4b44e7ff3ccad482 not found: ID does not exist"
Sep 06 01:16:00.999791 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.999770    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:00.999791 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.999789    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sf2b\" (UniqueName: \"kubernetes.io/projected/4830facf-2328-490d-b6c3-7b2025682503-kube-api-access-7sf2b\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:00.999922 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:00.999800    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4830facf-2328-490d-b6c3-7b2025682503-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:01.006760 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:01.006737    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"]
Sep 06 01:16:01.008910 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:01.008892    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1f7961-748fdf8cdb-98vbf"]
Sep 06 01:16:01.987095 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:01.987058    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4830facf-2328-490d-b6c3-7b2025682503" path="/var/lib/kubelet/pods/4830facf-2328-490d-b6c3-7b2025682503/volumes"
Sep 06 01:16:18.278219 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.278188    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"]
Sep 06 01:16:18.280942 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.278413    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z" podUID="a918b220-6890-459f-9735-c6a566a508c6" containerName="maas-api" containerID="cri-o://ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5" gracePeriod=30
Sep 06 01:16:18.323881 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.323845    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z" podUID="a918b220-6890-459f-9735-c6a566a508c6" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.44:8443/health\": dial tcp 10.132.0.44:8443: connect: connection refused"
Sep 06 01:16:18.519726 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.519700    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:16:18.643068 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.642978    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7kdv\" (UniqueName: \"kubernetes.io/projected/a918b220-6890-459f-9735-c6a566a508c6-kube-api-access-j7kdv\") pod \"a918b220-6890-459f-9735-c6a566a508c6\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") "
Sep 06 01:16:18.643068 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.643021    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-maas-api-tls\") pod \"a918b220-6890-459f-9735-c6a566a508c6\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") "
Sep 06 01:16:18.643068 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.643064    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-metrics-certs\") pod \"a918b220-6890-459f-9735-c6a566a508c6\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") "
Sep 06 01:16:18.643379 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.643108    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a918b220-6890-459f-9735-c6a566a508c6-openshift-service-ca\") pod \"a918b220-6890-459f-9735-c6a566a508c6\" (UID: \"a918b220-6890-459f-9735-c6a566a508c6\") "
Sep 06 01:16:18.643563 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.643530    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a918b220-6890-459f-9735-c6a566a508c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a918b220-6890-459f-9735-c6a566a508c6" (UID: "a918b220-6890-459f-9735-c6a566a508c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:16:18.646165 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.646047    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a918b220-6890-459f-9735-c6a566a508c6-kube-api-access-j7kdv" (OuterVolumeSpecName: "kube-api-access-j7kdv") pod "a918b220-6890-459f-9735-c6a566a508c6" (UID: "a918b220-6890-459f-9735-c6a566a508c6"). InnerVolumeSpecName "kube-api-access-j7kdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:16:18.646421 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.646386    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a918b220-6890-459f-9735-c6a566a508c6" (UID: "a918b220-6890-459f-9735-c6a566a508c6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:16:18.646590 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.646566    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a918b220-6890-459f-9735-c6a566a508c6" (UID: "a918b220-6890-459f-9735-c6a566a508c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:16:18.743834 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.743803    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:18.743834 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.743828    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a918b220-6890-459f-9735-c6a566a508c6-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:18.743834 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.743839    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7kdv\" (UniqueName: \"kubernetes.io/projected/a918b220-6890-459f-9735-c6a566a508c6-kube-api-access-j7kdv\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:18.744029 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:18.743847    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918b220-6890-459f-9735-c6a566a508c6-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:19.063372 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:19.063344    2548 generic.go:356] "Generic (PLEG): container finished" podID="a918b220-6890-459f-9735-c6a566a508c6" containerID="ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5" exitCode=0
Sep 06 01:16:19.063533 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:19.063386    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"
Sep 06 01:16:19.063533 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:19.063398    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z" event={"ID":"a918b220-6890-459f-9735-c6a566a508c6","Type":"ContainerDied","Data":"ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5"}
Sep 06 01:16:19.063533 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:19.063437    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z" event={"ID":"a918b220-6890-459f-9735-c6a566a508c6","Type":"ContainerDied","Data":"f58fb5179a241bbc6bdac3bb4322fe905aba745061967a3a9d6ff25892039c7b"}
Sep 06 01:16:19.063533 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:19.063456    2548 scope.go:117] "RemoveContainer" containerID="ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5"
Sep 06 01:16:19.072696 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:19.072680    2548 scope.go:117] "RemoveContainer" containerID="ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5"
Sep 06 01:16:19.072953 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:16:19.072934    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5\": container with ID starting with ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5 not found: ID does not exist" containerID="ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5"
Sep 06 01:16:19.073002 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:19.072975    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5"} err="failed to get container status \"ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5\": rpc error: code = NotFound desc = could not find container \"ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5\": container with ID starting with ee85d3b74e305173e3663f7e5a50ebe89541825be1702e3b7084e9c580e837a5 not found: ID does not exist"
Sep 06 01:16:19.085892 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:19.085870    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"]
Sep 06 01:16:19.089648 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:19.089630    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-e6b4e2-56b978d5c8-zls9z"]
Sep 06 01:16:19.987220 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:19.987193    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a918b220-6890-459f-9735-c6a566a508c6" path="/var/lib/kubelet/pods/a918b220-6890-459f-9735-c6a566a508c6/volumes"
Sep 06 01:16:20.199782 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.199732    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"]
Sep 06 01:16:20.200314 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.200291    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4830facf-2328-490d-b6c3-7b2025682503" containerName="maas-api"
Sep 06 01:16:20.200314 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.200312    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4830facf-2328-490d-b6c3-7b2025682503" containerName="maas-api"
Sep 06 01:16:20.200314 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.200329    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a918b220-6890-459f-9735-c6a566a508c6" containerName="maas-api"
Sep 06 01:16:20.200515 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.200338    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a918b220-6890-459f-9735-c6a566a508c6" containerName="maas-api"
Sep 06 01:16:20.200515 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.200440    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="4830facf-2328-490d-b6c3-7b2025682503" containerName="maas-api"
Sep 06 01:16:20.200515 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.200450    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="a918b220-6890-459f-9735-c6a566a508c6" containerName="maas-api"
Sep 06 01:16:20.205070 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.205051    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.207723 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.207704    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-074d50-serving-cert\""
Sep 06 01:16:20.213092 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.213070    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"]
Sep 06 01:16:20.255165 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.255103    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-maas-api-tls\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.255165 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.255160    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-metrics-certs\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.255385 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.255185    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dg2j\" (UniqueName: \"kubernetes.io/projected/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-kube-api-access-6dg2j\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.255385 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.255289    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.356117 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.356089    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-metrics-certs\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.356117 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.356120    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dg2j\" (UniqueName: \"kubernetes.io/projected/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-kube-api-access-6dg2j\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.356367 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.356147    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.356367 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.356195    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-maas-api-tls\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.356367 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:16:20.356316    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-serving-cert: secret "maas-api-e2e-ipp-b-074d50-serving-cert" not found
Sep 06 01:16:20.356503 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:16:20.356378    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-maas-api-tls podName:790be0c2-b91e-45d1-9873-6cfe0a8a5bb6 nodeName:}" failed. No retries permitted until 2026-09-06 01:16:20.856358138 +0000 UTC m=+1561.389992456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-maas-api-tls") pod "maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5" (UID: "790be0c2-b91e-45d1-9873-6cfe0a8a5bb6") : secret "maas-api-e2e-ipp-b-074d50-serving-cert" not found
Sep 06 01:16:20.356926 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.356904    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.358462 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.358441    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-metrics-certs\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.366925 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.366897    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dg2j\" (UniqueName: \"kubernetes.io/projected/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-kube-api-access-6dg2j\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.861659 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.861629    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-maas-api-tls\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:20.863978 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:20.863954    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-maas-api-tls\") pod \"maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:21.117525 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:21.117452    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:21.384962 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:21.384936    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"]
Sep 06 01:16:21.386780 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:16:21.386752    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790be0c2_b91e_45d1_9873_6cfe0a8a5bb6.slice/crio-5cc2270544fd4c988c0f8e4ea5e9a3aa3343600251f42fb10207e34c169399c0 WatchSource:0}: Error finding container 5cc2270544fd4c988c0f8e4ea5e9a3aa3343600251f42fb10207e34c169399c0: Status 404 returned error can't find the container with id 5cc2270544fd4c988c0f8e4ea5e9a3aa3343600251f42fb10207e34c169399c0
Sep 06 01:16:22.081698 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:22.081612    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5" event={"ID":"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6","Type":"ContainerStarted","Data":"196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26"}
Sep 06 01:16:22.081698 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:22.081661    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5" event={"ID":"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6","Type":"ContainerStarted","Data":"5cc2270544fd4c988c0f8e4ea5e9a3aa3343600251f42fb10207e34c169399c0"}
Sep 06 01:16:22.081933 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:22.081753    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:22.099631 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:22.099579    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5" podStartSLOduration=1.758205515 podStartE2EDuration="2.099561803s" totalImagesPullingTime="341.356288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:16:22.099034963 +0000 UTC m=+1562.632669289" watchObservedRunningTime="2026-09-06 01:16:22.099561803 +0000 UTC m=+1562.633196129"
Sep 06 01:16:28.091327 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:28.091294    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:16:36.213993 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.213956    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"]
Sep 06 01:16:36.214481 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.214154    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq" podUID="e8870360-2449-4a3f-a632-8b471e5c29a4" containerName="maas-api" containerID="cri-o://6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7" gracePeriod=30
Sep 06 01:16:36.463694 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.463641    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:16:36.600542 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.600403    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-maas-api-tls\") pod \"e8870360-2449-4a3f-a632-8b471e5c29a4\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") "
Sep 06 01:16:36.600697 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.600610    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dprr8\" (UniqueName: \"kubernetes.io/projected/e8870360-2449-4a3f-a632-8b471e5c29a4-kube-api-access-dprr8\") pod \"e8870360-2449-4a3f-a632-8b471e5c29a4\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") "
Sep 06 01:16:36.600697 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.600685    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8870360-2449-4a3f-a632-8b471e5c29a4-openshift-service-ca\") pod \"e8870360-2449-4a3f-a632-8b471e5c29a4\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") "
Sep 06 01:16:36.600822 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.600780    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-metrics-certs\") pod \"e8870360-2449-4a3f-a632-8b471e5c29a4\" (UID: \"e8870360-2449-4a3f-a632-8b471e5c29a4\") "
Sep 06 01:16:36.601107 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.601082    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8870360-2449-4a3f-a632-8b471e5c29a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8870360-2449-4a3f-a632-8b471e5c29a4" (UID: "e8870360-2449-4a3f-a632-8b471e5c29a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:16:36.602520 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.602495    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8870360-2449-4a3f-a632-8b471e5c29a4" (UID: "e8870360-2449-4a3f-a632-8b471e5c29a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:16:36.602692 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.602674    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8870360-2449-4a3f-a632-8b471e5c29a4-kube-api-access-dprr8" (OuterVolumeSpecName: "kube-api-access-dprr8") pod "e8870360-2449-4a3f-a632-8b471e5c29a4" (UID: "e8870360-2449-4a3f-a632-8b471e5c29a4"). InnerVolumeSpecName "kube-api-access-dprr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:16:36.602930 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.602913    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e8870360-2449-4a3f-a632-8b471e5c29a4" (UID: "e8870360-2449-4a3f-a632-8b471e5c29a4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:16:36.701642 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.701614    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8870360-2449-4a3f-a632-8b471e5c29a4-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:36.701642 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.701638    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:36.701642 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.701647    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8870360-2449-4a3f-a632-8b471e5c29a4-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:36.701845 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:36.701656    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dprr8\" (UniqueName: \"kubernetes.io/projected/e8870360-2449-4a3f-a632-8b471e5c29a4-kube-api-access-dprr8\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:16:37.147787 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:37.147753    2548 generic.go:356] "Generic (PLEG): container finished" podID="e8870360-2449-4a3f-a632-8b471e5c29a4" containerID="6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7" exitCode=0
Sep 06 01:16:37.147963 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:37.147796    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"
Sep 06 01:16:37.147963 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:37.147805    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq" event={"ID":"e8870360-2449-4a3f-a632-8b471e5c29a4","Type":"ContainerDied","Data":"6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7"}
Sep 06 01:16:37.147963 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:37.147856    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq" event={"ID":"e8870360-2449-4a3f-a632-8b471e5c29a4","Type":"ContainerDied","Data":"8d7bebeec739f2cbac1f71a0c8210728a17aeaab1dbbcc4bc4578e578a67f307"}
Sep 06 01:16:37.147963 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:37.147880    2548 scope.go:117] "RemoveContainer" containerID="6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7"
Sep 06 01:16:37.156941 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:37.156925    2548 scope.go:117] "RemoveContainer" containerID="6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7"
Sep 06 01:16:37.157194 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:16:37.157175    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7\": container with ID starting with 6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7 not found: ID does not exist" containerID="6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7"
Sep 06 01:16:37.157238 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:37.157203    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7"} err="failed to get container status \"6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7\": rpc error: code = NotFound desc = could not find container \"6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7\": container with ID starting with 6f8b4a5c20d938a2bf7ae34fc446733855b975c68d884c8000043d670c5e87f7 not found: ID does not exist"
Sep 06 01:16:37.172023 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:37.171959    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"]
Sep 06 01:16:37.174323 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:37.174301    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq"]
Sep 06 01:16:37.987194 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:37.987163    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8870360-2449-4a3f-a632-8b471e5c29a4" path="/var/lib/kubelet/pods/e8870360-2449-4a3f-a632-8b471e5c29a4/volumes"
Sep 06 01:16:39.457745 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:16:39.457700    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-812148-7f8685656f-lzcwq" podUID="e8870360-2449-4a3f-a632-8b471e5c29a4" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.45:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 06 01:17:29.401882 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.401841    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"]
Sep 06 01:17:29.402331 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.402284    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8870360-2449-4a3f-a632-8b471e5c29a4" containerName="maas-api"
Sep 06 01:17:29.402331 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.402298    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8870360-2449-4a3f-a632-8b471e5c29a4" containerName="maas-api"
Sep 06 01:17:29.402412 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.402351    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8870360-2449-4a3f-a632-8b471e5c29a4" containerName="maas-api"
Sep 06 01:17:29.405535 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.405512    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.408609 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.408579    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-3032be-serving-cert\""
Sep 06 01:17:29.417477 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.417448    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"]
Sep 06 01:17:29.549187 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.549151    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.549422 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.549214    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcwv8\" (UniqueName: \"kubernetes.io/projected/e0556229-4625-4c70-b4ff-e2c321051ece-kube-api-access-pcwv8\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.549422 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.549361    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0556229-4625-4c70-b4ff-e2c321051ece-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.549422 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.549401    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.650097 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.650042    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.650335 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.650123    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwv8\" (UniqueName: \"kubernetes.io/projected/e0556229-4625-4c70-b4ff-e2c321051ece-kube-api-access-pcwv8\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.650335 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.650176    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0556229-4625-4c70-b4ff-e2c321051ece-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.650335 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.650192    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.650808 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.650784    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0556229-4625-4c70-b4ff-e2c321051ece-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.652669 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.652607    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.652669 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.652658    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.660985 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.660964    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcwv8\" (UniqueName: \"kubernetes.io/projected/e0556229-4625-4c70-b4ff-e2c321051ece-kube-api-access-pcwv8\") pod \"maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:29.718656 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:29.718615    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:30.000992 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:30.000966    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"]
Sep 06 01:17:30.002813 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:17:30.002789    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0556229_4625_4c70_b4ff_e2c321051ece.slice/crio-74e8851f40a89a1246081a0690935d3572ec6564f435be119a38776f2f67dc7e WatchSource:0}: Error finding container 74e8851f40a89a1246081a0690935d3572ec6564f435be119a38776f2f67dc7e: Status 404 returned error can't find the container with id 74e8851f40a89a1246081a0690935d3572ec6564f435be119a38776f2f67dc7e
Sep 06 01:17:30.387598 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:30.387516    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v" event={"ID":"e0556229-4625-4c70-b4ff-e2c321051ece","Type":"ContainerStarted","Data":"74e8851f40a89a1246081a0690935d3572ec6564f435be119a38776f2f67dc7e"}
Sep 06 01:17:31.393633 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:31.393597    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v" event={"ID":"e0556229-4625-4c70-b4ff-e2c321051ece","Type":"ContainerStarted","Data":"840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9"}
Sep 06 01:17:31.394068 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:31.393729    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:31.411153 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:31.411099    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v" podStartSLOduration=2.018412865 podStartE2EDuration="2.411079665s" totalImagesPullingTime="392.6668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:17:31.410845116 +0000 UTC m=+1631.944479465" watchObservedRunningTime="2026-09-06 01:17:31.411079665 +0000 UTC m=+1631.944713991"
Sep 06 01:17:37.403512 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:37.403483    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:17:59.949293 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:59.949246    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"]
Sep 06 01:17:59.949693 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:17:59.949491    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v" podUID="e0556229-4625-4c70-b4ff-e2c321051ece" containerName="maas-api" containerID="cri-o://840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9" gracePeriod=30
Sep 06 01:18:00.190678 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.190653    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:18:00.290470 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.290443    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0556229-4625-4c70-b4ff-e2c321051ece-openshift-service-ca\") pod \"e0556229-4625-4c70-b4ff-e2c321051ece\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") "
Sep 06 01:18:00.290604 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.290478    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-maas-api-tls\") pod \"e0556229-4625-4c70-b4ff-e2c321051ece\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") "
Sep 06 01:18:00.290604 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.290512    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-metrics-certs\") pod \"e0556229-4625-4c70-b4ff-e2c321051ece\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") "
Sep 06 01:18:00.290604 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.290535    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcwv8\" (UniqueName: \"kubernetes.io/projected/e0556229-4625-4c70-b4ff-e2c321051ece-kube-api-access-pcwv8\") pod \"e0556229-4625-4c70-b4ff-e2c321051ece\" (UID: \"e0556229-4625-4c70-b4ff-e2c321051ece\") "
Sep 06 01:18:00.290825 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.290800    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0556229-4625-4c70-b4ff-e2c321051ece-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0556229-4625-4c70-b4ff-e2c321051ece" (UID: "e0556229-4625-4c70-b4ff-e2c321051ece"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:18:00.292660 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.292630    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e0556229-4625-4c70-b4ff-e2c321051ece" (UID: "e0556229-4625-4c70-b4ff-e2c321051ece"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:18:00.292765 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.292679    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0556229-4625-4c70-b4ff-e2c321051ece" (UID: "e0556229-4625-4c70-b4ff-e2c321051ece"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:18:00.292765 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.292712    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0556229-4625-4c70-b4ff-e2c321051ece-kube-api-access-pcwv8" (OuterVolumeSpecName: "kube-api-access-pcwv8") pod "e0556229-4625-4c70-b4ff-e2c321051ece" (UID: "e0556229-4625-4c70-b4ff-e2c321051ece"). InnerVolumeSpecName "kube-api-access-pcwv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:18:00.391221 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.391189    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0556229-4625-4c70-b4ff-e2c321051ece-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:18:00.391221 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.391213    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:18:00.391221 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.391225    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0556229-4625-4c70-b4ff-e2c321051ece-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:18:00.391484 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.391238    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcwv8\" (UniqueName: \"kubernetes.io/projected/e0556229-4625-4c70-b4ff-e2c321051ece-kube-api-access-pcwv8\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:18:00.522824 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.522790    2548 generic.go:356] "Generic (PLEG): container finished" podID="e0556229-4625-4c70-b4ff-e2c321051ece" containerID="840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9" exitCode=0
Sep 06 01:18:00.523004 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.522834    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"
Sep 06 01:18:00.523004 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.522870    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v" event={"ID":"e0556229-4625-4c70-b4ff-e2c321051ece","Type":"ContainerDied","Data":"840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9"}
Sep 06 01:18:00.523004 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.522920    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v" event={"ID":"e0556229-4625-4c70-b4ff-e2c321051ece","Type":"ContainerDied","Data":"74e8851f40a89a1246081a0690935d3572ec6564f435be119a38776f2f67dc7e"}
Sep 06 01:18:00.523004 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.522942    2548 scope.go:117] "RemoveContainer" containerID="840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9"
Sep 06 01:18:00.532587 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.532572    2548 scope.go:117] "RemoveContainer" containerID="840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9"
Sep 06 01:18:00.532843 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:18:00.532825    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9\": container with ID starting with 840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9 not found: ID does not exist" containerID="840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9"
Sep 06 01:18:00.532906 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.532851    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9"} err="failed to get container status \"840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9\": rpc error: code = NotFound desc = could not find container \"840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9\": container with ID starting with 840b715b594605919a016157b2e7b4bd22a948f675cf71006378a56228c0b3d9 not found: ID does not exist"
Sep 06 01:18:00.545048 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.545002    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"]
Sep 06 01:18:00.550995 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:00.550977    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3032be-78f6d8d6b4-mbb8v"]
Sep 06 01:18:01.987295 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:01.987246    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0556229-4625-4c70-b4ff-e2c321051ece" path="/var/lib/kubelet/pods/e0556229-4625-4c70-b4ff-e2c321051ece/volumes"
Sep 06 01:18:25.933668 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:25.933634    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"]
Sep 06 01:18:25.934158 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:25.933881    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb" podUID="b4902aba-de36-4c69-b3c1-91482ff86d81" containerName="maas-api" containerID="cri-o://8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f" gracePeriod=30
Sep 06 01:18:26.186725 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.186666    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:18:26.300007 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.299975    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4902aba-de36-4c69-b3c1-91482ff86d81-openshift-service-ca\") pod \"b4902aba-de36-4c69-b3c1-91482ff86d81\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") "
Sep 06 01:18:26.300177 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.300023    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-metrics-certs\") pod \"b4902aba-de36-4c69-b3c1-91482ff86d81\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") "
Sep 06 01:18:26.300177 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.300124    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjv8v\" (UniqueName: \"kubernetes.io/projected/b4902aba-de36-4c69-b3c1-91482ff86d81-kube-api-access-kjv8v\") pod \"b4902aba-de36-4c69-b3c1-91482ff86d81\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") "
Sep 06 01:18:26.300177 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.300166    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-maas-api-tls\") pod \"b4902aba-de36-4c69-b3c1-91482ff86d81\" (UID: \"b4902aba-de36-4c69-b3c1-91482ff86d81\") "
Sep 06 01:18:26.300416 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.300389    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4902aba-de36-4c69-b3c1-91482ff86d81-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4902aba-de36-4c69-b3c1-91482ff86d81" (UID: "b4902aba-de36-4c69-b3c1-91482ff86d81"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:18:26.300595 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.300579    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4902aba-de36-4c69-b3c1-91482ff86d81-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:18:26.302503 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.302471    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4902aba-de36-4c69-b3c1-91482ff86d81-kube-api-access-kjv8v" (OuterVolumeSpecName: "kube-api-access-kjv8v") pod "b4902aba-de36-4c69-b3c1-91482ff86d81" (UID: "b4902aba-de36-4c69-b3c1-91482ff86d81"). InnerVolumeSpecName "kube-api-access-kjv8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:18:26.302627 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.302521    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b4902aba-de36-4c69-b3c1-91482ff86d81" (UID: "b4902aba-de36-4c69-b3c1-91482ff86d81"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:18:26.302627 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.302545    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4902aba-de36-4c69-b3c1-91482ff86d81" (UID: "b4902aba-de36-4c69-b3c1-91482ff86d81"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:18:26.401412 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.401378    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:18:26.401412 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.401409    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjv8v\" (UniqueName: \"kubernetes.io/projected/b4902aba-de36-4c69-b3c1-91482ff86d81-kube-api-access-kjv8v\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:18:26.401412 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.401420    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4902aba-de36-4c69-b3c1-91482ff86d81-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:18:26.649422 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.649387    2548 generic.go:356] "Generic (PLEG): container finished" podID="b4902aba-de36-4c69-b3c1-91482ff86d81" containerID="8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f" exitCode=0
Sep 06 01:18:26.649614 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.649436    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"
Sep 06 01:18:26.649614 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.649470    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb" event={"ID":"b4902aba-de36-4c69-b3c1-91482ff86d81","Type":"ContainerDied","Data":"8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f"}
Sep 06 01:18:26.649614 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.649527    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb" event={"ID":"b4902aba-de36-4c69-b3c1-91482ff86d81","Type":"ContainerDied","Data":"df33327e15ec3d3afa84af73e756a7fa2d419e73d074a3bae0c42e6f5f6fd471"}
Sep 06 01:18:26.649614 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.649553    2548 scope.go:117] "RemoveContainer" containerID="8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f"
Sep 06 01:18:26.658401 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.658385    2548 scope.go:117] "RemoveContainer" containerID="8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f"
Sep 06 01:18:26.658651 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:18:26.658634    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f\": container with ID starting with 8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f not found: ID does not exist" containerID="8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f"
Sep 06 01:18:26.658698 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.658659    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f"} err="failed to get container status \"8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f\": rpc error: code = NotFound desc = could not find container \"8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f\": container with ID starting with 8904d56f6841237f8154283a07ff5d01948d1761dcd33243b1ac7ce9e50da98f not found: ID does not exist"
Sep 06 01:18:26.669881 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.669859    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"]
Sep 06 01:18:26.673312 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:26.673291    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b2e4f6-7c685b966f-tffrb"]
Sep 06 01:18:27.986037 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:18:27.986001    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4902aba-de36-4c69-b3c1-91482ff86d81" path="/var/lib/kubelet/pods/b4902aba-de36-4c69-b3c1-91482ff86d81/volumes"
Sep 06 01:19:30.922024 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:30.921987    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"]
Sep 06 01:19:30.922536 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:30.922204    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5" podUID="790be0c2-b91e-45d1-9873-6cfe0a8a5bb6" containerName="maas-api" containerID="cri-o://196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26" gracePeriod=30
Sep 06 01:19:31.171925 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.171901    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:19:31.255563 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.255536    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-openshift-service-ca\") pod \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") "
Sep 06 01:19:31.255699 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.255567    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-maas-api-tls\") pod \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") "
Sep 06 01:19:31.255699 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.255602    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-metrics-certs\") pod \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") "
Sep 06 01:19:31.255699 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.255649    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dg2j\" (UniqueName: \"kubernetes.io/projected/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-kube-api-access-6dg2j\") pod \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\" (UID: \"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6\") "
Sep 06 01:19:31.255929 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.255898    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "790be0c2-b91e-45d1-9873-6cfe0a8a5bb6" (UID: "790be0c2-b91e-45d1-9873-6cfe0a8a5bb6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:19:31.257708 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.257686    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "790be0c2-b91e-45d1-9873-6cfe0a8a5bb6" (UID: "790be0c2-b91e-45d1-9873-6cfe0a8a5bb6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:19:31.257786 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.257706    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-kube-api-access-6dg2j" (OuterVolumeSpecName: "kube-api-access-6dg2j") pod "790be0c2-b91e-45d1-9873-6cfe0a8a5bb6" (UID: "790be0c2-b91e-45d1-9873-6cfe0a8a5bb6"). InnerVolumeSpecName "kube-api-access-6dg2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:19:31.257786 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.257738    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "790be0c2-b91e-45d1-9873-6cfe0a8a5bb6" (UID: "790be0c2-b91e-45d1-9873-6cfe0a8a5bb6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:19:31.357185 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.357145    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:19:31.357185 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.357179    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dg2j\" (UniqueName: \"kubernetes.io/projected/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-kube-api-access-6dg2j\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:19:31.357185 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.357192    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:19:31.357463 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.357204    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:19:31.947113 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.947080    2548 generic.go:356] "Generic (PLEG): container finished" podID="790be0c2-b91e-45d1-9873-6cfe0a8a5bb6" containerID="196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26" exitCode=0
Sep 06 01:19:31.947624 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.947123    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5" event={"ID":"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6","Type":"ContainerDied","Data":"196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26"}
Sep 06 01:19:31.947624 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.947189    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5" event={"ID":"790be0c2-b91e-45d1-9873-6cfe0a8a5bb6","Type":"ContainerDied","Data":"5cc2270544fd4c988c0f8e4ea5e9a3aa3343600251f42fb10207e34c169399c0"}
Sep 06 01:19:31.947624 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.947133    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"
Sep 06 01:19:31.947624 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.947221    2548 scope.go:117] "RemoveContainer" containerID="196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26"
Sep 06 01:19:31.956556 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.956539    2548 scope.go:117] "RemoveContainer" containerID="196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26"
Sep 06 01:19:31.956845 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:19:31.956821    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26\": container with ID starting with 196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26 not found: ID does not exist" containerID="196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26"
Sep 06 01:19:31.956925 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.956852    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26"} err="failed to get container status \"196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26\": rpc error: code = NotFound desc = could not find container \"196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26\": container with ID starting with 196f67bb181795b4f3a690ee2dd58e468033a4c813990a7ace796454f06a7b26 not found: ID does not exist"
Sep 06 01:19:31.968550 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.968525    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"]
Sep 06 01:19:31.972497 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.972479    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-074d50-5b49d8bd8c-qhnj5"]
Sep 06 01:19:31.986716 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:31.986697    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="790be0c2-b91e-45d1-9873-6cfe0a8a5bb6" path="/var/lib/kubelet/pods/790be0c2-b91e-45d1-9873-6cfe0a8a5bb6/volumes"
Sep 06 01:19:48.384541 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.384497    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"]
Sep 06 01:19:48.385089 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.384737    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc" podUID="b80c6364-3c30-4054-8512-101fcaba706f" containerName="maas-api" containerID="cri-o://1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488" gracePeriod=30
Sep 06 01:19:48.635352 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.635259    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:19:48.703841 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.703806    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-maas-api-tls\") pod \"b80c6364-3c30-4054-8512-101fcaba706f\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") "
Sep 06 01:19:48.704013 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.703856    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-metrics-certs\") pod \"b80c6364-3c30-4054-8512-101fcaba706f\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") "
Sep 06 01:19:48.704013 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.703886    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80c6364-3c30-4054-8512-101fcaba706f-openshift-service-ca\") pod \"b80c6364-3c30-4054-8512-101fcaba706f\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") "
Sep 06 01:19:48.704013 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.703911    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g56jj\" (UniqueName: \"kubernetes.io/projected/b80c6364-3c30-4054-8512-101fcaba706f-kube-api-access-g56jj\") pod \"b80c6364-3c30-4054-8512-101fcaba706f\" (UID: \"b80c6364-3c30-4054-8512-101fcaba706f\") "
Sep 06 01:19:48.704314 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.704286    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b80c6364-3c30-4054-8512-101fcaba706f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b80c6364-3c30-4054-8512-101fcaba706f" (UID: "b80c6364-3c30-4054-8512-101fcaba706f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:19:48.706090 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.706057    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80c6364-3c30-4054-8512-101fcaba706f-kube-api-access-g56jj" (OuterVolumeSpecName: "kube-api-access-g56jj") pod "b80c6364-3c30-4054-8512-101fcaba706f" (UID: "b80c6364-3c30-4054-8512-101fcaba706f"). InnerVolumeSpecName "kube-api-access-g56jj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:19:48.706188 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.706090    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b80c6364-3c30-4054-8512-101fcaba706f" (UID: "b80c6364-3c30-4054-8512-101fcaba706f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:19:48.706188 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.706105    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b80c6364-3c30-4054-8512-101fcaba706f" (UID: "b80c6364-3c30-4054-8512-101fcaba706f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:19:48.805500 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.805459    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:19:48.805500 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.805495    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80c6364-3c30-4054-8512-101fcaba706f-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:19:48.805500 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.805504    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g56jj\" (UniqueName: \"kubernetes.io/projected/b80c6364-3c30-4054-8512-101fcaba706f-kube-api-access-g56jj\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:19:48.805500 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:48.805512    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80c6364-3c30-4054-8512-101fcaba706f-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:19:49.028881 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:49.028844    2548 generic.go:356] "Generic (PLEG): container finished" podID="b80c6364-3c30-4054-8512-101fcaba706f" containerID="1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488" exitCode=0
Sep 06 01:19:49.029093 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:49.028911    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc" event={"ID":"b80c6364-3c30-4054-8512-101fcaba706f","Type":"ContainerDied","Data":"1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488"}
Sep 06 01:19:49.029093 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:49.028920    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"
Sep 06 01:19:49.029093 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:49.028969    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc" event={"ID":"b80c6364-3c30-4054-8512-101fcaba706f","Type":"ContainerDied","Data":"ff16bf49663760faec6a24c7dbb822c6a563b324b203f05bc78e1d42d3d05e7c"}
Sep 06 01:19:49.029093 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:49.029002    2548 scope.go:117] "RemoveContainer" containerID="1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488"
Sep 06 01:19:49.040012 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:49.039990    2548 scope.go:117] "RemoveContainer" containerID="1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488"
Sep 06 01:19:49.045116 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:19:49.045082    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488\": container with ID starting with 1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488 not found: ID does not exist" containerID="1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488"
Sep 06 01:19:49.045233 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:49.045129    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488"} err="failed to get container status \"1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488\": rpc error: code = NotFound desc = could not find container \"1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488\": container with ID starting with 1832ca27eb11888eb53404dcb3402b3ba059811dd0226e810e09b75f62a29488 not found: ID does not exist"
Sep 06 01:19:49.052712 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:49.052691    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"]
Sep 06 01:19:49.056104 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:49.056085    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5844a8-9f675fdc-vzlnc"]
Sep 06 01:19:49.985861 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:19:49.985822    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b80c6364-3c30-4054-8512-101fcaba706f" path="/var/lib/kubelet/pods/b80c6364-3c30-4054-8512-101fcaba706f/volumes"
Sep 06 01:20:06.422866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.422834    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"]
Sep 06 01:20:06.423354 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.423044    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq" podUID="52cb733c-b3c0-4684-8001-036cad62796b" containerName="maas-api" containerID="cri-o://79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87" gracePeriod=30
Sep 06 01:20:06.664218 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.664194    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:20:06.757730 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.757706    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52cb733c-b3c0-4684-8001-036cad62796b-openshift-service-ca\") pod \"52cb733c-b3c0-4684-8001-036cad62796b\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") "
Sep 06 01:20:06.757872 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.757761    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-maas-api-tls\") pod \"52cb733c-b3c0-4684-8001-036cad62796b\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") "
Sep 06 01:20:06.757872 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.757808    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-metrics-certs\") pod \"52cb733c-b3c0-4684-8001-036cad62796b\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") "
Sep 06 01:20:06.757872 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.757851    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64z8f\" (UniqueName: \"kubernetes.io/projected/52cb733c-b3c0-4684-8001-036cad62796b-kube-api-access-64z8f\") pod \"52cb733c-b3c0-4684-8001-036cad62796b\" (UID: \"52cb733c-b3c0-4684-8001-036cad62796b\") "
Sep 06 01:20:06.758117 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.758095    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52cb733c-b3c0-4684-8001-036cad62796b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "52cb733c-b3c0-4684-8001-036cad62796b" (UID: "52cb733c-b3c0-4684-8001-036cad62796b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:20:06.759858 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.759835    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "52cb733c-b3c0-4684-8001-036cad62796b" (UID: "52cb733c-b3c0-4684-8001-036cad62796b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:20:06.759942 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.759905    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52cb733c-b3c0-4684-8001-036cad62796b-kube-api-access-64z8f" (OuterVolumeSpecName: "kube-api-access-64z8f") pod "52cb733c-b3c0-4684-8001-036cad62796b" (UID: "52cb733c-b3c0-4684-8001-036cad62796b"). InnerVolumeSpecName "kube-api-access-64z8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:20:06.759982 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.759962    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "52cb733c-b3c0-4684-8001-036cad62796b" (UID: "52cb733c-b3c0-4684-8001-036cad62796b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:20:06.858864 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.858833    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64z8f\" (UniqueName: \"kubernetes.io/projected/52cb733c-b3c0-4684-8001-036cad62796b-kube-api-access-64z8f\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:20:06.858864 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.858859    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52cb733c-b3c0-4684-8001-036cad62796b-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:20:06.858864 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.858871    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:20:06.859083 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:06.858879    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52cb733c-b3c0-4684-8001-036cad62796b-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:20:07.109029 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:07.108958    2548 generic.go:356] "Generic (PLEG): container finished" podID="52cb733c-b3c0-4684-8001-036cad62796b" containerID="79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87" exitCode=0
Sep 06 01:20:07.109029 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:07.108996    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq" event={"ID":"52cb733c-b3c0-4684-8001-036cad62796b","Type":"ContainerDied","Data":"79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87"}
Sep 06 01:20:07.109029 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:07.109000    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"
Sep 06 01:20:07.109222 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:07.109034    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq" event={"ID":"52cb733c-b3c0-4684-8001-036cad62796b","Type":"ContainerDied","Data":"92696ca656c861de79a5e6e282036b959486bfe5ff7d703966727d26c5cb5dd7"}
Sep 06 01:20:07.109222 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:07.109056    2548 scope.go:117] "RemoveContainer" containerID="79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87"
Sep 06 01:20:07.117896 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:07.117882    2548 scope.go:117] "RemoveContainer" containerID="79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87"
Sep 06 01:20:07.118160 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:20:07.118141    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87\": container with ID starting with 79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87 not found: ID does not exist" containerID="79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87"
Sep 06 01:20:07.118204 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:07.118168    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87"} err="failed to get container status \"79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87\": rpc error: code = NotFound desc = could not find container \"79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87\": container with ID starting with 79a0bc302e0d2e1a1b67980b7d9d84cf8da67d33138d918b57b53ef705f2df87 not found: ID does not exist"
Sep 06 01:20:07.130088 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:07.130065    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"]
Sep 06 01:20:07.133904 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:07.133886    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-470346-6856b468d6-9zfcq"]
Sep 06 01:20:07.986555 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:07.986523    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52cb733c-b3c0-4684-8001-036cad62796b" path="/var/lib/kubelet/pods/52cb733c-b3c0-4684-8001-036cad62796b/volumes"
Sep 06 01:20:15.837796 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:15.837703    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5545c7878f-x6kxb"]
Sep 06 01:20:15.838232 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:15.838026    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5545c7878f-x6kxb" podUID="5a771160-dc88-4ddc-97f4-7c79baccfd62" containerName="manager" containerID="cri-o://2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d" gracePeriod=30
Sep 06 01:20:16.079297 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.079243    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:20:16.127448 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.127380    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwwx4\" (UniqueName: \"kubernetes.io/projected/5a771160-dc88-4ddc-97f4-7c79baccfd62-kube-api-access-qwwx4\") pod \"5a771160-dc88-4ddc-97f4-7c79baccfd62\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") "
Sep 06 01:20:16.127448 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.127413    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-webhook-cert\") pod \"5a771160-dc88-4ddc-97f4-7c79baccfd62\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") "
Sep 06 01:20:16.127448 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.127435    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-metrics-certs\") pod \"5a771160-dc88-4ddc-97f4-7c79baccfd62\" (UID: \"5a771160-dc88-4ddc-97f4-7c79baccfd62\") "
Sep 06 01:20:16.129472 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.129434    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5a771160-dc88-4ddc-97f4-7c79baccfd62" (UID: "5a771160-dc88-4ddc-97f4-7c79baccfd62"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:20:16.129472 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.129444    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5a771160-dc88-4ddc-97f4-7c79baccfd62" (UID: "5a771160-dc88-4ddc-97f4-7c79baccfd62"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:20:16.129680 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.129480    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a771160-dc88-4ddc-97f4-7c79baccfd62-kube-api-access-qwwx4" (OuterVolumeSpecName: "kube-api-access-qwwx4") pod "5a771160-dc88-4ddc-97f4-7c79baccfd62" (UID: "5a771160-dc88-4ddc-97f4-7c79baccfd62"). InnerVolumeSpecName "kube-api-access-qwwx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:20:16.151790 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.151763    2548 generic.go:356] "Generic (PLEG): container finished" podID="5a771160-dc88-4ddc-97f4-7c79baccfd62" containerID="2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d" exitCode=0
Sep 06 01:20:16.151931 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.151798    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5545c7878f-x6kxb" event={"ID":"5a771160-dc88-4ddc-97f4-7c79baccfd62","Type":"ContainerDied","Data":"2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d"}
Sep 06 01:20:16.151931 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.151827    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5545c7878f-x6kxb"
Sep 06 01:20:16.151931 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.151849    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5545c7878f-x6kxb" event={"ID":"5a771160-dc88-4ddc-97f4-7c79baccfd62","Type":"ContainerDied","Data":"833eed3d8793681611e849f563dcdaa6e7ff2e4ab75bf8df0ad6451ed0fac505"}
Sep 06 01:20:16.151931 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.151871    2548 scope.go:117] "RemoveContainer" containerID="2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d"
Sep 06 01:20:16.160453 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.160434    2548 scope.go:117] "RemoveContainer" containerID="2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d"
Sep 06 01:20:16.160727 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:20:16.160704    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d\": container with ID starting with 2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d not found: ID does not exist" containerID="2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d"
Sep 06 01:20:16.160832 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.160735    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d"} err="failed to get container status \"2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d\": rpc error: code = NotFound desc = could not find container \"2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d\": container with ID starting with 2529fcbad03e60dacbd73dbcad4d8c12d3dee43eebf844d34bcdee2462c25e7d not found: ID does not exist"
Sep 06 01:20:16.174555 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.174530    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5545c7878f-x6kxb"]
Sep 06 01:20:16.180519 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.180500    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5545c7878f-x6kxb"]
Sep 06 01:20:16.228168 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.228147    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:20:16.228168 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.228167    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwwx4\" (UniqueName: \"kubernetes.io/projected/5a771160-dc88-4ddc-97f4-7c79baccfd62-kube-api-access-qwwx4\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:20:16.228305 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:16.228178    2548 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a771160-dc88-4ddc-97f4-7c79baccfd62-webhook-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:20:17.985859 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:17.985826    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a771160-dc88-4ddc-97f4-7c79baccfd62" path="/var/lib/kubelet/pods/5a771160-dc88-4ddc-97f4-7c79baccfd62/volumes"
Sep 06 01:20:20.057134 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:20.057106    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:20:20.060629 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:20.060603    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:20:20.151396 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:20:20.151371    2548 scope.go:117] "RemoveContainer" containerID="26f60af8442ad2abf1d6eac07b1ac57df09cce6703e54045c19568d2c8996882"
Sep 06 01:21:17.046442 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046409    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5545c7878f-qbpgj"]
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046706    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4902aba-de36-4c69-b3c1-91482ff86d81" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046717    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4902aba-de36-4c69-b3c1-91482ff86d81" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046724    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790be0c2-b91e-45d1-9873-6cfe0a8a5bb6" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046729    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="790be0c2-b91e-45d1-9873-6cfe0a8a5bb6" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046737    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52cb733c-b3c0-4684-8001-036cad62796b" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046743    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="52cb733c-b3c0-4684-8001-036cad62796b" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046750    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0556229-4625-4c70-b4ff-e2c321051ece" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046755    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0556229-4625-4c70-b4ff-e2c321051ece" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046764    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a771160-dc88-4ddc-97f4-7c79baccfd62" containerName="manager"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046771    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a771160-dc88-4ddc-97f4-7c79baccfd62" containerName="manager"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046785    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80c6364-3c30-4054-8512-101fcaba706f" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046790    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80c6364-3c30-4054-8512-101fcaba706f" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046845    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="790be0c2-b91e-45d1-9873-6cfe0a8a5bb6" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046853    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="52cb733c-b3c0-4684-8001-036cad62796b" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046859    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80c6364-3c30-4054-8512-101fcaba706f" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046865    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4902aba-de36-4c69-b3c1-91482ff86d81" containerName="maas-api"
Sep 06 01:21:17.046866 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046870    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0556229-4625-4c70-b4ff-e2c321051ece" containerName="maas-api"
Sep 06 01:21:17.047411 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.046876    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a771160-dc88-4ddc-97f4-7c79baccfd62" containerName="manager"
Sep 06 01:21:17.049812 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.049791    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:17.052485 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.052461    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 01:21:17.053560 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.053538    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 01:21:17.053665 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.053589    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 01:21:17.053665 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.053649    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sbh9p\""
Sep 06 01:21:17.111923 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.111894    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5545c7878f-qbpgj"]
Sep 06 01:21:17.117057 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.117034    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-webhook-cert\") pod \"maas-controller-5545c7878f-qbpgj\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") " pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:17.117201 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.117070    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-metrics-certs\") pod \"maas-controller-5545c7878f-qbpgj\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") " pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:17.117201 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.117098    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dd84\" (UniqueName: \"kubernetes.io/projected/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-kube-api-access-2dd84\") pod \"maas-controller-5545c7878f-qbpgj\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") " pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:17.218148 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.218122    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-webhook-cert\") pod \"maas-controller-5545c7878f-qbpgj\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") " pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:17.218308 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.218151    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-metrics-certs\") pod \"maas-controller-5545c7878f-qbpgj\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") " pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:17.218308 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.218175    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dd84\" (UniqueName: \"kubernetes.io/projected/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-kube-api-access-2dd84\") pod \"maas-controller-5545c7878f-qbpgj\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") " pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:17.220725 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.220698    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-metrics-certs\") pod \"maas-controller-5545c7878f-qbpgj\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") " pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:17.220725 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.220722    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-webhook-cert\") pod \"maas-controller-5545c7878f-qbpgj\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") " pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:17.226560 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.226538    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dd84\" (UniqueName: \"kubernetes.io/projected/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-kube-api-access-2dd84\") pod \"maas-controller-5545c7878f-qbpgj\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") " pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:17.359990 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.359918    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:17.630943 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.630916    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5545c7878f-qbpgj"]
Sep 06 01:21:17.632876 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:21:17.632845    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4eb39c5_5781_43e1_8a29_a15c54f6dac5.slice/crio-3527850b97c04eeb06b303bf12cb22fb69caa6a3b983210874fcb5f915db83eb WatchSource:0}: Error finding container 3527850b97c04eeb06b303bf12cb22fb69caa6a3b983210874fcb5f915db83eb: Status 404 returned error can't find the container with id 3527850b97c04eeb06b303bf12cb22fb69caa6a3b983210874fcb5f915db83eb
Sep 06 01:21:17.634172 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:17.634154    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:21:18.426247 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:18.426065    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5545c7878f-qbpgj" event={"ID":"c4eb39c5-5781-43e1-8a29-a15c54f6dac5","Type":"ContainerStarted","Data":"9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83"}
Sep 06 01:21:18.426247 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:18.426120    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5545c7878f-qbpgj" event={"ID":"c4eb39c5-5781-43e1-8a29-a15c54f6dac5","Type":"ContainerStarted","Data":"3527850b97c04eeb06b303bf12cb22fb69caa6a3b983210874fcb5f915db83eb"}
Sep 06 01:21:18.426247 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:18.426161    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:18.446147 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:18.446097    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5545c7878f-qbpgj" podStartSLOduration=1.003114808 podStartE2EDuration="1.446082491s" totalImagesPullingTime="442.967683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:18.44367383 +0000 UTC m=+1858.977308157" watchObservedRunningTime="2026-09-06 01:21:18.446082491 +0000 UTC m=+1858.979716818"
Sep 06 01:21:29.433024 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:29.432993    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:36.737092 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:36.737048    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5545c7878f-qbpgj"]
Sep 06 01:21:36.737609 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:36.737329    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5545c7878f-qbpgj" podUID="c4eb39c5-5781-43e1-8a29-a15c54f6dac5" containerName="manager" containerID="cri-o://9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83" gracePeriod=30
Sep 06 01:21:36.987382 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:36.987316    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:37.091658 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.091625    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-webhook-cert\") pod \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") "
Sep 06 01:21:37.091817 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.091667    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-metrics-certs\") pod \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") "
Sep 06 01:21:37.091817 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.091727    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dd84\" (UniqueName: \"kubernetes.io/projected/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-kube-api-access-2dd84\") pod \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\" (UID: \"c4eb39c5-5781-43e1-8a29-a15c54f6dac5\") "
Sep 06 01:21:37.093770 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.093734    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c4eb39c5-5781-43e1-8a29-a15c54f6dac5" (UID: "c4eb39c5-5781-43e1-8a29-a15c54f6dac5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:21:37.093770 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.093760    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c4eb39c5-5781-43e1-8a29-a15c54f6dac5" (UID: "c4eb39c5-5781-43e1-8a29-a15c54f6dac5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:21:37.093928 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.093789    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-kube-api-access-2dd84" (OuterVolumeSpecName: "kube-api-access-2dd84") pod "c4eb39c5-5781-43e1-8a29-a15c54f6dac5" (UID: "c4eb39c5-5781-43e1-8a29-a15c54f6dac5"). InnerVolumeSpecName "kube-api-access-2dd84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:21:37.192407 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.192375    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dd84\" (UniqueName: \"kubernetes.io/projected/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-kube-api-access-2dd84\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:21:37.192407 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.192400    2548 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-webhook-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:21:37.192407 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.192409    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4eb39c5-5781-43e1-8a29-a15c54f6dac5-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:21:37.510346 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.510311    2548 generic.go:356] "Generic (PLEG): container finished" podID="c4eb39c5-5781-43e1-8a29-a15c54f6dac5" containerID="9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83" exitCode=0
Sep 06 01:21:37.510526 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.510363    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5545c7878f-qbpgj"
Sep 06 01:21:37.510526 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.510399    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5545c7878f-qbpgj" event={"ID":"c4eb39c5-5781-43e1-8a29-a15c54f6dac5","Type":"ContainerDied","Data":"9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83"}
Sep 06 01:21:37.510526 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.510458    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5545c7878f-qbpgj" event={"ID":"c4eb39c5-5781-43e1-8a29-a15c54f6dac5","Type":"ContainerDied","Data":"3527850b97c04eeb06b303bf12cb22fb69caa6a3b983210874fcb5f915db83eb"}
Sep 06 01:21:37.510526 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.510482    2548 scope.go:117] "RemoveContainer" containerID="9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83"
Sep 06 01:21:37.519901 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.519879    2548 scope.go:117] "RemoveContainer" containerID="9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83"
Sep 06 01:21:37.520324 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:21:37.520230    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83\": container with ID starting with 9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83 not found: ID does not exist" containerID="9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83"
Sep 06 01:21:37.520324 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.520286    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83"} err="failed to get container status \"9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83\": rpc error: code = NotFound desc = could not find container \"9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83\": container with ID starting with 9ebeb5b5f9fc4df90170538e2a45e947f775571644c43b9befbbd9e0f0cfbc83 not found: ID does not exist"
Sep 06 01:21:37.532575 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.532551    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5545c7878f-qbpgj"]
Sep 06 01:21:37.537296 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.537275    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5545c7878f-qbpgj"]
Sep 06 01:21:37.986579 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:37.986545    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4eb39c5-5781-43e1-8a29-a15c54f6dac5" path="/var/lib/kubelet/pods/c4eb39c5-5781-43e1-8a29-a15c54f6dac5/volumes"
Sep 06 01:21:38.347193 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.347109    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5545c7878f-lk7wd"]
Sep 06 01:21:38.347474 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.347460    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4eb39c5-5781-43e1-8a29-a15c54f6dac5" containerName="manager"
Sep 06 01:21:38.347520 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.347475    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4eb39c5-5781-43e1-8a29-a15c54f6dac5" containerName="manager"
Sep 06 01:21:38.347603 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.347536    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4eb39c5-5781-43e1-8a29-a15c54f6dac5" containerName="manager"
Sep 06 01:21:38.351757 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.351737    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:38.355817 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.355768    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 01:21:38.355999 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.355768    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 01:21:38.355999 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.355885    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 01:21:38.355999 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.355909    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sbh9p\""
Sep 06 01:21:38.360862 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.360841    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5545c7878f-lk7wd"]
Sep 06 01:21:38.504155 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.504119    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cec6dcc-8766-433e-b29f-1866fe0c120d-metrics-certs\") pod \"maas-controller-5545c7878f-lk7wd\" (UID: \"8cec6dcc-8766-433e-b29f-1866fe0c120d\") " pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:38.504383 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.504163    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cec6dcc-8766-433e-b29f-1866fe0c120d-webhook-cert\") pod \"maas-controller-5545c7878f-lk7wd\" (UID: \"8cec6dcc-8766-433e-b29f-1866fe0c120d\") " pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:38.504383 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.504340    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7sr5\" (UniqueName: \"kubernetes.io/projected/8cec6dcc-8766-433e-b29f-1866fe0c120d-kube-api-access-h7sr5\") pod \"maas-controller-5545c7878f-lk7wd\" (UID: \"8cec6dcc-8766-433e-b29f-1866fe0c120d\") " pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:38.605124 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.605034    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7sr5\" (UniqueName: \"kubernetes.io/projected/8cec6dcc-8766-433e-b29f-1866fe0c120d-kube-api-access-h7sr5\") pod \"maas-controller-5545c7878f-lk7wd\" (UID: \"8cec6dcc-8766-433e-b29f-1866fe0c120d\") " pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:38.605124 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.605107    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cec6dcc-8766-433e-b29f-1866fe0c120d-metrics-certs\") pod \"maas-controller-5545c7878f-lk7wd\" (UID: \"8cec6dcc-8766-433e-b29f-1866fe0c120d\") " pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:38.605385 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.605134    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cec6dcc-8766-433e-b29f-1866fe0c120d-webhook-cert\") pod \"maas-controller-5545c7878f-lk7wd\" (UID: \"8cec6dcc-8766-433e-b29f-1866fe0c120d\") " pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:38.607603 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.607580    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cec6dcc-8766-433e-b29f-1866fe0c120d-metrics-certs\") pod \"maas-controller-5545c7878f-lk7wd\" (UID: \"8cec6dcc-8766-433e-b29f-1866fe0c120d\") " pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:38.607747 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.607729    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cec6dcc-8766-433e-b29f-1866fe0c120d-webhook-cert\") pod \"maas-controller-5545c7878f-lk7wd\" (UID: \"8cec6dcc-8766-433e-b29f-1866fe0c120d\") " pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:38.612971 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.612942    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7sr5\" (UniqueName: \"kubernetes.io/projected/8cec6dcc-8766-433e-b29f-1866fe0c120d-kube-api-access-h7sr5\") pod \"maas-controller-5545c7878f-lk7wd\" (UID: \"8cec6dcc-8766-433e-b29f-1866fe0c120d\") " pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:38.662811 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.662784    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:38.933181 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:38.933096    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5545c7878f-lk7wd"]
Sep 06 01:21:38.936209 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:21:38.936181    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cec6dcc_8766_433e_b29f_1866fe0c120d.slice/crio-ec2c64fce8319bab6403236f013a98a581806040f2d2cd95b8a29b2faaa2b3fb WatchSource:0}: Error finding container ec2c64fce8319bab6403236f013a98a581806040f2d2cd95b8a29b2faaa2b3fb: Status 404 returned error can't find the container with id ec2c64fce8319bab6403236f013a98a581806040f2d2cd95b8a29b2faaa2b3fb
Sep 06 01:21:39.523615 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:39.523582    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5545c7878f-lk7wd" event={"ID":"8cec6dcc-8766-433e-b29f-1866fe0c120d","Type":"ContainerStarted","Data":"d1e606b66aed21c381ea0187057b9e7f27ebbceba83cb1bf10b320e00e522ef0"}
Sep 06 01:21:39.524005 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:39.523636    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5545c7878f-lk7wd" event={"ID":"8cec6dcc-8766-433e-b29f-1866fe0c120d","Type":"ContainerStarted","Data":"ec2c64fce8319bab6403236f013a98a581806040f2d2cd95b8a29b2faaa2b3fb"}
Sep 06 01:21:39.524005 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:39.523673    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:21:39.543200 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:39.543093    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5545c7878f-lk7wd" podStartSLOduration=1.2037948059999999 podStartE2EDuration="1.543074614s" totalImagesPullingTime="339.279808ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:39.542056701 +0000 UTC m=+1880.075691030" watchObservedRunningTime="2026-09-06 01:21:39.543074614 +0000 UTC m=+1880.076708942"
Sep 06 01:21:50.531219 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:21:50.531138    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5545c7878f-lk7wd"
Sep 06 01:25:20.081939 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:20.081914    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:25:20.087228 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:20.087208    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:25:35.022224 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.022194    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"]
Sep 06 01:25:35.025594 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.025575    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.035634 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.035610    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"]
Sep 06 01:25:35.109621 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.109589    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59fc4eec-64a0-42a6-af53-2edc09a98048-maas-api-tls\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.109741 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.109634    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fznbw\" (UniqueName: \"kubernetes.io/projected/59fc4eec-64a0-42a6-af53-2edc09a98048-kube-api-access-fznbw\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.109741 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.109703    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59fc4eec-64a0-42a6-af53-2edc09a98048-openshift-service-ca\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.109741 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.109738    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59fc4eec-64a0-42a6-af53-2edc09a98048-metrics-certs\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.210886 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.210849    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59fc4eec-64a0-42a6-af53-2edc09a98048-openshift-service-ca\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.210886 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.210885    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59fc4eec-64a0-42a6-af53-2edc09a98048-metrics-certs\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.211115 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.211024    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59fc4eec-64a0-42a6-af53-2edc09a98048-maas-api-tls\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.211167 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.211124    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fznbw\" (UniqueName: \"kubernetes.io/projected/59fc4eec-64a0-42a6-af53-2edc09a98048-kube-api-access-fznbw\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.211646 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.211616    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59fc4eec-64a0-42a6-af53-2edc09a98048-openshift-service-ca\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.213553 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.213523    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59fc4eec-64a0-42a6-af53-2edc09a98048-metrics-certs\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.213775 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.213756    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59fc4eec-64a0-42a6-af53-2edc09a98048-maas-api-tls\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.219003 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.218980    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fznbw\" (UniqueName: \"kubernetes.io/projected/59fc4eec-64a0-42a6-af53-2edc09a98048-kube-api-access-fznbw\") pod \"maas-api-6886844f88-rxkpg\" (UID: \"59fc4eec-64a0-42a6-af53-2edc09a98048\") " pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.336474 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.336401    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:35.607766 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:35.607739    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"]
Sep 06 01:25:35.610507 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:25:35.610469    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fc4eec_64a0_42a6_af53_2edc09a98048.slice/crio-c68104718312d7a3902ad04ce74ab688c6b72c5da8e3d26db5a4874e3cd27eae WatchSource:0}: Error finding container c68104718312d7a3902ad04ce74ab688c6b72c5da8e3d26db5a4874e3cd27eae: Status 404 returned error can't find the container with id c68104718312d7a3902ad04ce74ab688c6b72c5da8e3d26db5a4874e3cd27eae
Sep 06 01:25:36.540229 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:36.540195    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg" event={"ID":"59fc4eec-64a0-42a6-af53-2edc09a98048","Type":"ContainerStarted","Data":"5166759e16307f85038cc029d5fa00be3a5bc03d1df62fc8a388489fcc1f4b43"}
Sep 06 01:25:36.540740 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:36.540258    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg" event={"ID":"59fc4eec-64a0-42a6-af53-2edc09a98048","Type":"ContainerStarted","Data":"c68104718312d7a3902ad04ce74ab688c6b72c5da8e3d26db5a4874e3cd27eae"}
Sep 06 01:25:36.540740 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:36.540303    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:36.560651 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:36.560608    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg" podStartSLOduration=1.129776881 podStartE2EDuration="1.560592897s" totalImagesPullingTime="430.816016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:36.559546617 +0000 UTC m=+2117.093180943" watchObservedRunningTime="2026-09-06 01:25:36.560592897 +0000 UTC m=+2117.094227224"
Sep 06 01:25:42.550686 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:42.550656    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6886844f88-rxkpg"
Sep 06 01:25:51.367194 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:51.367164    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"]
Sep 06 01:25:51.367636 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:51.367360    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2" podUID="dc42c3d4-a0d4-4537-88c5-94f097328384" containerName="maas-api" containerID="cri-o://4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9" gracePeriod=30
Sep 06 01:25:52.606772 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.606748    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:25:52.608870 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.608845    2548 generic.go:356] "Generic (PLEG): container finished" podID="dc42c3d4-a0d4-4537-88c5-94f097328384" containerID="4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9" exitCode=0
Sep 06 01:25:52.608982 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.608884    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"
Sep 06 01:25:52.608982 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.608926    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2" event={"ID":"dc42c3d4-a0d4-4537-88c5-94f097328384","Type":"ContainerDied","Data":"4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9"}
Sep 06 01:25:52.608982 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.608979    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2" event={"ID":"dc42c3d4-a0d4-4537-88c5-94f097328384","Type":"ContainerDied","Data":"5520b9ddd36458d6eba5f658047b112cdea0ec647179af391983d3ae23c09e9c"}
Sep 06 01:25:52.609145 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.609009    2548 scope.go:117] "RemoveContainer" containerID="4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9"
Sep 06 01:25:52.616972 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.616955    2548 scope.go:117] "RemoveContainer" containerID="4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9"
Sep 06 01:25:52.617220 ip-10-0-130-34 kubenswrapper[2548]: E0906 01:25:52.617205    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9\": container with ID starting with 4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9 not found: ID does not exist" containerID="4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9"
Sep 06 01:25:52.617299 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.617236    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9"} err="failed to get container status \"4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9\": rpc error: code = NotFound desc = could not find container \"4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9\": container with ID starting with 4f5f9b69bde367fbb6276aad028e469e4f653d9aeb772507b160ec18754292e9 not found: ID does not exist"
Sep 06 01:25:52.752842 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.752820    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc42c3d4-a0d4-4537-88c5-94f097328384-openshift-service-ca\") pod \"dc42c3d4-a0d4-4537-88c5-94f097328384\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") "
Sep 06 01:25:52.752982 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.752864    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs\") pod \"dc42c3d4-a0d4-4537-88c5-94f097328384\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") "
Sep 06 01:25:52.752982 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.752923    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjlsk\" (UniqueName: \"kubernetes.io/projected/dc42c3d4-a0d4-4537-88c5-94f097328384-kube-api-access-jjlsk\") pod \"dc42c3d4-a0d4-4537-88c5-94f097328384\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") "
Sep 06 01:25:52.752982 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.752954    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-maas-api-tls\") pod \"dc42c3d4-a0d4-4537-88c5-94f097328384\" (UID: \"dc42c3d4-a0d4-4537-88c5-94f097328384\") "
Sep 06 01:25:52.753243 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.753215    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc42c3d4-a0d4-4537-88c5-94f097328384-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc42c3d4-a0d4-4537-88c5-94f097328384" (UID: "dc42c3d4-a0d4-4537-88c5-94f097328384"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:52.755046 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.755021    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc42c3d4-a0d4-4537-88c5-94f097328384" (UID: "dc42c3d4-a0d4-4537-88c5-94f097328384"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:25:52.755148 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.755053    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc42c3d4-a0d4-4537-88c5-94f097328384-kube-api-access-jjlsk" (OuterVolumeSpecName: "kube-api-access-jjlsk") pod "dc42c3d4-a0d4-4537-88c5-94f097328384" (UID: "dc42c3d4-a0d4-4537-88c5-94f097328384"). InnerVolumeSpecName "kube-api-access-jjlsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:52.755148 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.755097    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dc42c3d4-a0d4-4537-88c5-94f097328384" (UID: "dc42c3d4-a0d4-4537-88c5-94f097328384"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:25:52.854374 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.854354    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjlsk\" (UniqueName: \"kubernetes.io/projected/dc42c3d4-a0d4-4537-88c5-94f097328384-kube-api-access-jjlsk\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:25:52.854374 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.854375    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:25:52.854492 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.854385    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc42c3d4-a0d4-4537-88c5-94f097328384-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:25:52.854492 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.854399    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc42c3d4-a0d4-4537-88c5-94f097328384-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\""
Sep 06 01:25:52.930590 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.930564    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"]
Sep 06 01:25:52.934225 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:52.934205    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-gtgq2"]
Sep 06 01:25:53.985953 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:25:53.985913    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc42c3d4-a0d4-4537-88c5-94f097328384" path="/var/lib/kubelet/pods/dc42c3d4-a0d4-4537-88c5-94f097328384/volumes"
Sep 06 01:26:16.217463 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:16.217377    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5545c7878f-lk7wd_8cec6dcc-8766-433e-b29f-1866fe0c120d/manager/0.log"
Sep 06 01:26:16.721865 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:16.721841    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79dff7ddb6-wq62m_50d281dc-2b80-4bfd-95c1-90cd211df890/copy-manifests/0.log"
Sep 06 01:26:16.731362 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:16.731327    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79dff7ddb6-wq62m_50d281dc-2b80-4bfd-95c1-90cd211df890/manager/0.log"
Sep 06 01:26:17.331158 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:17.331134    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6886844f88-rxkpg_59fc4eec-64a0-42a6-af53-2edc09a98048/maas-api/0.log"
Sep 06 01:26:19.673160 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:19.673126    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rxxcs_596e62ff-429d-4787-ad66-39c5be7d28fd/discovery/0.log"
Sep 06 01:26:20.411768 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:20.411735    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b797f8856-mpddc_250efc20-ed5b-4f56-aee8-fcf5afdbacc0/router/0.log"
Sep 06 01:26:20.777182 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:20.777151    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-r6gzf_08218d28-a5a8-4fe6-a406-fb4ca3b201c2/main/0.log"
Sep 06 01:26:21.018525 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:21.018477    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-rcwtg_e56f53fb-42ee-4d9c-8472-90f275b2465d/main/0.log"
Sep 06 01:26:29.984316 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:29.984283    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fkfvk_efcd94a4-731f-48e2-89d3-b17b6b312647/global-pull-secret-syncer/0.log"
Sep 06 01:26:30.145172 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:30.145138    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4ljff_9b94681b-36d9-4371-ad05-47c56b6c5c2e/konnectivity-agent/0.log"
Sep 06 01:26:30.223996 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:30.223965    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-34.ec2.internal_40602ea1537eae72f6c1193eafd2b1fb/haproxy/0.log"
Sep 06 01:26:37.394154 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:37.394117    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-vfxgd_b7651597-3577-4f93-84cc-4b068adf9280/cluster-monitoring-operator/0.log"
Sep 06 01:26:37.702055 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:37.702030    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j4lzw_70a74ad3-a00d-4261-98ff-087b229f72dd/node-exporter/0.log"
Sep 06 01:26:37.726989 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:37.726962    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j4lzw_70a74ad3-a00d-4261-98ff-087b229f72dd/kube-rbac-proxy/0.log"
Sep 06 01:26:37.750461 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:37.750438    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j4lzw_70a74ad3-a00d-4261-98ff-087b229f72dd/init-textfile/0.log"
Sep 06 01:26:39.710961 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:39.710931    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-fgnd2_d6eae2e5-a786-45da-9bf9-03f98e4c7e9d/networking-console-plugin/0.log"
Sep 06 01:26:40.431321 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.431286    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"]
Sep 06 01:26:40.431638 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.431625    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc42c3d4-a0d4-4537-88c5-94f097328384" containerName="maas-api"
Sep 06 01:26:40.431686 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.431640    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc42c3d4-a0d4-4537-88c5-94f097328384" containerName="maas-api"
Sep 06 01:26:40.431721 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.431706    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc42c3d4-a0d4-4537-88c5-94f097328384" containerName="maas-api"
Sep 06 01:26:40.434664 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.434643    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.437335 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.437314    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4r8dp\"/\"openshift-service-ca.crt\""
Sep 06 01:26:40.437999 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.437979    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4r8dp\"/\"kube-root-ca.crt\""
Sep 06 01:26:40.438102 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.438000    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4r8dp\"/\"default-dockercfg-9s6px\""
Sep 06 01:26:40.445053 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.445034    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"]
Sep 06 01:26:40.445828 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.445811    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/2.log"
Sep 06 01:26:40.457978 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.457953    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-pzkqj_487de660-0766-4387-9351-63c22a95dd79/console-operator/3.log"
Sep 06 01:26:40.529501 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.529468    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-podres\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.529659 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.529534    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-sys\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.529659 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.529560    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-proc\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.529659 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.529611    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-lib-modules\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.529659 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.529634    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kp8r\" (UniqueName: \"kubernetes.io/projected/98751b74-b7da-40ef-9157-b7dd6fe6f81e-kube-api-access-7kp8r\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.630962 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.630931    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-podres\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.631119 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.630974    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-sys\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.631119 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.630991    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-proc\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.631119 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.631021    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-lib-modules\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.631119 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.631037    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kp8r\" (UniqueName: \"kubernetes.io/projected/98751b74-b7da-40ef-9157-b7dd6fe6f81e-kube-api-access-7kp8r\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.631119 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.631069    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-sys\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.631119 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.631086    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-podres\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.631119 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.631079    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-proc\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.631393 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.631142    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98751b74-b7da-40ef-9157-b7dd6fe6f81e-lib-modules\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.639047 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.639020    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kp8r\" (UniqueName: \"kubernetes.io/projected/98751b74-b7da-40ef-9157-b7dd6fe6f81e-kube-api-access-7kp8r\") pod \"perf-node-gather-daemonset-m2bwk\" (UID: \"98751b74-b7da-40ef-9157-b7dd6fe6f81e\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:40.744399 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:40.744367    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:41.015516 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:41.015492    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"]
Sep 06 01:26:41.019164 ip-10-0-130-34 kubenswrapper[2548]: W0906 01:26:41.019131    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod98751b74_b7da_40ef_9157_b7dd6fe6f81e.slice/crio-4edb609bd1607975069abaa54084dd371c3a471b620211453ff42b1e958f6583 WatchSource:0}: Error finding container 4edb609bd1607975069abaa54084dd371c3a471b620211453ff42b1e958f6583: Status 404 returned error can't find the container with id 4edb609bd1607975069abaa54084dd371c3a471b620211453ff42b1e958f6583
Sep 06 01:26:41.752168 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:41.752138    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-tn5q6_903f27c0-a3ab-4274-b755-74f99d165cc6/volume-data-source-validator/0.log"
Sep 06 01:26:41.821126 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:41.821095    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk" event={"ID":"98751b74-b7da-40ef-9157-b7dd6fe6f81e","Type":"ContainerStarted","Data":"bcda456537b57c3509d1cf8f83a140902ee3f867fa97005578e8e523dc43c656"}
Sep 06 01:26:41.821313 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:41.821151    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk" event={"ID":"98751b74-b7da-40ef-9157-b7dd6fe6f81e","Type":"ContainerStarted","Data":"4edb609bd1607975069abaa54084dd371c3a471b620211453ff42b1e958f6583"}
Sep 06 01:26:41.821313 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:41.821241    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:41.838817 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:41.838773    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk" podStartSLOduration=1.8387585990000002 podStartE2EDuration="1.838758599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:41.838008534 +0000 UTC m=+2182.371642864" watchObservedRunningTime="2026-09-06 01:26:41.838758599 +0000 UTC m=+2182.372392961"
Sep 06 01:26:42.802508 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:42.802453    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-66gtb_8a6f2386-4763-4ee2-ac46-26b654018da3/dns/0.log"
Sep 06 01:26:42.823565 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:42.823517    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-66gtb_8a6f2386-4763-4ee2-ac46-26b654018da3/kube-rbac-proxy/0.log"
Sep 06 01:26:42.961387 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:42.961358    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q96w7_206b4891-2024-44ed-9975-9c6e90ac3500/dns-node-resolver/0.log"
Sep 06 01:26:43.561398 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:43.561371    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qzqcf_cb45d3f6-b91f-430b-b76c-0261720d3daf/node-ca/0.log"
Sep 06 01:26:45.028438 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:45.028387    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rxxcs_596e62ff-429d-4787-ad66-39c5be7d28fd/discovery/0.log"
Sep 06 01:26:45.223480 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:45.223405    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b797f8856-mpddc_250efc20-ed5b-4f56-aee8-fcf5afdbacc0/router/0.log"
Sep 06 01:26:46.146484 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:46.146454    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mrjrs_cc2c520a-fd1b-4c14-a2d3-7a2d31adb7b0/serve-healthcheck-canary/0.log"
Sep 06 01:26:46.623057 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:46.623010    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-kr428_b30512c8-a402-4e9f-916d-77c29036c8ed/insights-operator/0.log"
Sep 06 01:26:46.623957 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:46.623930    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-kr428_b30512c8-a402-4e9f-916d-77c29036c8ed/insights-operator/1.log"
Sep 06 01:26:46.714647 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:46.714620    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8kgwz_774c006e-d3b9-4d72-a124-e0e577db02ad/kube-rbac-proxy/0.log"
Sep 06 01:26:46.734979 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:46.734956    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8kgwz_774c006e-d3b9-4d72-a124-e0e577db02ad/exporter/0.log"
Sep 06 01:26:46.758347 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:46.758325    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8kgwz_774c006e-d3b9-4d72-a124-e0e577db02ad/extractor/0.log"
Sep 06 01:26:47.836123 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:47.836098    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-m2bwk"
Sep 06 01:26:49.325955 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:49.325911    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5545c7878f-lk7wd_8cec6dcc-8766-433e-b29f-1866fe0c120d/manager/0.log"
Sep 06 01:26:49.569635 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:49.569604    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79dff7ddb6-wq62m_50d281dc-2b80-4bfd-95c1-90cd211df890/manager/0.log"
Sep 06 01:26:49.590341 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:49.590316    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79dff7ddb6-wq62m_50d281dc-2b80-4bfd-95c1-90cd211df890/copy-manifests/0.log"
Sep 06 01:26:51.022507 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:51.022477    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c79fd5646-rmk6r_e08a981f-640f-49df-90f1-dd70f16c08bc/manager/0.log"
Sep 06 01:26:51.242253 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:51.242219    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rxxcs_596e62ff-429d-4787-ad66-39c5be7d28fd/discovery/0.log"
Sep 06 01:26:51.373611 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:51.373519    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b797f8856-mpddc_250efc20-ed5b-4f56-aee8-fcf5afdbacc0/router/0.log"
Sep 06 01:26:53.393336 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:53.393304    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rxxcs_596e62ff-429d-4787-ad66-39c5be7d28fd/discovery/0.log"
Sep 06 01:26:53.535026 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:53.534984    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b797f8856-mpddc_250efc20-ed5b-4f56-aee8-fcf5afdbacc0/router/0.log"
Sep 06 01:26:56.100241 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:56.100205    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-jtgvp_e2d21385-2fab-4ae8-9663-cb60816caa24/migrator/0.log"
Sep 06 01:26:56.120494 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:56.120466    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-jtgvp_e2d21385-2fab-4ae8-9663-cb60816caa24/graceful-termination/0.log"
Sep 06 01:26:56.469330 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:56.469293    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-sktdk_12870d88-2f67-4834-9643-71e9e8547131/kube-storage-version-migrator-operator/1.log"
Sep 06 01:26:56.471049 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:56.471018    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-sktdk_12870d88-2f67-4834-9643-71e9e8547131/kube-storage-version-migrator-operator/0.log"
Sep 06 01:26:57.617224 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:57.617198    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5j2m_d5a0b4fa-fb6e-45b7-92b1-db8003e1401a/kube-multus-additional-cni-plugins/0.log"
Sep 06 01:26:57.637525 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:57.637470    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5j2m_d5a0b4fa-fb6e-45b7-92b1-db8003e1401a/egress-router-binary-copy/0.log"
Sep 06 01:26:57.659818 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:57.659785    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5j2m_d5a0b4fa-fb6e-45b7-92b1-db8003e1401a/cni-plugins/0.log"
Sep 06 01:26:57.679334 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:57.679261    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5j2m_d5a0b4fa-fb6e-45b7-92b1-db8003e1401a/bond-cni-plugin/0.log"
Sep 06 01:26:57.698199 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:57.698168    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5j2m_d5a0b4fa-fb6e-45b7-92b1-db8003e1401a/routeoverride-cni/0.log"
Sep 06 01:26:57.718796 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:57.718774    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5j2m_d5a0b4fa-fb6e-45b7-92b1-db8003e1401a/whereabouts-cni-bincopy/0.log"
Sep 06 01:26:57.738585 ip-10-0-130-34 kubenswrapper[2548]: I0906 01:26:57.738558    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5j2m_d5a0b4fa-fb6e-45b7-92b1-db8003e1401a/whereabouts-cni/0.log"