Sep 10 21:17:13.969585 ip-10-0-137-146 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 21:17:13.969595 ip-10-0-137-146 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 21:17:13.969604 ip-10-0-137-146 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 21:17:13.969795 ip-10-0-137-146 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 21:17:24.024063 ip-10-0-137-146 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 21:17:24.024079 ip-10-0-137-146 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b9d82da8f52948a298a1814241315129 --
Sep 10 21:19:09.694472 ip-10-0-137-146 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 21:19:10.041145 ip-10-0-137-146 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 21:19:10.041145 ip-10-0-137-146 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 21:19:10.041145 ip-10-0-137-146 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 21:19:10.041145 ip-10-0-137-146 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 21:19:10.041145 ip-10-0-137-146 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 21:19:10.041913 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.041835    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 21:19:10.045452 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045432    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 21:19:10.045452 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045449    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 21:19:10.045452 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045454    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 21:19:10.045452 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045459    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045464    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045470    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045474    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045478    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045482    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045486    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045489    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045494    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045498    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045502    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045505    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045509    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045513    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045516    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045520    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045525    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045528    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045532    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045536    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 21:19:10.045697 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045540    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045543    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045547    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045551    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045555    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045559    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045562    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045566    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045570    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045574    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045580    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045585    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045589    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045593    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045598    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045603    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045607    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045611    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045615    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045619    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 21:19:10.046527 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045623    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045628    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045632    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045636    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045640    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045645    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045649    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045653    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045658    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045662    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045666    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045670    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045675    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045679    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045685    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045689    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045693    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045697    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045701    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045705    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 21:19:10.047397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045709    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045714    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045719    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045724    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045729    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045733    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045738    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045743    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045748    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045752    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045756    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045760    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045765    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045769    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045776    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045782    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045789    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045793    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045798    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 21:19:10.048227 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045803    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045807    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045811    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045815    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045820    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045824    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045828    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045832    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045836    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045840    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045846    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045853    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045857    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045861    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045866    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045870    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.045876    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047023    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 21:19:10.049042 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047033    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047039    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047045    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047049    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047054    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047059    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047063    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047068    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047073    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047077    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047082    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047086    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047090    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047095    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047099    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047103    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047107    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047112    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047116    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047120    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 21:19:10.049881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047124    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047129    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047133    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047137    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047141    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047145    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047149    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047153    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047158    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047162    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047166    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047171    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047177    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047184    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047188    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047192    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047213    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047218    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047222    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047226    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 21:19:10.050543 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047230    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047234    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047239    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047243    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047247    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047251    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047255    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047259    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047264    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047268    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047272    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047276    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047280    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047285    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047289    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047309    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047315    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047320    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047325    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047329    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 21:19:10.051036 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047333    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047338    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047342    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047346    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047350    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047356    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047362    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047366    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047371    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047375    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047380    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047386    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047392    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047396    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047401    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047406    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047410    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047414    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047419    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 21:19:10.051621 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047423    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047427    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047431    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047435    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047440    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047444    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047448    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047452    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047456    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047460    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047464    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047471    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047478    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047485    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047493    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047498    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047502    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047506    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.047510    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 21:19:10.052116 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048091    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048101    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048106    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048112    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048118    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048123    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048128    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048133    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048137    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048141    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048146    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048150    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048154    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048158    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048162    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048166    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048170    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048176    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048180    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048183    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 21:19:10.052766 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048188    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048192    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048214    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048219    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048223    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048228    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048231    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048238    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048242    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048246    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048251    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048255    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048261    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048266    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048270    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048274    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048278    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048282    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048288    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048292    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 21:19:10.053336 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048296    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048301    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048304    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048308    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048313    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048317    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048321    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048325    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048329    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048333    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048337    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048341    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048346    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048350    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048354    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048358    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048364    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048368    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048373    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048377    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 21:19:10.053914 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048381    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048386    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048390    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048394    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048399    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048408    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048412    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048416    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048420    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048425    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048429    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048433    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048437    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048441    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048445    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048449    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048456    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048462    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048468    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 21:19:10.054443 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048473    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048477    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048482    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048486    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048491    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048495    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048500    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048504    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048509    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048513    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048518    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048522    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048527    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048531    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048535    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048540    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048544    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048548    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048553    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.048558    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048658    2568 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 21:19:10.054915 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048709    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048719    2568 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048726    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048732    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048737    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048743    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048750    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048755    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048760    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048765    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048771    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048776    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048780    2568 flags.go:64] FLAG: --cgroup-root=""
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048785    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048790    2568 flags.go:64] FLAG: --client-ca-file=""
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048794    2568 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048799    2568 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048807    2568 flags.go:64] FLAG: --cluster-domain=""
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048812    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048817    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048822    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048827    2568 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048842    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 21:19:10.055482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048847    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048852    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048857    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048862    2568 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048867    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048872    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048877    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048881    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048889    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048894    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048899    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048904    2568 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048908    2568 flags.go:64] FLAG: --enable-server="true"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048913    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048919    2568 flags.go:64] FLAG: --event-burst="100"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048924    2568 flags.go:64] FLAG: --event-qps="50"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048929    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048933    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048938    2568 flags.go:64] FLAG: --eviction-hard=""
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048944    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048949    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048954    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048958    2568 flags.go:64] FLAG: --eviction-soft=""
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048963    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048968    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 21:19:10.056044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048973    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048980    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048985    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048989    2568 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.048994    2568 flags.go:64] FLAG: --feature-gates=""
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049000    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049005    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049010    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049014    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049019    2568 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049024    2568 flags.go:64] FLAG: --help="false"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049029    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049033    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049038    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049043    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049048    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049054    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049059    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049063    2568 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049067    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049072    2568 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049077    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049082    2568 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049086    2568 flags.go:64] FLAG: --kube-reserved=""
Sep 10 21:19:10.056872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049091    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049095    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049100    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049105    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049109    2568 flags.go:64] FLAG: --lock-file=""
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049113    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049118    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049123    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049132    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049137    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049141    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049146    2568 flags.go:64] FLAG: --logging-format="text"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049150    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049155    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049160    2568 flags.go:64] FLAG: --manifest-url=""
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049166    2568 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049173    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049178    2568 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049184    2568 flags.go:64] FLAG: --max-pods="110"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049190    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049221    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049228    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049232    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049237    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049242    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 21:19:10.057610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049248    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049259    2568 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049264    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049269    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049274    2568 flags.go:64] FLAG: --pod-cidr=""
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049279    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049286    2568 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049291    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049296    2568 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049301    2568 flags.go:64] FLAG: --port="10250"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049305    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049310    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09b964303d2b81500"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049315    2568 flags.go:64] FLAG: --qos-reserved=""
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049320    2568 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049325    2568 flags.go:64] FLAG: --register-node="true"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049329    2568 flags.go:64] FLAG: --register-with-taints=""
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049335    2568 flags.go:64] FLAG: --registry-burst="10"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049340    2568 flags.go:64] FLAG: --registry-qps="5"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049345    2568 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049349    2568 flags.go:64] FLAG: --reserved-memory=""
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049356    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049361    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049366    2568 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049372    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049377    2568 flags.go:64] FLAG: --runonce="false"
Sep 10 21:19:10.058470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049381    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049397    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049402    2568 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049407    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049412    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049416    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049421    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049426    2568 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049432    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049437    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049441    2568 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049445    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049450    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049455    2568 flags.go:64] FLAG: --system-cgroups=""
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049460    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049471    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049476    2568 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049481    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049486    2568 flags.go:64] FLAG: --tls-min-version=""
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049491    2568 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049496    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049500    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049505    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049510    2568 flags.go:64] FLAG: --v="2"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049516    2568 flags.go:64] FLAG: --version="false"
Sep 10 21:19:10.059096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049523    2568 flags.go:64] FLAG: --vmodule=""
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049529    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.049534    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049709    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049716    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049723    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049728    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049732    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049736    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049740    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049745    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049749    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049753    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049757    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049761    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049765    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049770    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049774    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049779    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049783    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 21:19:10.059761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049787    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049791    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049795    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049799    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049803    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049807    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049812    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049816    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049820    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049824    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049828    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049834    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049840    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049845    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049849    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049854    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049858    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049864    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049868    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 21:19:10.060259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049872    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049876    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049880    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049884    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049888    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049892    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049896    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049901    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049907    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049913    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049919    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049924    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049929    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049933    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049937    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049942    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049946    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049951    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049955    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 21:19:10.060739 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049959    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049963    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049967    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049972    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049978    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049982    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049987    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049991    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049995    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.049999    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050003    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050009    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050013    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050017    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050021    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050025    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050029    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050033    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050038    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 21:19:10.061244 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050042    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050046    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050050    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050054    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050058    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050063    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050068    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050072    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050076    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050080    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050084    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050089    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050093    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050097    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050101    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050105    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050109    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050115    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050119    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050123    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 21:19:10.061713 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050127    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050132    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050139    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050145    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.050150    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.051344    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.059224    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.059239    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.059961    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.059972    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060028    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060034    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060037    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060040    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060043    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 21:19:10.062214 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060046    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060050    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060052    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060055    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060059    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060061    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060064    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060067    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060070    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060072    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060075    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060077    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060080    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060083    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060085    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060088    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060090    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060093    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060095    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 21:19:10.062593 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060098    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060101    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060103    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060107    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060110    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060113    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060116    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060119    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060122    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060125    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060128    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060131    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060133    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060136    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060138    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060141    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060144    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060147    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060149    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060152    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 21:19:10.063079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060154    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060157    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060159    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060162    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060165    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060167    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060169    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060172    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060175    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060178    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060180    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060183    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060185    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060188    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060190    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060193    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060208    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060213    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060216    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 21:19:10.063576 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060219    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060222    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060226    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060230    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060233    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060236    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060239    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060242    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060245    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060248    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060251    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060253    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060256    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060259    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060262    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060264    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060268    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060271    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060275    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 21:19:10.064031 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060278    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060281    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060284    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060286    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060289    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060293    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060295    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060298    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060301    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060303    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060306    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060311    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060313    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060316    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060319    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060321    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 21:19:10.064556 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060324    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.060329    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060445    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060450    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060453    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060456    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060459    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060462    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060465    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060468    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060470    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060473    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060476    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060478    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060482    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 21:19:10.065012 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060484    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060487    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060489    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060492    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060494    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060497    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060500    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060502    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060505    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060508    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060510    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060513    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060516    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060519    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060521    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060524    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060527    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060529    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060532    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060534    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060537    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 21:19:10.065415 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060539    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060542    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060544    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060547    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060549    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060552    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060554    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060556    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060559    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060562    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060565    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060567    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060570    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060573    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060575    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060578    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060580    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060583    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060585    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 21:19:10.065960 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060588    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060591    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060593    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060596    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060600    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060603    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060607    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060610    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060613    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060615    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060618    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060621    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060624    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060626    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060629    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060631    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060634    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060636    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060639    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 21:19:10.066700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060641    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060644    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060646    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060650    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060654    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060656    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060660    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060663    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060666    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060668    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060671    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060674    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060677    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060681    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060684    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060687    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060689    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060692    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060695    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 21:19:10.067606 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060697    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060700    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060702    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060705    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060708    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060710    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060712    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:10.060715    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.060720    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.060850    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.063457    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.064144    2568 server.go:1019] "Starting client certificate rotation"
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.064230    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 21:19:10.068417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.064268    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 21:19:10.068784 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.066706    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 21:19:10.068784 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.068424    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 21:19:10.079250 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.079231    2568 log.go:25] "Validated CRI v1 runtime API"
Sep 10 21:19:10.081829 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.081813    2568 log.go:25] "Validated CRI v1 image API"
Sep 10 21:19:10.082784 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.082768    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 21:19:10.087303 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.087281    2568 fs.go:135] Filesystem UUIDs: map[4f7385aa-4dad-4e5a-8cb2-1e0dacaf7a5f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ed0cc293-656f-4804-883c-35c3a0b5c61b:/dev/nvme0n1p3]
Sep 10 21:19:10.087366 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.087302    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 21:19:10.092379 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.092352    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 21:19:10.094469 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.094358    2568 manager.go:216] Machine: {Timestamp:2026-09-10 21:19:10.093317173 +0000 UTC m=+0.295647736 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098427 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec289c0635568d8557c74e60744a67e1 SystemUUID:ec289c06-3556-8d85-57c7-4e60744a67e1 BootID:b9d82da8-f529-48a2-98a1-814241315129 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:97:3e:81:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:97:3e:81:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:56:75:51:2e:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 21:19:10.094469 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.094462    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 21:19:10.094598 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.094540    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 21:19:10.098463 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.098440    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 21:19:10.098583 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.098465    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 21:19:10.099573 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.099562    2568 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 21:19:10.099618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.099575    2568 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 21:19:10.099618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.099582    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 21:19:10.100301 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.100292    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 21:19:10.101014 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.101004    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 21:19:10.103631 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.103620    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 21:19:10.103736 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.103727    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 21:19:10.103770 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.103755    2568 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 21:19:10.103770 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.103768    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 21:19:10.103821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.103789    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 21:19:10.103821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.103799    2568 kubelet.go:398] "Adding apiserver pod source"
Sep 10 21:19:10.103821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.103808    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 21:19:10.104154 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.104142    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 21:19:10.104241 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.104161    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 21:19:10.107288 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.107271    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 21:19:10.109179 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.109162    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 21:19:10.109269 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.109193    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 21:19:10.110512 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110501    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 21:19:10.110555 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110517    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 21:19:10.110555 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110523    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 21:19:10.110555 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110528    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 21:19:10.110555 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110537    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 21:19:10.110555 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110542    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 21:19:10.110555 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110556    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 21:19:10.110718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110562    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 21:19:10.110718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110569    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 21:19:10.110718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110575    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 21:19:10.110718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110584    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 21:19:10.110718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.110590    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 21:19:10.111853 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.111843    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 21:19:10.111853 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.111852    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 21:19:10.114121 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.114099    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 21:19:10.114180 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.114100    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 21:19:10.115400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.115380    2568 server.go:1268] "Started kubelet"
Sep 10 21:19:10.115499 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.115444    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 21:19:10.115551 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.115502    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 21:19:10.115596 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.115562    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 21:19:10.116306 ip-10-0-137-146 systemd[1]: Started Kubernetes Kubelet.
Sep 10 21:19:10.117783 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.117768    2568 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 21:19:10.120772 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.120755    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 21:19:10.122587 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.122572    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 21:19:10.123730 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.122895    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-146.ec2.internal.18d4125ebf1a8328  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-146.ec2.internal,UID:ip-10-0-137-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-146.ec2.internal,},FirstTimestamp:2026-09-10 21:19:10.115341096 +0000 UTC m=+0.317671659,LastTimestamp:2026-09-10 21:19:10.115341096 +0000 UTC m=+0.317671659,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-146.ec2.internal,}"
Sep 10 21:19:10.124125 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.124094    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 21:19:10.125753 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.125735    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 21:19:10.126149 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.126131    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 21:19:10.126342 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.126293    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:10.126840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.126821    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 21:19:10.126928 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.126905    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 21:19:10.126928 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.126918    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 21:19:10.127232 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.127189    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 21:19:10.127232 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.127232    2568 factory.go:55] Registering systemd factory
Sep 10 21:19:10.127352 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.127241    2568 factory.go:223] Registration of the systemd container factory successfully
Sep 10 21:19:10.127491 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.127478    2568 factory.go:153] Registering CRI-O factory
Sep 10 21:19:10.127491 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.127492    2568 factory.go:223] Registration of the crio container factory successfully
Sep 10 21:19:10.127580 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.127523    2568 factory.go:103] Registering Raw factory
Sep 10 21:19:10.127580 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.127532    2568 manager.go:1196] Started watching for new ooms in manager
Sep 10 21:19:10.127971 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.127953    2568 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 21:19:10.128029 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.127972    2568 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 21:19:10.128768 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.128750    2568 manager.go:349] Starting recovery of all containers
Sep 10 21:19:10.131054 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.131000    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 21:19:10.131131 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.131048    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 21:19:10.135279 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.135117    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 21:19:10.140455 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.140432    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2rjct"
Sep 10 21:19:10.142693 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.142667    2568 manager.go:354] Recovery completed
Sep 10 21:19:10.145917 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.145835    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2rjct"
Sep 10 21:19:10.147438 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.147422    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 21:19:10.149053 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.149035    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 21:19:10.149129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.149070    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 21:19:10.149129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.149085    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Sep 10 21:19:10.149666 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.149653    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 21:19:10.149666 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.149666    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 21:19:10.149806 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.149673    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 21:19:10.149806 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.149684    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 21:19:10.150538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.150519    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 21:19:10.150611 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.150550    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 21:19:10.150611 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.150573    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Sep 10 21:19:10.150782 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.150711    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-146.ec2.internal.18d4125ec11cebf5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-146.ec2.internal,UID:ip-10-0-137-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-146.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-146.ec2.internal,},FirstTimestamp:2026-09-10 21:19:10.149053429 +0000 UTC m=+0.351383991,LastTimestamp:2026-09-10 21:19:10.149053429 +0000 UTC m=+0.351383991,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-146.ec2.internal,}"
Sep 10 21:19:10.150907 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.150895    2568 policy_none.go:49] "None policy: Start"
Sep 10 21:19:10.150954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.150912    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 21:19:10.150954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.150923    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 21:19:10.152096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.152084    2568 policy_none.go:47] "Start"
Sep 10 21:19:10.189372 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.189325    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.189421    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.189472    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.189514    2568 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.190896    2568 manager.go:337] "Starting Device Plugin manager"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.190925    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.190937    2568 server.go:87] "Starting device plugin registration server"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.191257    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.191279    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.191278    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.191517    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.191672    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.191681    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.192018    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 21:19:10.192710 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.192100    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:10.289897 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.289869    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"]
Sep 10 21:19:10.289991 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.289933    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 21:19:10.290694 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.290676    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 21:19:10.290789 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.290708    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 21:19:10.290789 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.290727    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Sep 10 21:19:10.291914 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.291870    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 21:19:10.292004 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.291992    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 21:19:10.292111 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.292071    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.292147 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.292122    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 21:19:10.292788 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.292758    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 21:19:10.292927 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.292809    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 21:19:10.292927 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.292835    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Sep 10 21:19:10.292927 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.292879    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 21:19:10.292927 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.292901    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 21:19:10.292927 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.292925    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Sep 10 21:19:10.293163 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.292954    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.293163 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.293025    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 21:19:10.293163 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.293053    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 21:19:10.293163 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.293088    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Sep 10 21:19:10.295114 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.294527    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.295114 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.294564    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 21:19:10.295867 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.295851    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 21:19:10.295924 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.295880    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 21:19:10.295924 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.295895    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Sep 10 21:19:10.308439 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.308420    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.308510 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.308445    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-146.ec2.internal\": node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:10.329054 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.329032    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bd2c549d08687dd130091e878b75501-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"1bd2c549d08687dd130091e878b75501\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.329144 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.329056    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bd2c549d08687dd130091e878b75501-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"1bd2c549d08687dd130091e878b75501\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.329144 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.329073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71370ee16b2ace2d8a162fa943dad00b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-146.ec2.internal\" (UID: \"71370ee16b2ace2d8a162fa943dad00b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.335432 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.335414    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-146.ec2.internal\" not found" node="ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.339475 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.339462    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-146.ec2.internal\" not found" node="ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.346914 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.346900    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:10.429684 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.429664    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71370ee16b2ace2d8a162fa943dad00b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-146.ec2.internal\" (UID: \"71370ee16b2ace2d8a162fa943dad00b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.429771 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.429716    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71370ee16b2ace2d8a162fa943dad00b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-146.ec2.internal\" (UID: \"71370ee16b2ace2d8a162fa943dad00b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.429771 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.429748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bd2c549d08687dd130091e878b75501-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"1bd2c549d08687dd130091e878b75501\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.429855 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.429778    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bd2c549d08687dd130091e878b75501-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"1bd2c549d08687dd130091e878b75501\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.429855 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.429813    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bd2c549d08687dd130091e878b75501-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"1bd2c549d08687dd130091e878b75501\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.429855 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.429820    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bd2c549d08687dd130091e878b75501-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"1bd2c549d08687dd130091e878b75501\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.447803 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.447782    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:10.548292 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.548244    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:10.638048 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.638023    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.641676 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:10.641657    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:10.649037 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.649020    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:10.749520 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.749492    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:10.850035 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.849992    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:10.950590 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:10.950564    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:11.051109 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:11.051087    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:11.064184 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.064164    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 21:19:11.064325 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.064308    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 21:19:11.149674 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.149616    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 21:14:11 +0000 UTC" deadline="2028-04-22 20:29:54.618119837 +0000 UTC"
Sep 10 21:19:11.149674 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.149638    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14159h10m43.468484661s"
Sep 10 21:19:11.151777 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:11.151758    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:11.252744 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:11.252720    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:11.271297 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.271279    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 21:19:11.272844 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:11.272807    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd2c549d08687dd130091e878b75501.slice/crio-df7c55b2ddcf1ecb30c09eedb5463ed1bb753bc6a75880eb9025fcb050b1fa70 WatchSource:0}: Error finding container df7c55b2ddcf1ecb30c09eedb5463ed1bb753bc6a75880eb9025fcb050b1fa70: Status 404 returned error can't find the container with id df7c55b2ddcf1ecb30c09eedb5463ed1bb753bc6a75880eb9025fcb050b1fa70
Sep 10 21:19:11.273311 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:11.273294    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71370ee16b2ace2d8a162fa943dad00b.slice/crio-2cd59ea8e495253b415015d753d303a8d99d77daf6f99ac5b8201924f426b651 WatchSource:0}: Error finding container 2cd59ea8e495253b415015d753d303a8d99d77daf6f99ac5b8201924f426b651: Status 404 returned error can't find the container with id 2cd59ea8e495253b415015d753d303a8d99d77daf6f99ac5b8201924f426b651
Sep 10 21:19:11.278395 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.278374    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:19:11.283014 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.282999    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 21:19:11.353510 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:11.353484    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:11.454098 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:11.454039    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:11.555584 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:11.555556    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:11.656343 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:11.656314    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Sep 10 21:19:11.667294 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.667269    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 21:19:11.726827 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.726769    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:11.744610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.744591    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 21:19:11.745653 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.745640    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Sep 10 21:19:11.756350 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:11.756330    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 21:19:12.105589 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.105514    2568 apiserver.go:52] "Watching apiserver"
Sep 10 21:19:12.113435 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.113410    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 21:19:12.114038 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.113947    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-d9zqc","kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2","openshift-dns/node-resolver-glgcs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal","openshift-multus/multus-d2rv4","openshift-network-diagnostics/network-check-target-r27tz","openshift-cluster-node-tuning-operator/tuned-vj5lr","openshift-image-registry/node-ca-zgtsv","openshift-multus/multus-additional-cni-plugins-dm2sf","openshift-multus/network-metrics-daemon-jx9c8","openshift-network-operator/iptables-alerter-lc9p6","openshift-ovn-kubernetes/ovnkube-node-6m8qb","kube-system/global-pull-secret-syncer-kthqx"]
Sep 10 21:19:12.115649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.115624    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:12.115748 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.115727    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:12.116745 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.116633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:12.116745 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.116709    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:12.117878 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.117857    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.121244 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.118939    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-glgcs"
Sep 10 21:19:12.122850 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.121368    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 21:19:12.122850 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.121628    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 21:19:12.122850 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.121955    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cjcs4\""
Sep 10 21:19:12.122850 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.122214    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 21:19:12.123955 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.123518    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4kn88\""
Sep 10 21:19:12.123955 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.123768    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 21:19:12.123955 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.123909    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 21:19:12.124816 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.124230    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:12.124816 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.124325    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:12.126184 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.125877    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.126682 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.126664    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 21:19:12.127658 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.127637    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zgtsv"
Sep 10 21:19:12.130060 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.130042    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 21:19:12.131012 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.130989    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8p5kl\""
Sep 10 21:19:12.131313 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.131260    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 21:19:12.131500 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.130446    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 21:19:12.131563 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.131546    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 21:19:12.131622 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.131593    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 21:19:12.131693 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.131478    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 21:19:12.131693 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.130468    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 21:19:12.131806 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.131550    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kqmkk\""
Sep 10 21:19:12.131859 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.131847    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.132594 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.132573    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.133964 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.133944    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.135229 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.134949    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 21:19:12.135229 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.135088    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 21:19:12.135229 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.135110    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bgsjv\""
Sep 10 21:19:12.135812 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.135524    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 21:19:12.135812 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.135613    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7fcbw\""
Sep 10 21:19:12.135812 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.135650    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:19:12.135812 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.135666    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 21:19:12.135812 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.135757    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 21:19:12.136132 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.135980    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 21:19:12.136132 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.136069    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 21:19:12.136360 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.136341    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 21:19:12.136442 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.136411    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:12.137567 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.137548    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 21:19:12.137755 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.137739    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4wggk\""
Sep 10 21:19:12.137906 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.137788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32820bf3-c33a-4610-b8ba-4e97526b5bd2-kubelet-config\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:12.137981 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.137914    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-kubelet\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.137981 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.137945    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-etc-openvswitch\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.137981 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.137971    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-run-ovn\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.137995    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-run-multus-certs\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.138139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-slash\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-cni-netd\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138085    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-hostroot\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.138139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138099    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lc9p6"
Sep 10 21:19:12.138139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138109    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-systemd-units\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138185    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-socket-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.138474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-sys-fs\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.138474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138232    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-conf-dir\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.138474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138276    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:12.138474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138301    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-registration-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.138474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138328    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cd516c0-6d5a-40e1-8ec1-5b00366a50ab-serviceca\") pod \"node-ca-zgtsv\" (UID: \"5cd516c0-6d5a-40e1-8ec1-5b00366a50ab\") " pod="openshift-image-registry/node-ca-zgtsv"
Sep 10 21:19:12.138474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138357    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-log-socket\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138412    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-system-cni-dir\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.138474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138459    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-var-lib-kubelet\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.138972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138508    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60363da9-9c5f-4001-a8be-9ab2071a3811-ovn-node-metrics-cert\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138533    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-run-systemd\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-var-lib-openvswitch\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-cni-bin\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138669    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60363da9-9c5f-4001-a8be-9ab2071a3811-ovnkube-config\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138776    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60363da9-9c5f-4001-a8be-9ab2071a3811-ovnkube-script-lib\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138821    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5f7c\" (UniqueName: \"kubernetes.io/projected/60363da9-9c5f-4001-a8be-9ab2071a3811-kube-api-access-k5f7c\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.138972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138858    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpqc5\" (UniqueName: \"kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5\") pod \"network-check-target-r27tz\" (UID: \"b0deb471-f73a-4e0d-9eb5-49527f70f628\") " pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:12.138972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138892    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgm8t\" (UniqueName: \"kubernetes.io/projected/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-kube-api-access-qgm8t\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.138972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138916    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2deb30-60af-4074-b910-bd87cebdf4bb-tmp-dir\") pod \"node-resolver-glgcs\" (UID: \"dd2deb30-60af-4074-b910-bd87cebdf4bb\") " pod="openshift-dns/node-resolver-glgcs"
Sep 10 21:19:12.138972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138952    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-socket-dir-parent\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.138976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-device-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139002    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7774v\" (UniqueName: \"kubernetes.io/projected/5cd516c0-6d5a-40e1-8ec1-5b00366a50ab-kube-api-access-7774v\") pod \"node-ca-zgtsv\" (UID: \"5cd516c0-6d5a-40e1-8ec1-5b00366a50ab\") " pod="openshift-image-registry/node-ca-zgtsv"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139040    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwgct\" (UniqueName: \"kubernetes.io/projected/810abf45-98cd-4b31-99d7-55b358f4183a-kube-api-access-bwgct\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139064    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-run-ovn-kubernetes\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139088    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139115    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cd516c0-6d5a-40e1-8ec1-5b00366a50ab-host\") pod \"node-ca-zgtsv\" (UID: \"5cd516c0-6d5a-40e1-8ec1-5b00366a50ab\") " pod="openshift-image-registry/node-ca-zgtsv"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139190    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-run-k8s-cni-cncf-io\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139253    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-daemon-config\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139388    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd2deb30-60af-4074-b910-bd87cebdf4bb-hosts-file\") pod \"node-resolver-glgcs\" (UID: \"dd2deb30-60af-4074-b910-bd87cebdf4bb\") " pod="openshift-dns/node-resolver-glgcs"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139433    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp2q9\" (UniqueName: \"kubernetes.io/projected/dd2deb30-60af-4074-b910-bd87cebdf4bb-kube-api-access-zp2q9\") pod \"node-resolver-glgcs\" (UID: \"dd2deb30-60af-4074-b910-bd87cebdf4bb\") " pod="openshift-dns/node-resolver-glgcs"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139462    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-cnibin\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60363da9-9c5f-4001-a8be-9ab2071a3811-env-overrides\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139517    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-run-netns\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-var-lib-cni-multus\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139595    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-run-openvswitch\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.139636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139618    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-cni-dir\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139652    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-etc-kubernetes\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139674    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qmcc\" (UniqueName: \"kubernetes.io/projected/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-kube-api-access-6qmcc\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139699    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-run-netns\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139735    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32820bf3-c33a-4610-b8ba-4e97526b5bd2-dbus\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139834    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-cni-binary-copy\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-var-lib-cni-bin\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.139883    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-node-log\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.140017    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.140091    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 21:19:12.140494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.140476    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:19:12.140939 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.140504    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gtj6t\""
Sep 10 21:19:12.140939 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.140739    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jx2q9\""
Sep 10 21:19:12.142077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.142055    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 21:19:12.142387 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.142369    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 21:19:12.142472 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.142437    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 21:19:12.176249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.176228    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xxql6"
Sep 10 21:19:12.187497 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.187415    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xxql6"
Sep 10 21:19:12.196921 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.196881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal" event={"ID":"71370ee16b2ace2d8a162fa943dad00b","Type":"ContainerStarted","Data":"2cd59ea8e495253b415015d753d303a8d99d77daf6f99ac5b8201924f426b651"}
Sep 10 21:19:12.198311 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.198288    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal" event={"ID":"1bd2c549d08687dd130091e878b75501","Type":"ContainerStarted","Data":"df7c55b2ddcf1ecb30c09eedb5463ed1bb753bc6a75880eb9025fcb050b1fa70"}
Sep 10 21:19:12.227820 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.227795    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 21:19:12.240475 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240448    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-etc-openvswitch\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240587 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240488    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-run-ovn\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240587 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240514    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c33420a8-f603-42f3-a341-909e91b104e0-system-cni-dir\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.240587 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240537    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c33420a8-f603-42f3-a341-909e91b104e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.240587 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240543    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-etc-openvswitch\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240587 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-run-multus-certs\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.240587 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240590    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-slash\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240628    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-run-ovn\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240638    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-slash\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240664    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-cni-netd\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240695    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-kubernetes\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240725    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-hostroot\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240737    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-cni-netd\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240696    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-run-multus-certs\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-systemd-units\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240784    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-systemd-units\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240786    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240816    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-socket-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240833    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-hostroot\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-sys-fs\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240870    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c33420a8-f603-42f3-a341-909e91b104e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-conf-dir\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.240929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240921    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240939    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-sys-fs\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240948    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-registration-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.240973    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c33420a8-f603-42f3-a341-909e91b104e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241000    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c33420a8-f603-42f3-a341-909e91b104e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241026    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cd516c0-6d5a-40e1-8ec1-5b00366a50ab-serviceca\") pod \"node-ca-zgtsv\" (UID: \"5cd516c0-6d5a-40e1-8ec1-5b00366a50ab\") " pod="openshift-image-registry/node-ca-zgtsv"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-log-socket\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241057    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-socket-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c33420a8-f603-42f3-a341-909e91b104e0-cnibin\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241100    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbfb8929-d843-40f2-8563-0992d0209310-agent-certs\") pod \"konnectivity-agent-d9zqc\" (UID: \"fbfb8929-d843-40f2-8563-0992d0209310\") " pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241123    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-registration-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241201    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-conf-dir\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-log-socket\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.241337    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.241427    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret podName:32820bf3-c33a-4610-b8ba-4e97526b5bd2 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:12.741393982 +0000 UTC m=+2.943724549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret") pod "global-pull-secret-syncer-kthqx" (UID: "32820bf3-c33a-4610-b8ba-4e97526b5bd2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241125    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbfb8929-d843-40f2-8563-0992d0209310-konnectivity-ca\") pod \"konnectivity-agent-d9zqc\" (UID: \"fbfb8929-d843-40f2-8563-0992d0209310\") " pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241607    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dc906ee-7674-4649-b5ae-ddf4564a3354-host-slash\") pod \"iptables-alerter-lc9p6\" (UID: \"5dc906ee-7674-4649-b5ae-ddf4564a3354\") " pod="openshift-network-operator/iptables-alerter-lc9p6"
Sep 10 21:19:12.241782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-system-cni-dir\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241662    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-var-lib-kubelet\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241672    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cd516c0-6d5a-40e1-8ec1-5b00366a50ab-serviceca\") pod \"node-ca-zgtsv\" (UID: \"5cd516c0-6d5a-40e1-8ec1-5b00366a50ab\") " pod="openshift-image-registry/node-ca-zgtsv"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241686    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60363da9-9c5f-4001-a8be-9ab2071a3811-ovn-node-metrics-cert\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241715    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-run-systemd\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241747    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-var-lib-openvswitch\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241771    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-cni-bin\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241796    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60363da9-9c5f-4001-a8be-9ab2071a3811-ovnkube-config\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241804    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-var-lib-kubelet\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241822    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60363da9-9c5f-4001-a8be-9ab2071a3811-ovnkube-script-lib\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241856    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5f7c\" (UniqueName: \"kubernetes.io/projected/60363da9-9c5f-4001-a8be-9ab2071a3811-kube-api-access-k5f7c\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241885    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqc5\" (UniqueName: \"kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5\") pod \"network-check-target-r27tz\" (UID: \"b0deb471-f73a-4e0d-9eb5-49527f70f628\") " pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgm8t\" (UniqueName: \"kubernetes.io/projected/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-kube-api-access-qgm8t\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241933    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2deb30-60af-4074-b910-bd87cebdf4bb-tmp-dir\") pod \"node-resolver-glgcs\" (UID: \"dd2deb30-60af-4074-b910-bd87cebdf4bb\") " pod="openshift-dns/node-resolver-glgcs"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241957    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-socket-dir-parent\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.241981    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-device-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242007    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-sys\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.242637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242029    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bc12c40-3208-4e08-ac29-1cacd527aea8-tmp\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242063    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xstxl\" (UniqueName: \"kubernetes.io/projected/5bc12c40-3208-4e08-ac29-1cacd527aea8-kube-api-access-xstxl\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242095    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dc906ee-7674-4649-b5ae-ddf4564a3354-iptables-alerter-script\") pod \"iptables-alerter-lc9p6\" (UID: \"5dc906ee-7674-4649-b5ae-ddf4564a3354\") " pod="openshift-network-operator/iptables-alerter-lc9p6"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242129    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ntw4\" (UniqueName: \"kubernetes.io/projected/5dc906ee-7674-4649-b5ae-ddf4564a3354-kube-api-access-8ntw4\") pod \"iptables-alerter-lc9p6\" (UID: \"5dc906ee-7674-4649-b5ae-ddf4564a3354\") " pod="openshift-network-operator/iptables-alerter-lc9p6"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242157    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7774v\" (UniqueName: \"kubernetes.io/projected/5cd516c0-6d5a-40e1-8ec1-5b00366a50ab-kube-api-access-7774v\") pod \"node-ca-zgtsv\" (UID: \"5cd516c0-6d5a-40e1-8ec1-5b00366a50ab\") " pod="openshift-image-registry/node-ca-zgtsv"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242189    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwgct\" (UniqueName: \"kubernetes.io/projected/810abf45-98cd-4b31-99d7-55b358f4183a-kube-api-access-bwgct\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242213    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-sysctl-conf\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242247    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-run-ovn-kubernetes\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242287    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242311    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-sysctl-d\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242334    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-run\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242358    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cd516c0-6d5a-40e1-8ec1-5b00366a50ab-host\") pod \"node-ca-zgtsv\" (UID: \"5cd516c0-6d5a-40e1-8ec1-5b00366a50ab\") " pod="openshift-image-registry/node-ca-zgtsv"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242414    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-var-lib-openvswitch\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242441    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60363da9-9c5f-4001-a8be-9ab2071a3811-ovnkube-script-lib\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242464    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-run-k8s-cni-cncf-io\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-system-cni-dir\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242498    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-daemon-config\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.243317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-cni-bin\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242526    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd2deb30-60af-4074-b910-bd87cebdf4bb-hosts-file\") pod \"node-resolver-glgcs\" (UID: \"dd2deb30-60af-4074-b910-bd87cebdf4bb\") " pod="openshift-dns/node-resolver-glgcs"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242555    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp2q9\" (UniqueName: \"kubernetes.io/projected/dd2deb30-60af-4074-b910-bd87cebdf4bb-kube-api-access-zp2q9\") pod \"node-resolver-glgcs\" (UID: \"dd2deb30-60af-4074-b910-bd87cebdf4bb\") " pod="openshift-dns/node-resolver-glgcs"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242580    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-cnibin\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60363da9-9c5f-4001-a8be-9ab2071a3811-env-overrides\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242631    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-lib-modules\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242656    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-tuned\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242681    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-run-netns\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242710    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-var-lib-cni-multus\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-run-openvswitch\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-sysconfig\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242785    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-cni-dir\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242810    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-etc-kubernetes\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242810    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-run-ovn-kubernetes\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242842    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qmcc\" (UniqueName: \"kubernetes.io/projected/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-kube-api-access-6qmcc\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242896    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242927    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-run-netns\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.244077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242958    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47t48\" (UniqueName: \"kubernetes.io/projected/c33420a8-f603-42f3-a341-909e91b104e0-kube-api-access-47t48\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.242989    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243040    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243072    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-modprobe-d\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32820bf3-c33a-4610-b8ba-4e97526b5bd2-dbus\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243130    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-cni-binary-copy\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243167    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-var-lib-cni-bin\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243192    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-node-log\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243217    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-systemd\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243241    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-var-lib-kubelet\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243261    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2deb30-60af-4074-b910-bd87cebdf4bb-tmp-dir\") pod \"node-resolver-glgcs\" (UID: \"dd2deb30-60af-4074-b910-bd87cebdf4bb\") " pod="openshift-dns/node-resolver-glgcs"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243268    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-host\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243361    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cd516c0-6d5a-40e1-8ec1-5b00366a50ab-host\") pod \"node-ca-zgtsv\" (UID: \"5cd516c0-6d5a-40e1-8ec1-5b00366a50ab\") " pod="openshift-image-registry/node-ca-zgtsv"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32820bf3-c33a-4610-b8ba-4e97526b5bd2-kubelet-config\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243424    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-device-dir\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243424    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-kubelet\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243465    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-run-netns\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.244840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243514    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60363da9-9c5f-4001-a8be-9ab2071a3811-ovnkube-config\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243523    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32820bf3-c33a-4610-b8ba-4e97526b5bd2-kubelet-config\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.243591    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243616    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-socket-dir-parent\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243667    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32820bf3-c33a-4610-b8ba-4e97526b5bd2-dbus\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243677    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-node-log\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.243716    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs podName:810abf45-98cd-4b31-99d7-55b358f4183a nodeName:}" failed. No retries permitted until 2026-09-10 21:19:12.743699869 +0000 UTC m=+2.946030438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs") pod "network-metrics-daemon-jx9c8" (UID: "810abf45-98cd-4b31-99d7-55b358f4183a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243720    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-var-lib-cni-bin\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243756    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-host-kubelet\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243763    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-run-systemd\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243799    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-run-k8s-cni-cncf-io\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.243846    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.244085    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-cni-binary-copy\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.244092    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-cnibin\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.244104    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60363da9-9c5f-4001-a8be-9ab2071a3811-run-openvswitch\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.244127    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-run-netns\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.244158    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-host-var-lib-cni-multus\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.245597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.244176    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-cni-dir\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.246600 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.244195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd2deb30-60af-4074-b910-bd87cebdf4bb-hosts-file\") pod \"node-resolver-glgcs\" (UID: \"dd2deb30-60af-4074-b910-bd87cebdf4bb\") " pod="openshift-dns/node-resolver-glgcs"
Sep 10 21:19:12.246600 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.244213    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-etc-kubernetes\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.246600 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.244251    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-multus-daemon-config\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.246600 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.244468    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60363da9-9c5f-4001-a8be-9ab2071a3811-env-overrides\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.248562 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.248540    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60363da9-9c5f-4001-a8be-9ab2071a3811-ovn-node-metrics-cert\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.257058 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.257032    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 21:19:12.257165 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.257065    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 21:19:12.257165 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.257080    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gpqc5 for pod openshift-network-diagnostics/network-check-target-r27tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:12.257165 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.257158    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5 podName:b0deb471-f73a-4e0d-9eb5-49527f70f628 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:12.757119108 +0000 UTC m=+2.959449682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gpqc5" (UniqueName: "kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5") pod "network-check-target-r27tz" (UID: "b0deb471-f73a-4e0d-9eb5-49527f70f628") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:12.257393 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.257368    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp2q9\" (UniqueName: \"kubernetes.io/projected/dd2deb30-60af-4074-b910-bd87cebdf4bb-kube-api-access-zp2q9\") pod \"node-resolver-glgcs\" (UID: \"dd2deb30-60af-4074-b910-bd87cebdf4bb\") " pod="openshift-dns/node-resolver-glgcs"
Sep 10 21:19:12.259310 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.259260    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7774v\" (UniqueName: \"kubernetes.io/projected/5cd516c0-6d5a-40e1-8ec1-5b00366a50ab-kube-api-access-7774v\") pod \"node-ca-zgtsv\" (UID: \"5cd516c0-6d5a-40e1-8ec1-5b00366a50ab\") " pod="openshift-image-registry/node-ca-zgtsv"
Sep 10 21:19:12.259696 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.259642    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qmcc\" (UniqueName: \"kubernetes.io/projected/04f97ba9-e71a-440d-9ea0-9d9a5f88da95-kube-api-access-6qmcc\") pod \"multus-d2rv4\" (UID: \"04f97ba9-e71a-440d-9ea0-9d9a5f88da95\") " pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.260691 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.259993    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgm8t\" (UniqueName: \"kubernetes.io/projected/d1cffe97-7d50-4980-9cdf-8c840de0c9ef-kube-api-access-qgm8t\") pod \"aws-ebs-csi-driver-node-t5pz2\" (UID: \"d1cffe97-7d50-4980-9cdf-8c840de0c9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.260691 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.260402    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwgct\" (UniqueName: \"kubernetes.io/projected/810abf45-98cd-4b31-99d7-55b358f4183a-kube-api-access-bwgct\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:12.261901 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.261881    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5f7c\" (UniqueName: \"kubernetes.io/projected/60363da9-9c5f-4001-a8be-9ab2071a3811-kube-api-access-k5f7c\") pod \"ovnkube-node-6m8qb\" (UID: \"60363da9-9c5f-4001-a8be-9ab2071a3811\") " pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.343771 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.343736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-modprobe-d\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.343960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.343784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-systemd\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.343960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.343846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-var-lib-kubelet\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.343960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.343877    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-systemd\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.343960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.343885    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-host\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.343960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.343927    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c33420a8-f603-42f3-a341-909e91b104e0-system-cni-dir\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.343960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.343943    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-host\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.343960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.343958    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c33420a8-f603-42f3-a341-909e91b104e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.343996    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c33420a8-f603-42f3-a341-909e91b104e0-system-cni-dir\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.343997    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-kubernetes\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344050    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-kubernetes\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344050    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c33420a8-f603-42f3-a341-909e91b104e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344056    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-modprobe-d\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c33420a8-f603-42f3-a341-909e91b104e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344133    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c33420a8-f603-42f3-a341-909e91b104e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344202    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c33420a8-f603-42f3-a341-909e91b104e0-cnibin\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbfb8929-d843-40f2-8563-0992d0209310-agent-certs\") pod \"konnectivity-agent-d9zqc\" (UID: \"fbfb8929-d843-40f2-8563-0992d0209310\") " pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbfb8929-d843-40f2-8563-0992d0209310-konnectivity-ca\") pod \"konnectivity-agent-d9zqc\" (UID: \"fbfb8929-d843-40f2-8563-0992d0209310\") " pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dc906ee-7674-4649-b5ae-ddf4564a3354-host-slash\") pod \"iptables-alerter-lc9p6\" (UID: \"5dc906ee-7674-4649-b5ae-ddf4564a3354\") " pod="openshift-network-operator/iptables-alerter-lc9p6"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344354    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-sys\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344346    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c33420a8-f603-42f3-a341-909e91b104e0-cnibin\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344376    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bc12c40-3208-4e08-ac29-1cacd527aea8-tmp\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.344400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstxl\" (UniqueName: \"kubernetes.io/projected/5bc12c40-3208-4e08-ac29-1cacd527aea8-kube-api-access-xstxl\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dc906ee-7674-4649-b5ae-ddf4564a3354-iptables-alerter-script\") pod \"iptables-alerter-lc9p6\" (UID: \"5dc906ee-7674-4649-b5ae-ddf4564a3354\") " pod="openshift-network-operator/iptables-alerter-lc9p6"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344446    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ntw4\" (UniqueName: \"kubernetes.io/projected/5dc906ee-7674-4649-b5ae-ddf4564a3354-kube-api-access-8ntw4\") pod \"iptables-alerter-lc9p6\" (UID: \"5dc906ee-7674-4649-b5ae-ddf4564a3354\") " pod="openshift-network-operator/iptables-alerter-lc9p6"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344468    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-sysctl-conf\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-sysctl-d\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344512    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-run\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344535    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-lib-modules\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-tuned\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344575    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-sysconfig\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344596    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47t48\" (UniqueName: \"kubernetes.io/projected/c33420a8-f603-42f3-a341-909e91b104e0-kube-api-access-47t48\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344303    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c33420a8-f603-42f3-a341-909e91b104e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344711    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c33420a8-f603-42f3-a341-909e91b104e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344871    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-sys\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.343925    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-var-lib-kubelet\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344909    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c33420a8-f603-42f3-a341-909e91b104e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.344974    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dc906ee-7674-4649-b5ae-ddf4564a3354-host-slash\") pod \"iptables-alerter-lc9p6\" (UID: \"5dc906ee-7674-4649-b5ae-ddf4564a3354\") " pod="openshift-network-operator/iptables-alerter-lc9p6"
Sep 10 21:19:12.345129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.345029    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-run\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345886 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.345187    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c33420a8-f603-42f3-a341-909e91b104e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.345886 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.345344    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbfb8929-d843-40f2-8563-0992d0209310-konnectivity-ca\") pod \"konnectivity-agent-d9zqc\" (UID: \"fbfb8929-d843-40f2-8563-0992d0209310\") " pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:12.345886 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.345373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-sysctl-d\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345886 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.345425    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-sysconfig\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345886 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.345437    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-sysctl-conf\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.345886 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.345487    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dc906ee-7674-4649-b5ae-ddf4564a3354-iptables-alerter-script\") pod \"iptables-alerter-lc9p6\" (UID: \"5dc906ee-7674-4649-b5ae-ddf4564a3354\") " pod="openshift-network-operator/iptables-alerter-lc9p6"
Sep 10 21:19:12.345886 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.345495    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5bc12c40-3208-4e08-ac29-1cacd527aea8-lib-modules\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.347898 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.347875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5bc12c40-3208-4e08-ac29-1cacd527aea8-etc-tuned\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.348035 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.348016    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bc12c40-3208-4e08-ac29-1cacd527aea8-tmp\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.348123 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.348018    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbfb8929-d843-40f2-8563-0992d0209310-agent-certs\") pod \"konnectivity-agent-d9zqc\" (UID: \"fbfb8929-d843-40f2-8563-0992d0209310\") " pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:12.355145 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.355112    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47t48\" (UniqueName: \"kubernetes.io/projected/c33420a8-f603-42f3-a341-909e91b104e0-kube-api-access-47t48\") pod \"multus-additional-cni-plugins-dm2sf\" (UID: \"c33420a8-f603-42f3-a341-909e91b104e0\") " pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.355506 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.355481    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ntw4\" (UniqueName: \"kubernetes.io/projected/5dc906ee-7674-4649-b5ae-ddf4564a3354-kube-api-access-8ntw4\") pod \"iptables-alerter-lc9p6\" (UID: \"5dc906ee-7674-4649-b5ae-ddf4564a3354\") " pod="openshift-network-operator/iptables-alerter-lc9p6"
Sep 10 21:19:12.355708 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.355663    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xstxl\" (UniqueName: \"kubernetes.io/projected/5bc12c40-3208-4e08-ac29-1cacd527aea8-kube-api-access-xstxl\") pod \"tuned-vj5lr\" (UID: \"5bc12c40-3208-4e08-ac29-1cacd527aea8\") " pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.434483 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.434449    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2"
Sep 10 21:19:12.443302 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.443277    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-glgcs"
Sep 10 21:19:12.453909 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.453882    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d2rv4"
Sep 10 21:19:12.460420 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.460403    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zgtsv"
Sep 10 21:19:12.468307 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.468286    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:12.476373 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.476354    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vj5lr"
Sep 10 21:19:12.484950 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.484927    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dm2sf"
Sep 10 21:19:12.495612 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.495591    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:12.502364 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.502344    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lc9p6"
Sep 10 21:19:12.557882 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.557856    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 21:19:12.748381 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.748296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:12.748522 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.748466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:12.748522 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.748466    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:12.748633 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.748528    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:12.748633 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.748561    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret podName:32820bf3-c33a-4610-b8ba-4e97526b5bd2 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:13.748543467 +0000 UTC m=+3.950874021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret") pod "global-pull-secret-syncer-kthqx" (UID: "32820bf3-c33a-4610-b8ba-4e97526b5bd2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:12.748633 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.748613    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs podName:810abf45-98cd-4b31-99d7-55b358f4183a nodeName:}" failed. No retries permitted until 2026-09-10 21:19:13.748593399 +0000 UTC m=+3.950924166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs") pod "network-metrics-daemon-jx9c8" (UID: "810abf45-98cd-4b31-99d7-55b358f4183a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:12.849359 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:12.849325    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqc5\" (UniqueName: \"kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5\") pod \"network-check-target-r27tz\" (UID: \"b0deb471-f73a-4e0d-9eb5-49527f70f628\") " pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:12.849520 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.849445    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 21:19:12.849520 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.849469    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 21:19:12.849520 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.849480    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gpqc5 for pod openshift-network-diagnostics/network-check-target-r27tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:12.849658 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:12.849539    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5 podName:b0deb471-f73a-4e0d-9eb5-49527f70f628 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:13.849519851 +0000 UTC m=+4.051850419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpqc5" (UniqueName: "kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5") pod "network-check-target-r27tz" (UID: "b0deb471-f73a-4e0d-9eb5-49527f70f628") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:13.190230 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:13.190123    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 21:14:12 +0000 UTC" deadline="2028-06-10 21:49:06.957939632 +0000 UTC"
Sep 10 21:19:13.190230 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:13.190171    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15336h29m53.767771756s"
Sep 10 21:19:13.352510 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:13.352295    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33420a8_f603_42f3_a341_909e91b104e0.slice/crio-1e83a7cc75ed52645386e0663b0458aef586d795c89999cdc8852ddedbcb1ab5 WatchSource:0}: Error finding container 1e83a7cc75ed52645386e0663b0458aef586d795c89999cdc8852ddedbcb1ab5: Status 404 returned error can't find the container with id 1e83a7cc75ed52645386e0663b0458aef586d795c89999cdc8852ddedbcb1ab5
Sep 10 21:19:13.353840 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:13.353808    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfb8929_d843_40f2_8563_0992d0209310.slice/crio-cb3dd9f3203456cb7d10e133e89d4b7f75775fbf8b59ca0683e7c74bb1066013 WatchSource:0}: Error finding container cb3dd9f3203456cb7d10e133e89d4b7f75775fbf8b59ca0683e7c74bb1066013: Status 404 returned error can't find the container with id cb3dd9f3203456cb7d10e133e89d4b7f75775fbf8b59ca0683e7c74bb1066013
Sep 10 21:19:13.357025 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:13.356982    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60363da9_9c5f_4001_a8be_9ab2071a3811.slice/crio-948a0768ae4eafcbef8889926eb0285cb9b8c90583110defeb3018d0c0731d58 WatchSource:0}: Error finding container 948a0768ae4eafcbef8889926eb0285cb9b8c90583110defeb3018d0c0731d58: Status 404 returned error can't find the container with id 948a0768ae4eafcbef8889926eb0285cb9b8c90583110defeb3018d0c0731d58
Sep 10 21:19:13.359562 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:13.359544    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc12c40_3208_4e08_ac29_1cacd527aea8.slice/crio-61d30d1bc0a5fc8bb9d2d54cd481fbbcbe61f032e1c2c56eeb061cd83beb058c WatchSource:0}: Error finding container 61d30d1bc0a5fc8bb9d2d54cd481fbbcbe61f032e1c2c56eeb061cd83beb058c: Status 404 returned error can't find the container with id 61d30d1bc0a5fc8bb9d2d54cd481fbbcbe61f032e1c2c56eeb061cd83beb058c
Sep 10 21:19:13.360936 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:13.360917    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd516c0_6d5a_40e1_8ec1_5b00366a50ab.slice/crio-99e069a8dd207f4ee4134ab593c26c4be92df6fadd3319059f194a054968033b WatchSource:0}: Error finding container 99e069a8dd207f4ee4134ab593c26c4be92df6fadd3319059f194a054968033b: Status 404 returned error can't find the container with id 99e069a8dd207f4ee4134ab593c26c4be92df6fadd3319059f194a054968033b
Sep 10 21:19:13.361903 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:13.361826    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc906ee_7674_4649_b5ae_ddf4564a3354.slice/crio-1182b1797f6556d7be9e76c748d30afbe83c9f98fe23623abbdbc76dae4a6aa1 WatchSource:0}: Error finding container 1182b1797f6556d7be9e76c748d30afbe83c9f98fe23623abbdbc76dae4a6aa1: Status 404 returned error can't find the container with id 1182b1797f6556d7be9e76c748d30afbe83c9f98fe23623abbdbc76dae4a6aa1
Sep 10 21:19:13.363374 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:13.363353    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1cffe97_7d50_4980_9cdf_8c840de0c9ef.slice/crio-b48c4aa6b3ebc8b77910f9e7f94c4cf47ffd5142446f470f8135b3b3af64e7cb WatchSource:0}: Error finding container b48c4aa6b3ebc8b77910f9e7f94c4cf47ffd5142446f470f8135b3b3af64e7cb: Status 404 returned error can't find the container with id b48c4aa6b3ebc8b77910f9e7f94c4cf47ffd5142446f470f8135b3b3af64e7cb
Sep 10 21:19:13.365018 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:13.364995    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2deb30_60af_4074_b910_bd87cebdf4bb.slice/crio-9675d1e2d94f1d4170bd854671c7815205dd6933afe6ea37695c3bda9890884b WatchSource:0}: Error finding container 9675d1e2d94f1d4170bd854671c7815205dd6933afe6ea37695c3bda9890884b: Status 404 returned error can't find the container with id 9675d1e2d94f1d4170bd854671c7815205dd6933afe6ea37695c3bda9890884b
Sep 10 21:19:13.366711 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:13.366653    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f97ba9_e71a_440d_9ea0_9d9a5f88da95.slice/crio-30924af40519bd11e3c8da016a42a773b584af9c29e5c8ba8dae1b192f47f1a9 WatchSource:0}: Error finding container 30924af40519bd11e3c8da016a42a773b584af9c29e5c8ba8dae1b192f47f1a9: Status 404 returned error can't find the container with id 30924af40519bd11e3c8da016a42a773b584af9c29e5c8ba8dae1b192f47f1a9
Sep 10 21:19:13.757266 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:13.757206    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:13.757410 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:13.757316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:13.757410 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:13.757384    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:13.757500 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:13.757416    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:13.757500 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:13.757449    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret podName:32820bf3-c33a-4610-b8ba-4e97526b5bd2 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:15.757435202 +0000 UTC m=+5.959765754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret") pod "global-pull-secret-syncer-kthqx" (UID: "32820bf3-c33a-4610-b8ba-4e97526b5bd2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:13.757500 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:13.757470    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs podName:810abf45-98cd-4b31-99d7-55b358f4183a nodeName:}" failed. No retries permitted until 2026-09-10 21:19:15.757459334 +0000 UTC m=+5.959789892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs") pod "network-metrics-daemon-jx9c8" (UID: "810abf45-98cd-4b31-99d7-55b358f4183a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:13.857727 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:13.857646    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqc5\" (UniqueName: \"kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5\") pod \"network-check-target-r27tz\" (UID: \"b0deb471-f73a-4e0d-9eb5-49527f70f628\") " pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:13.857878 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:13.857834    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 21:19:13.857878 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:13.857863    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 21:19:13.857878 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:13.857878    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gpqc5 for pod openshift-network-diagnostics/network-check-target-r27tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:13.858052 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:13.857959    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5 podName:b0deb471-f73a-4e0d-9eb5-49527f70f628 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:15.857937998 +0000 UTC m=+6.060268556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpqc5" (UniqueName: "kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5") pod "network-check-target-r27tz" (UID: "b0deb471-f73a-4e0d-9eb5-49527f70f628") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:14.195602 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.195421    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 21:14:12 +0000 UTC" deadline="2028-05-23 06:11:29.081235706 +0000 UTC"
Sep 10 21:19:14.195602 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.195457    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14888h52m14.885782851s"
Sep 10 21:19:14.208045 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.208018    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:14.208240 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:14.208142    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:14.208471 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.208452    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:14.208578 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:14.208556    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:14.208647 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.208633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:14.208744 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:14.208725    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:14.213818 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.213484    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-glgcs" event={"ID":"dd2deb30-60af-4074-b910-bd87cebdf4bb","Type":"ContainerStarted","Data":"9675d1e2d94f1d4170bd854671c7815205dd6933afe6ea37695c3bda9890884b"}
Sep 10 21:19:14.219468 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.219440    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lc9p6" event={"ID":"5dc906ee-7674-4649-b5ae-ddf4564a3354","Type":"ContainerStarted","Data":"1182b1797f6556d7be9e76c748d30afbe83c9f98fe23623abbdbc76dae4a6aa1"}
Sep 10 21:19:14.234867 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.234836    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vj5lr" event={"ID":"5bc12c40-3208-4e08-ac29-1cacd527aea8","Type":"ContainerStarted","Data":"61d30d1bc0a5fc8bb9d2d54cd481fbbcbe61f032e1c2c56eeb061cd83beb058c"}
Sep 10 21:19:14.249476 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.249396    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d9zqc" event={"ID":"fbfb8929-d843-40f2-8563-0992d0209310","Type":"ContainerStarted","Data":"cb3dd9f3203456cb7d10e133e89d4b7f75775fbf8b59ca0683e7c74bb1066013"}
Sep 10 21:19:14.264341 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.264312    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb" event={"ID":"60363da9-9c5f-4001-a8be-9ab2071a3811","Type":"ContainerStarted","Data":"948a0768ae4eafcbef8889926eb0285cb9b8c90583110defeb3018d0c0731d58"}
Sep 10 21:19:14.276278 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.276151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm2sf" event={"ID":"c33420a8-f603-42f3-a341-909e91b104e0","Type":"ContainerStarted","Data":"1e83a7cc75ed52645386e0663b0458aef586d795c89999cdc8852ddedbcb1ab5"}
Sep 10 21:19:14.292341 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.292310    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal" event={"ID":"71370ee16b2ace2d8a162fa943dad00b","Type":"ContainerStarted","Data":"d86d8408820a86305e665e0c696abd664c302a60e6146dad0d3938ac5f47b7be"}
Sep 10 21:19:14.306970 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.306937    2568 generic.go:356] "Generic (PLEG): container finished" podID="1bd2c549d08687dd130091e878b75501" containerID="104ae1872412485b53f8071c308a33fe2fc9a2303d95490b4087e0d1f733f0f0" exitCode=0
Sep 10 21:19:14.321288 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.307180    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal" event={"ID":"1bd2c549d08687dd130091e878b75501","Type":"ContainerDied","Data":"104ae1872412485b53f8071c308a33fe2fc9a2303d95490b4087e0d1f733f0f0"}
Sep 10 21:19:14.321288 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.318693    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal" podStartSLOduration=2.318673217 podStartE2EDuration="2.318673217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:14.317693381 +0000 UTC m=+4.520023958" watchObservedRunningTime="2026-09-10 21:19:14.318673217 +0000 UTC m=+4.521003794"
Sep 10 21:19:14.326430 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.326398    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d2rv4" event={"ID":"04f97ba9-e71a-440d-9ea0-9d9a5f88da95","Type":"ContainerStarted","Data":"30924af40519bd11e3c8da016a42a773b584af9c29e5c8ba8dae1b192f47f1a9"}
Sep 10 21:19:14.335131 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.335104    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2" event={"ID":"d1cffe97-7d50-4980-9cdf-8c840de0c9ef","Type":"ContainerStarted","Data":"b48c4aa6b3ebc8b77910f9e7f94c4cf47ffd5142446f470f8135b3b3af64e7cb"}
Sep 10 21:19:14.353083 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:14.352394    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zgtsv" event={"ID":"5cd516c0-6d5a-40e1-8ec1-5b00366a50ab","Type":"ContainerStarted","Data":"99e069a8dd207f4ee4134ab593c26c4be92df6fadd3319059f194a054968033b"}
Sep 10 21:19:15.373342 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:15.373204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal" event={"ID":"1bd2c549d08687dd130091e878b75501","Type":"ContainerStarted","Data":"b9404b46e04d1637495793516a73886419fdd72e1bac3612022157517bbb6117"}
Sep 10 21:19:15.777380 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:15.777290    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:15.777380 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:15.777368    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:15.777569 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:15.777529    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:15.777612 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:15.777598    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret podName:32820bf3-c33a-4610-b8ba-4e97526b5bd2 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:19.777577786 +0000 UTC m=+9.979908357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret") pod "global-pull-secret-syncer-kthqx" (UID: "32820bf3-c33a-4610-b8ba-4e97526b5bd2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:15.777691 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:15.777670    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:15.777760 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:15.777721    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs podName:810abf45-98cd-4b31-99d7-55b358f4183a nodeName:}" failed. No retries permitted until 2026-09-10 21:19:19.777698339 +0000 UTC m=+9.980028896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs") pod "network-metrics-daemon-jx9c8" (UID: "810abf45-98cd-4b31-99d7-55b358f4183a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:15.878656 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:15.878615    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqc5\" (UniqueName: \"kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5\") pod \"network-check-target-r27tz\" (UID: \"b0deb471-f73a-4e0d-9eb5-49527f70f628\") " pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:15.879058 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:15.879022    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 21:19:15.879058 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:15.879056    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 21:19:15.879254 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:15.879088    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gpqc5 for pod openshift-network-diagnostics/network-check-target-r27tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:15.879254 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:15.879236    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5 podName:b0deb471-f73a-4e0d-9eb5-49527f70f628 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:19.879214796 +0000 UTC m=+10.081545364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpqc5" (UniqueName: "kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5") pod "network-check-target-r27tz" (UID: "b0deb471-f73a-4e0d-9eb5-49527f70f628") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:16.195123 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:16.195042    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:16.195296 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:16.195179    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:16.195613 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:16.195591    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:16.195737 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:16.195713    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:16.195810 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:16.195781    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:16.195869 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:16.195857    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:18.191306 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:18.190010    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:18.191306 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:18.190151    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:18.191306 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:18.190621    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:18.191306 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:18.190729    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:18.191306 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:18.190775    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:18.191306 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:18.190843    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:19.815486 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:19.815442    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:19.816006 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:19.815514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:19.816006 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:19.815655    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:19.816006 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:19.815716    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret podName:32820bf3-c33a-4610-b8ba-4e97526b5bd2 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:27.815695769 +0000 UTC m=+18.018026323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret") pod "global-pull-secret-syncer-kthqx" (UID: "32820bf3-c33a-4610-b8ba-4e97526b5bd2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:19.816246 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:19.816090    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:19.816246 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:19.816127    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs podName:810abf45-98cd-4b31-99d7-55b358f4183a nodeName:}" failed. No retries permitted until 2026-09-10 21:19:27.816116255 +0000 UTC m=+18.018446807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs") pod "network-metrics-daemon-jx9c8" (UID: "810abf45-98cd-4b31-99d7-55b358f4183a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:19.916899 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:19.916826    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqc5\" (UniqueName: \"kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5\") pod \"network-check-target-r27tz\" (UID: \"b0deb471-f73a-4e0d-9eb5-49527f70f628\") " pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:19.917141 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:19.917000    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 21:19:19.917141 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:19.917025    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 21:19:19.917141 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:19.917039    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gpqc5 for pod openshift-network-diagnostics/network-check-target-r27tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:19.917141 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:19.917099    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5 podName:b0deb471-f73a-4e0d-9eb5-49527f70f628 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:27.917082091 +0000 UTC m=+18.119412662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpqc5" (UniqueName: "kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5") pod "network-check-target-r27tz" (UID: "b0deb471-f73a-4e0d-9eb5-49527f70f628") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:20.194297 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:20.194174    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:20.194297 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:20.194193    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:20.194637 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:20.194310    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:20.194637 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:20.194401    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:20.194637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:20.194459    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:20.194637 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:20.194544    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:22.192515 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:22.192371    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:22.193009 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:22.192524    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:22.193009 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:22.192653    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:22.193009 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:22.192754    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:22.193009 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:22.192811    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:22.193009 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:22.192876    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:24.190594 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:24.190325    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:24.191064 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:24.190341    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:24.191064 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:24.190703    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:24.191064 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:24.190384    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:24.191064 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:24.190740    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:24.191064 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:24.190835    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:26.189975 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:26.189940    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:26.190449 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:26.189951    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:26.190449 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:26.190073    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:26.190449 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:26.189954    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:26.190449 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:26.190152    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:26.190449 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:26.190253    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:27.877308 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:27.877275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:27.877682 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:27.877316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:27.877682 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:27.877417    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:27.877682 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:27.877424    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:27.877682 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:27.877474    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs podName:810abf45-98cd-4b31-99d7-55b358f4183a nodeName:}" failed. No retries permitted until 2026-09-10 21:19:43.877459401 +0000 UTC m=+34.079789967 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs") pod "network-metrics-daemon-jx9c8" (UID: "810abf45-98cd-4b31-99d7-55b358f4183a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:27.877682 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:27.877489    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret podName:32820bf3-c33a-4610-b8ba-4e97526b5bd2 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:43.877482935 +0000 UTC m=+34.079813508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret") pod "global-pull-secret-syncer-kthqx" (UID: "32820bf3-c33a-4610-b8ba-4e97526b5bd2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:27.978465 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:27.978440    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqc5\" (UniqueName: \"kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5\") pod \"network-check-target-r27tz\" (UID: \"b0deb471-f73a-4e0d-9eb5-49527f70f628\") " pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:27.978598 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:27.978547    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 21:19:27.978598 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:27.978562    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 21:19:27.978598 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:27.978571    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gpqc5 for pod openshift-network-diagnostics/network-check-target-r27tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:27.978719 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:27.978608    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5 podName:b0deb471-f73a-4e0d-9eb5-49527f70f628 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:43.978598462 +0000 UTC m=+34.180929012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpqc5" (UniqueName: "kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5") pod "network-check-target-r27tz" (UID: "b0deb471-f73a-4e0d-9eb5-49527f70f628") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:28.190633 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:28.190604    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:28.190633 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:28.190613    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:28.190778 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:28.190690    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:28.190836 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:28.190760    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:28.190836 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:28.190800    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:28.190942 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:28.190914    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:30.190892 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:30.190860    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:30.191376 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:30.190960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:30.191376 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:30.190988    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:30.191376 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:30.191031    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:30.191376 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:30.191031    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:30.191376 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:30.191134    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:32.190164 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.189978    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:32.190825 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.189977    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:32.190825 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:32.190256    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:32.190825 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.189977    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:32.190825 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:32.190303    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:32.190825 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:32.190350    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:32.407431 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.407396    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d2rv4" event={"ID":"04f97ba9-e71a-440d-9ea0-9d9a5f88da95","Type":"ContainerStarted","Data":"96a959f0dacbe2ffa262ffb7f20b2f473b6f9660065a4bfbe033da276f8c4cf0"}
Sep 10 21:19:32.409615 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.409582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2" event={"ID":"d1cffe97-7d50-4980-9cdf-8c840de0c9ef","Type":"ContainerStarted","Data":"f7efeec22ad5effafa9135f196ad5ff17d24fafabe7c5c7ec4bf82ebe64b20de"}
Sep 10 21:19:32.411355 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.411226    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zgtsv" event={"ID":"5cd516c0-6d5a-40e1-8ec1-5b00366a50ab","Type":"ContainerStarted","Data":"2eba1c6e1a33a5e6c1ae0df061083be20e4dcf8db834233f58b34826241d0a5d"}
Sep 10 21:19:32.413458 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.413178    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-glgcs" event={"ID":"dd2deb30-60af-4074-b910-bd87cebdf4bb","Type":"ContainerStarted","Data":"17eae80302807421a8292f58679ca0c64b149f25298bd753bc170f7a2f0b94fe"}
Sep 10 21:19:32.415007 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.414978    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vj5lr" event={"ID":"5bc12c40-3208-4e08-ac29-1cacd527aea8","Type":"ContainerStarted","Data":"b1669072b84fc9559ff6add1e238c6039c85f080370d15a0b83867e80a648985"}
Sep 10 21:19:32.416489 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.416451    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d9zqc" event={"ID":"fbfb8929-d843-40f2-8563-0992d0209310","Type":"ContainerStarted","Data":"8ac5e0aaa1e03f5e371d74498a881605936a4b848549a64525ad7cd32bdf97ce"}
Sep 10 21:19:32.419810 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.419768    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb" event={"ID":"60363da9-9c5f-4001-a8be-9ab2071a3811","Type":"ContainerStarted","Data":"b1a341b04c789e6e5b1ac3c6f128854a785eae3766f6aa52e712fab3d9336a2a"}
Sep 10 21:19:32.419918 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.419875    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb" event={"ID":"60363da9-9c5f-4001-a8be-9ab2071a3811","Type":"ContainerStarted","Data":"fb221c509eb9b0ffc768ccf493976f23a21d55f9436788e0dd469e44bf2176bd"}
Sep 10 21:19:32.419977 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.419928    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb" event={"ID":"60363da9-9c5f-4001-a8be-9ab2071a3811","Type":"ContainerStarted","Data":"f57c3f790a9cbf46600a19d89c24d71c183d73417fb60142e2894b29a31cf329"}
Sep 10 21:19:32.420036 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.419988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb" event={"ID":"60363da9-9c5f-4001-a8be-9ab2071a3811","Type":"ContainerStarted","Data":"5805a4b7c49f57b7f593280806e0b08040f81a69fbf77348c99c758774f15b81"}
Sep 10 21:19:32.420088 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.420049    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb" event={"ID":"60363da9-9c5f-4001-a8be-9ab2071a3811","Type":"ContainerStarted","Data":"ddc0cdc0622e6d5740a71bbd0d01aed5b4b9cd39963924e8d3cda2868615001a"}
Sep 10 21:19:32.420135 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.420079    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb" event={"ID":"60363da9-9c5f-4001-a8be-9ab2071a3811","Type":"ContainerStarted","Data":"390f03d3e80ac34df632c689099940d99bc59165f613b859179c955cd7384db8"}
Sep 10 21:19:32.421425 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.421398    2568 generic.go:356] "Generic (PLEG): container finished" podID="c33420a8-f603-42f3-a341-909e91b104e0" containerID="9c08324e85d8633cd68cad3b693fbf81bf54ba0b0a3d37653f713ec5ec2f55d3" exitCode=0
Sep 10 21:19:32.421529 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.421435    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm2sf" event={"ID":"c33420a8-f603-42f3-a341-909e91b104e0","Type":"ContainerDied","Data":"9c08324e85d8633cd68cad3b693fbf81bf54ba0b0a3d37653f713ec5ec2f55d3"}
Sep 10 21:19:32.427395 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.427341    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal" podStartSLOduration=20.427330233 podStartE2EDuration="20.427330233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:15.389208147 +0000 UTC m=+5.591538727" watchObservedRunningTime="2026-09-10 21:19:32.427330233 +0000 UTC m=+22.629660806"
Sep 10 21:19:32.427540 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.427422    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d2rv4" podStartSLOduration=3.054082711 podStartE2EDuration="21.427416252s" totalImagesPullingTime="18.373333541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:32.427291577 +0000 UTC m=+22.629622152" watchObservedRunningTime="2026-09-10 21:19:32.427416252 +0000 UTC m=+22.629746825"
Sep 10 21:19:32.444375 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.444303    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d9zqc" podStartSLOduration=3.123270729 podStartE2EDuration="21.444286978s" totalImagesPullingTime="18.321016249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:32.44371507 +0000 UTC m=+22.646045642" watchObservedRunningTime="2026-09-10 21:19:32.444286978 +0000 UTC m=+22.646617552"
Sep 10 21:19:32.461369 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.461326    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zgtsv" podStartSLOduration=3.119496375 podStartE2EDuration="21.461309835s" totalImagesPullingTime="18.34181346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:32.46129055 +0000 UTC m=+22.663621122" watchObservedRunningTime="2026-09-10 21:19:32.461309835 +0000 UTC m=+22.663640410"
Sep 10 21:19:32.480001 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.479963    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vj5lr" podStartSLOduration=3.13428047 podStartE2EDuration="21.479952302s" totalImagesPullingTime="18.345671832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:32.479845294 +0000 UTC m=+22.682175868" watchObservedRunningTime="2026-09-10 21:19:32.479952302 +0000 UTC m=+22.682282873"
Sep 10 21:19:32.503080 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.503040    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-glgcs" podStartSLOduration=3.172308459 podStartE2EDuration="21.503029514s" totalImagesPullingTime="18.330721055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:32.502905671 +0000 UTC m=+22.705236255" watchObservedRunningTime="2026-09-10 21:19:32.503029514 +0000 UTC m=+22.705360085"
Sep 10 21:19:32.905627 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.905597    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:32.906437 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:32.906418    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:33.261846 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:33.261709    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 21:19:33.425380 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:33.425305    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lc9p6" event={"ID":"5dc906ee-7674-4649-b5ae-ddf4564a3354","Type":"ContainerStarted","Data":"bd1a42ac8cc18c914ce84fbee24f9ad570e503d3f6cef680b5fbc91d6dda0a7e"}
Sep 10 21:19:33.427093 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:33.427063    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2" event={"ID":"d1cffe97-7d50-4980-9cdf-8c840de0c9ef","Type":"ContainerStarted","Data":"389bbb0e40ccc7e1ec0a626c81ecf27b4ef7dcd00c77d6e4aa468af8e4af82bf"}
Sep 10 21:19:33.427373 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:33.427356    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:33.428290 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:33.428276    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d9zqc"
Sep 10 21:19:33.441803 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:33.441460    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lc9p6" podStartSLOduration=4.094552602 podStartE2EDuration="22.441440081s" totalImagesPullingTime="18.346887479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:33.440440552 +0000 UTC m=+23.642771125" watchObservedRunningTime="2026-09-10 21:19:33.441440081 +0000 UTC m=+23.643770655"
Sep 10 21:19:34.189997 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:34.189962    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:34.189997 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:34.189992    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:34.190238 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:34.189965    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:34.190238 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:34.190105    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:34.190361 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:34.190251    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:34.190417 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:34.190388    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:34.207057 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:34.206983    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T21:19:33.261843Z","UUID":"80f17dd8-2186-4133-8228-4560813a48ae","Handler":null,"Name":"","Endpoint":""}
Sep 10 21:19:34.208556 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:34.208536    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 21:19:34.208680 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:34.208568    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 21:19:34.432150 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:34.432119    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2" event={"ID":"d1cffe97-7d50-4980-9cdf-8c840de0c9ef","Type":"ContainerStarted","Data":"e0568ead78306c6b774b637f978b0f1e61c1c7a4052dd62313bd8f7d30a17df9"}
Sep 10 21:19:34.437517 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:34.437492    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb" event={"ID":"60363da9-9c5f-4001-a8be-9ab2071a3811","Type":"ContainerStarted","Data":"9fa576ec995d02732f338c2f30cbd36c3e8cb87a4a99e9b7043d9d311fec439f"}
Sep 10 21:19:34.449645 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:34.449560    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5pz2" podStartSLOduration=2.92712439 podStartE2EDuration="23.449539072s" totalImagesPullingTime="20.522414682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:34.449488062 +0000 UTC m=+24.651818634" watchObservedRunningTime="2026-09-10 21:19:34.449539072 +0000 UTC m=+24.651869645"
Sep 10 21:19:36.190101 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:36.190067    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:36.190101 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:36.190098    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:36.190671 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:36.190069    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:36.190671 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:36.190165    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:36.190671 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:36.190262    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:36.190826 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:36.190804    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:38.190803 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:38.190639    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:38.191306 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:38.190639    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:38.191306 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:38.190900    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:38.191306 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:38.190719    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:38.191306 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:38.190952    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:38.191306 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:38.191027    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:38.449934 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:38.449873    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb" event={"ID":"60363da9-9c5f-4001-a8be-9ab2071a3811","Type":"ContainerStarted","Data":"e22330807c9a60cdae9fff88d6d74c6cbbd79fa0ac87e538cc1e0e6904e877a5"}
Sep 10 21:19:38.450133 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:38.450098    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:38.451846 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:38.451824    2568 generic.go:356] "Generic (PLEG): container finished" podID="c33420a8-f603-42f3-a341-909e91b104e0" containerID="2dc36ca62131ef72d6ac1080a8844c2dc571d55d4b1ee118e60564a61b2f725d" exitCode=0
Sep 10 21:19:38.451948 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:38.451876    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm2sf" event={"ID":"c33420a8-f603-42f3-a341-909e91b104e0","Type":"ContainerDied","Data":"2dc36ca62131ef72d6ac1080a8844c2dc571d55d4b1ee118e60564a61b2f725d"}
Sep 10 21:19:38.464260 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:38.464243    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:38.483837 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:38.483797    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb" podStartSLOduration=9.053072897 podStartE2EDuration="27.483781667s" totalImagesPullingTime="18.43070877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:38.483527206 +0000 UTC m=+28.685857780" watchObservedRunningTime="2026-09-10 21:19:38.483781667 +0000 UTC m=+28.686112238"
Sep 10 21:19:39.454558 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:39.454528    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:39.455214 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:39.454632    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:39.468388 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:39.468367    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:19:39.824817 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:39.824788    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r27tz"]
Sep 10 21:19:39.824941 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:39.824910    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:39.825008 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:39.824986    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:39.828076 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:39.828048    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kthqx"]
Sep 10 21:19:39.828182 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:39.828151    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:39.828271 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:39.828253    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:39.828948 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:39.828926    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jx9c8"]
Sep 10 21:19:39.829047 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:39.829030    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:39.829155 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:39.829137    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:40.459183 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:40.458995    2568 generic.go:356] "Generic (PLEG): container finished" podID="c33420a8-f603-42f3-a341-909e91b104e0" containerID="6af4a23d26503ee357096b37674f8694556f87a9b6de640b1fda9061a18af6f6" exitCode=0
Sep 10 21:19:40.459634 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:40.459077    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm2sf" event={"ID":"c33420a8-f603-42f3-a341-909e91b104e0","Type":"ContainerDied","Data":"6af4a23d26503ee357096b37674f8694556f87a9b6de640b1fda9061a18af6f6"}
Sep 10 21:19:41.190242 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:41.190194    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:41.190242 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:41.190238    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:41.190446 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:41.190329    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:41.190446 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:41.190386    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:41.190528 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:41.190472    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:41.190563 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:41.190549    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:41.466081 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:41.466050    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm2sf" event={"ID":"c33420a8-f603-42f3-a341-909e91b104e0","Type":"ContainerStarted","Data":"b69e3256be242fbded749128a9d96f207c4b94432a37384a64fff25d6be6099e"}
Sep 10 21:19:42.470766 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:42.470737    2568 generic.go:356] "Generic (PLEG): container finished" podID="c33420a8-f603-42f3-a341-909e91b104e0" containerID="b69e3256be242fbded749128a9d96f207c4b94432a37384a64fff25d6be6099e" exitCode=0
Sep 10 21:19:42.471124 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:42.470774    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm2sf" event={"ID":"c33420a8-f603-42f3-a341-909e91b104e0","Type":"ContainerDied","Data":"b69e3256be242fbded749128a9d96f207c4b94432a37384a64fff25d6be6099e"}
Sep 10 21:19:43.189886 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:43.189853    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:43.190050 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:43.189862    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:43.190050 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:43.189969    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jx9c8" podUID="810abf45-98cd-4b31-99d7-55b358f4183a"
Sep 10 21:19:43.190050 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:43.189873    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:43.190050 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:43.190029    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kthqx" podUID="32820bf3-c33a-4610-b8ba-4e97526b5bd2"
Sep 10 21:19:43.190271 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:43.190124    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r27tz" podUID="b0deb471-f73a-4e0d-9eb5-49527f70f628"
Sep 10 21:19:43.897387 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:43.897357    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:43.897820 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:43.897404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:43.897820 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:43.897508    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:43.897820 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:43.897573    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret podName:32820bf3-c33a-4610-b8ba-4e97526b5bd2 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:15.897556192 +0000 UTC m=+66.099886758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret") pod "global-pull-secret-syncer-kthqx" (UID: "32820bf3-c33a-4610-b8ba-4e97526b5bd2") : object "kube-system"/"original-pull-secret" not registered
Sep 10 21:19:43.897820 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:43.897508    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:43.897820 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:43.897658    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs podName:810abf45-98cd-4b31-99d7-55b358f4183a nodeName:}" failed. No retries permitted until 2026-09-10 21:20:15.897640565 +0000 UTC m=+66.099971121 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs") pod "network-metrics-daemon-jx9c8" (UID: "810abf45-98cd-4b31-99d7-55b358f4183a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 21:19:43.998429 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:43.998401    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqc5\" (UniqueName: \"kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5\") pod \"network-check-target-r27tz\" (UID: \"b0deb471-f73a-4e0d-9eb5-49527f70f628\") " pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:43.998575 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:43.998522    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 21:19:43.998575 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:43.998536    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 21:19:43.998575 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:43.998545    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gpqc5 for pod openshift-network-diagnostics/network-check-target-r27tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:43.998683 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:43.998593    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5 podName:b0deb471-f73a-4e0d-9eb5-49527f70f628 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:15.998577513 +0000 UTC m=+66.200908065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpqc5" (UniqueName: "kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5") pod "network-check-target-r27tz" (UID: "b0deb471-f73a-4e0d-9eb5-49527f70f628") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 21:19:44.625689 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.625664    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeReady"
Sep 10 21:19:44.625827 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.625774    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 21:19:44.662795 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.662759    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9fc8977fb-phrdh"]
Sep 10 21:19:44.677842 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.677818    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"]
Sep 10 21:19:44.677975 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.677957    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.680503 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.680483    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mvsp2\""
Sep 10 21:19:44.681739 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.681365    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 21:19:44.681739 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.681430    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 21:19:44.681739 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.681431    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 21:19:44.692903 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.691991    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"]
Sep 10 21:19:44.692903 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.692251    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 21:19:44.692903 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.692446    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"
Sep 10 21:19:44.697024 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.697002    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wgr2n\""
Sep 10 21:19:44.697735 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.697712    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 10 21:19:44.698174 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.697950    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 10 21:19:44.699170 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.698355    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 10 21:19:44.699170 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.698689    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:19:44.704549 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.704507    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-bdtx2"]
Sep 10 21:19:44.704652 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.704606    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:44.707409 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.707389    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 21:19:44.707827 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.707805    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 21:19:44.708993 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.708976    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g2fsp\""
Sep 10 21:19:44.709146 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.708978    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 21:19:44.709239 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.709163    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 21:19:44.723229 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.722957    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79cd7487cd-68dhk"]
Sep 10 21:19:44.723229 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.723076    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:44.726094 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.726076    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 21:19:44.726187 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.726092    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h97d8\""
Sep 10 21:19:44.726187 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.726147    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 21:19:44.726336 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.726214    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 21:19:44.726336 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.726077    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 21:19:44.731262 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.731243    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 21:19:44.737137 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.737120    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"]
Sep 10 21:19:44.737285 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.737268    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:44.739597 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.739544    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 21:19:44.740049 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.739828    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 21:19:44.740049 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.739837    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 21:19:44.740049 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.739828    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 21:19:44.740049 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.739895    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 21:19:44.740049 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.740007    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 21:19:44.740049 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.740028    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-srzpj\""
Sep 10 21:19:44.749502 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.749483    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-xgsm5"]
Sep 10 21:19:44.749621 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.749600    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"
Sep 10 21:19:44.752180 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.752158    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 21:19:44.752317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.752180    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fv9qz\""
Sep 10 21:19:44.752317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.752239    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:19:44.752317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.752315    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 21:19:44.752508 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.752432    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 21:19:44.764151 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.764132    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9fc8977fb-phrdh"]
Sep 10 21:19:44.764245 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.764168    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"]
Sep 10 21:19:44.764245 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.764193    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-xgsm5"]
Sep 10 21:19:44.764245 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.764234    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"]
Sep 10 21:19:44.764372 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.764255    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79cd7487cd-68dhk"]
Sep 10 21:19:44.764372 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.764276    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-45m6w"]
Sep 10 21:19:44.764372 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.764274    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-xgsm5"
Sep 10 21:19:44.766550 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.766530    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 21:19:44.766645 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.766598    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:19:44.767570 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.767552    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g48cd\""
Sep 10 21:19:44.774522 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.774503    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"]
Sep 10 21:19:44.774670 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.774650    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:44.776982 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.776962    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f6g5g\""
Sep 10 21:19:44.777188 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.777170    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 21:19:44.777326 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.777306    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 21:19:44.791007 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.790958    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-vcswn"]
Sep 10 21:19:44.791110 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.791091    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:19:44.794395 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.794377    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:19:44.794509 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.794410    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 10 21:19:44.794809 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.794793    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 10 21:19:44.794880 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.794853    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4lt82\""
Sep 10 21:19:44.804777 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.804753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/81d45025-d223-4c98-8cb7-8862526a046d-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:44.804881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.804786    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.804881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.804812    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-installation-pull-secrets\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.804881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.804843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a-config\") pod \"service-ca-operator-cf7c776b7-h944c\" (UID: \"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"
Sep 10 21:19:44.805018 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.804881    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5bps\" (UniqueName: \"kubernetes.io/projected/e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a-kube-api-access-f5bps\") pod \"service-ca-operator-cf7c776b7-h944c\" (UID: \"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"
Sep 10 21:19:44.805018 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.804906    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d6729db-ccf2-48d4-a5d6-201937367057-ca-trust-extracted\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.805018 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.804937    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-bound-sa-token\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.805018 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.805000    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a-serving-cert\") pod \"service-ca-operator-cf7c776b7-h944c\" (UID: \"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"
Sep 10 21:19:44.805137 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.805022    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtb4s\" (UniqueName: \"kubernetes.io/projected/81d45025-d223-4c98-8cb7-8862526a046d-kube-api-access-jtb4s\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:44.805137 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.805040    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4wjp\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-kube-api-access-j4wjp\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.805137 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.805058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:44.805137 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.805098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-registry-certificates\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.805137 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.805117    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-image-registry-private-configuration\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.805322 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.805137    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-trusted-ca\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.809507 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.809494    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:44.809575 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.809438    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-nqftg"]
Sep 10 21:19:44.811686 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.811671    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 10 21:19:44.811853 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.811836    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:19:44.811907 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.811841    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5lwmg\""
Sep 10 21:19:44.812017 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.812002    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 10 21:19:44.812151 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.812137    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 10 21:19:44.816538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.816521    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 10 21:19:44.827914 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.827897    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-nqftg"
Sep 10 21:19:44.827990 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.827845    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"]
Sep 10 21:19:44.828066 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.828050    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-bdtx2"]
Sep 10 21:19:44.828124 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.828087    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rg85p"]
Sep 10 21:19:44.830269 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.830244    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 21:19:44.830498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.830480    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 21:19:44.830498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.830497    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9srml\""
Sep 10 21:19:44.838101 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.838082    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-45m6w"]
Sep 10 21:19:44.838174 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.838123    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-nqftg"]
Sep 10 21:19:44.838174 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.838145    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"]
Sep 10 21:19:44.838174 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.838168    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-vcswn"]
Sep 10 21:19:44.838326 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.838184    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rg85p"]
Sep 10 21:19:44.838326 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.838283    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rg85p"
Sep 10 21:19:44.840652 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.840636    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 21:19:44.840750 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.840671    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 21:19:44.842302 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.842285    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bgqsb\""
Sep 10 21:19:44.842412 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.842344    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 21:19:44.869241 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.869220    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9zqc_fbfb8929-d843-40f2-8563-0992d0209310/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:44.906257 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-registry-certificates\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.906641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e81cef71-792e-40cd-ae39-887ffd2bf1ea-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dr2wx\" (UID: \"e81cef71-792e-40cd-ae39-887ffd2bf1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"
Sep 10 21:19:44.906641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906282    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a-serving-cert\") pod \"service-ca-operator-cf7c776b7-h944c\" (UID: \"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"
Sep 10 21:19:44.906641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906299    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:44.906641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906343    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn49c\" (UniqueName: \"kubernetes.io/projected/ed1605d8-d145-4cc4-8172-d6b03ffa2058-kube-api-access-sn49c\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:44.906641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-serving-cert\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:44.906641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906390    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtb4s\" (UniqueName: \"kubernetes.io/projected/81d45025-d223-4c98-8cb7-8862526a046d-kube-api-access-jtb4s\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:44.906641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906406    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05a25009-e9db-4042-ba43-54abf4fcc40b-config\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:44.906641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906423    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05a25009-e9db-4042-ba43-54abf4fcc40b-serving-cert\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:44.906641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906495    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e81cef71-792e-40cd-ae39-887ffd2bf1ea-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dr2wx\" (UID: \"e81cef71-792e-40cd-ae39-887ffd2bf1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"
Sep 10 21:19:44.906641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906530    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-image-registry-private-configuration\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.906641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906557    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:44.907104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906666    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-trusted-ca\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.907104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906706    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-trusted-ca-bundle\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:44.907104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906731    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9wsg\" (UniqueName: \"kubernetes.io/projected/42edae3f-5ced-4adb-980a-0e52280f3c28-kube-api-access-h9wsg\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:19:44.907104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.906789    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-registry-certificates\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.907307 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907128    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d6729db-ccf2-48d4-a5d6-201937367057-ca-trust-extracted\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.907307 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907216    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-snapshots\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:44.907307 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907248    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-service-ca-bundle\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:44.907307 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzj7t\" (UniqueName: \"kubernetes.io/projected/e81cef71-792e-40cd-ae39-887ffd2bf1ea-kube-api-access-wzj7t\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dr2wx\" (UID: \"e81cef71-792e-40cd-ae39-887ffd2bf1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"
Sep 10 21:19:44.907498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907322    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjvsp\" (UniqueName: \"kubernetes.io/projected/71c1b5d7-25bb-4890-ac13-247f2d355006-kube-api-access-zjvsp\") pod \"volume-data-source-validator-86695b7cc7-xgsm5\" (UID: \"71c1b5d7-25bb-4890-ac13-247f2d355006\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-xgsm5"
Sep 10 21:19:44.907498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907354    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-tmp\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:44.907498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907396    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:44.907498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907424    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:44.907498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907464    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4wjp\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-kube-api-access-j4wjp\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.907498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907490    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d6729db-ccf2-48d4-a5d6-201937367057-ca-trust-extracted\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.907724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907499    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg94b\" (UniqueName: \"kubernetes.io/projected/cca846cb-713a-479b-ac8f-47133f900f05-kube-api-access-kg94b\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:44.907724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907531    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:19:44.907724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907559    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcqmv\" (UniqueName: \"kubernetes.io/projected/05a25009-e9db-4042-ba43-54abf4fcc40b-kube-api-access-dcqmv\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:44.907724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907595    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-default-certificate\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:44.907724 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:44.907698    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 21:19:44.907929 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:44.907773    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls podName:81d45025-d223-4c98-8cb7-8862526a046d nodeName:}" failed. No retries permitted until 2026-09-10 21:19:45.407753617 +0000 UTC m=+35.610084169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-wf8wk" (UID: "81d45025-d223-4c98-8cb7-8862526a046d") : secret "cluster-monitoring-operator-tls" not found
Sep 10 21:19:44.907989 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.907968    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca846cb-713a-479b-ac8f-47133f900f05-tmp-dir\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.908037    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-trusted-ca\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.908097    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cca846cb-713a-479b-ac8f-47133f900f05-config-volume\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.908140    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/81d45025-d223-4c98-8cb7-8862526a046d-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.908171    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05a25009-e9db-4042-ba43-54abf4fcc40b-trusted-ca\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.908220    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfts9\" (UniqueName: \"kubernetes.io/projected/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-kube-api-access-cfts9\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.908255    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.908281    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-installation-pull-secrets\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.908321    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a-config\") pod \"service-ca-operator-cf7c776b7-h944c\" (UID: \"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.908367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5bps\" (UniqueName: \"kubernetes.io/projected/e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a-kube-api-access-f5bps\") pod \"service-ca-operator-cf7c776b7-h944c\" (UID: \"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.908396    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-stats-auth\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.908428    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-bound-sa-token\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.909392    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/81d45025-d223-4c98-8cb7-8862526a046d-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:44.909512    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:44.909525    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9fc8977fb-phrdh: secret "image-registry-tls" not found
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:44.909585    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls podName:6d6729db-ccf2-48d4-a5d6-201937367057 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:45.409569622 +0000 UTC m=+35.611900186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls") pod "image-registry-9fc8977fb-phrdh" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057") : secret "image-registry-tls" not found
Sep 10 21:19:44.912010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.910762    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a-config\") pod \"service-ca-operator-cf7c776b7-h944c\" (UID: \"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"
Sep 10 21:19:44.912852 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.911140    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a-serving-cert\") pod \"service-ca-operator-cf7c776b7-h944c\" (UID: \"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"
Sep 10 21:19:44.912852 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.911285    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-image-registry-private-configuration\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.912852 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.912729    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-installation-pull-secrets\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.915525 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.915499    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtb4s\" (UniqueName: \"kubernetes.io/projected/81d45025-d223-4c98-8cb7-8862526a046d-kube-api-access-jtb4s\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:44.916255 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.916182    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4wjp\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-kube-api-access-j4wjp\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.916857 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.916833    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-bound-sa-token\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:44.917245 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.917227    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5bps\" (UniqueName: \"kubernetes.io/projected/e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a-kube-api-access-f5bps\") pod \"service-ca-operator-cf7c776b7-h944c\" (UID: \"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"
Sep 10 21:19:44.957122 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:44.957092    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9zqc_fbfb8929-d843-40f2-8563-0992d0209310/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:45.006259 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.006232    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"
Sep 10 21:19:45.008689 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.008669    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-service-ca-bundle\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.008791 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.008700    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzj7t\" (UniqueName: \"kubernetes.io/projected/e81cef71-792e-40cd-ae39-887ffd2bf1ea-kube-api-access-wzj7t\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dr2wx\" (UID: \"e81cef71-792e-40cd-ae39-887ffd2bf1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"
Sep 10 21:19:45.008791 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.008729    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjvsp\" (UniqueName: \"kubernetes.io/projected/71c1b5d7-25bb-4890-ac13-247f2d355006-kube-api-access-zjvsp\") pod \"volume-data-source-validator-86695b7cc7-xgsm5\" (UID: \"71c1b5d7-25bb-4890-ac13-247f2d355006\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-xgsm5"
Sep 10 21:19:45.008791 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.008755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-tmp\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.009096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009021    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:45.009096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009058    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg94b\" (UniqueName: \"kubernetes.io/projected/cca846cb-713a-479b-ac8f-47133f900f05-kube-api-access-kg94b\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:45.009096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009084    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:19:45.009279 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009112    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcqmv\" (UniqueName: \"kubernetes.io/projected/05a25009-e9db-4042-ba43-54abf4fcc40b-kube-api-access-dcqmv\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:45.009279 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009123    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-tmp\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.009279 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009135    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-default-certificate\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:45.009279 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca846cb-713a-479b-ac8f-47133f900f05-tmp-dir\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:45.009279 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009235    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cca846cb-713a-479b-ac8f-47133f900f05-config-volume\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:45.009279 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009266    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05a25009-e9db-4042-ba43-54abf4fcc40b-trusted-ca\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:45.009562 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009294    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfts9\" (UniqueName: \"kubernetes.io/projected/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-kube-api-access-cfts9\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.009562 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009350    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-stats-auth\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:45.009562 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009363    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-service-ca-bundle\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.009562 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e81cef71-792e-40cd-ae39-887ffd2bf1ea-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dr2wx\" (UID: \"e81cef71-792e-40cd-ae39-887ffd2bf1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"
Sep 10 21:19:45.009748 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.009691    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:45.509671513 +0000 UTC m=+35.712002088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : configmap references non-existent config key: service-ca.crt
Sep 10 21:19:45.009992 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009857    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:45.009992 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn49c\" (UniqueName: \"kubernetes.io/projected/ed1605d8-d145-4cc4-8172-d6b03ffa2058-kube-api-access-sn49c\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:45.009992 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.009913    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 21:19:45.009992 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-serving-cert\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.009992 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.009948    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05a25009-e9db-4042-ba43-54abf4fcc40b-config\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:45.009992 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.009975    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls podName:42edae3f-5ced-4adb-980a-0e52280f3c28 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:45.509958146 +0000 UTC m=+35.712288715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xnkbp" (UID: "42edae3f-5ced-4adb-980a-0e52280f3c28") : secret "samples-operator-tls" not found
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.010389    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05a25009-e9db-4042-ba43-54abf4fcc40b-serving-cert\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.010434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e81cef71-792e-40cd-ae39-887ffd2bf1ea-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dr2wx\" (UID: \"e81cef71-792e-40cd-ae39-887ffd2bf1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.010462    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.010501    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lttln\" (UniqueName: \"kubernetes.io/projected/2a0dbe00-190a-4b21-99af-523e61a90da6-kube-api-access-lttln\") pod \"network-check-source-6f8b768455-nqftg\" (UID: \"2a0dbe00-190a-4b21-99af-523e61a90da6\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-nqftg"
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.010545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-trusted-ca-bundle\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.010569    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d78005f-ee4e-4f99-9c0f-3250fe9eebd7-cert\") pod \"ingress-canary-rg85p\" (UID: \"8d78005f-ee4e-4f99-9c0f-3250fe9eebd7\") " pod="openshift-ingress-canary/ingress-canary-rg85p"
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.010596    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9wsg\" (UniqueName: \"kubernetes.io/projected/42edae3f-5ced-4adb-980a-0e52280f3c28-kube-api-access-h9wsg\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.010627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbtfm\" (UniqueName: \"kubernetes.io/projected/8d78005f-ee4e-4f99-9c0f-3250fe9eebd7-kube-api-access-mbtfm\") pod \"ingress-canary-rg85p\" (UID: \"8d78005f-ee4e-4f99-9c0f-3250fe9eebd7\") " pod="openshift-ingress-canary/ingress-canary-rg85p"
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.010626    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cca846cb-713a-479b-ac8f-47133f900f05-config-volume\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.010662    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05a25009-e9db-4042-ba43-54abf4fcc40b-config\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.010708    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-snapshots\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.010735    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 21:19:45.010958 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.010773    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls podName:cca846cb-713a-479b-ac8f-47133f900f05 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:45.510761418 +0000 UTC m=+35.713091981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls") pod "dns-default-45m6w" (UID: "cca846cb-713a-479b-ac8f-47133f900f05") : secret "dns-default-metrics-tls" not found
Sep 10 21:19:45.011679 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.011258    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-snapshots\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.011679 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.011481    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca846cb-713a-479b-ac8f-47133f900f05-tmp-dir\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:45.012226 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.011827    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e81cef71-792e-40cd-ae39-887ffd2bf1ea-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dr2wx\" (UID: \"e81cef71-792e-40cd-ae39-887ffd2bf1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"
Sep 10 21:19:45.012226 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.011920    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 21:19:45.012226 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.011963    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-default-certificate\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:45.012226 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.011974    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:45.511949885 +0000 UTC m=+35.714280435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : secret "router-metrics-certs-default" not found
Sep 10 21:19:45.012775 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.012751    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05a25009-e9db-4042-ba43-54abf4fcc40b-trusted-ca\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:45.012858 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.012771    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-trusted-ca-bundle\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.012914 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.012861    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e81cef71-792e-40cd-ae39-887ffd2bf1ea-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dr2wx\" (UID: \"e81cef71-792e-40cd-ae39-887ffd2bf1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"
Sep 10 21:19:45.013506 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.013486    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05a25009-e9db-4042-ba43-54abf4fcc40b-serving-cert\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:45.014319 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.014297    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-serving-cert\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.014831 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.014807    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-stats-auth\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:45.018913 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.018890    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzj7t\" (UniqueName: \"kubernetes.io/projected/e81cef71-792e-40cd-ae39-887ffd2bf1ea-kube-api-access-wzj7t\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dr2wx\" (UID: \"e81cef71-792e-40cd-ae39-887ffd2bf1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"
Sep 10 21:19:45.019889 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.019865    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcqmv\" (UniqueName: \"kubernetes.io/projected/05a25009-e9db-4042-ba43-54abf4fcc40b-kube-api-access-dcqmv\") pod \"console-operator-696884fb9c-vcswn\" (UID: \"05a25009-e9db-4042-ba43-54abf4fcc40b\") " pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:45.020455 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.020434    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfts9\" (UniqueName: \"kubernetes.io/projected/c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3-kube-api-access-cfts9\") pod \"insights-operator-5844b856db-bdtx2\" (UID: \"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3\") " pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.020874 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.020841    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg94b\" (UniqueName: \"kubernetes.io/projected/cca846cb-713a-479b-ac8f-47133f900f05-kube-api-access-kg94b\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:45.021252 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.021184    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9wsg\" (UniqueName: \"kubernetes.io/projected/42edae3f-5ced-4adb-980a-0e52280f3c28-kube-api-access-h9wsg\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:19:45.021753 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.021726    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjvsp\" (UniqueName: \"kubernetes.io/projected/71c1b5d7-25bb-4890-ac13-247f2d355006-kube-api-access-zjvsp\") pod \"volume-data-source-validator-86695b7cc7-xgsm5\" (UID: \"71c1b5d7-25bb-4890-ac13-247f2d355006\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-xgsm5"
Sep 10 21:19:45.021848 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.021798    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn49c\" (UniqueName: \"kubernetes.io/projected/ed1605d8-d145-4cc4-8172-d6b03ffa2058-kube-api-access-sn49c\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:45.033764 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.033741    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-bdtx2"
Sep 10 21:19:45.058903 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.058882    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"
Sep 10 21:19:45.059505 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.059476    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9zqc_fbfb8929-d843-40f2-8563-0992d0209310/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:45.075616 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.075428    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-xgsm5"
Sep 10 21:19:45.111344 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.111261    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lttln\" (UniqueName: \"kubernetes.io/projected/2a0dbe00-190a-4b21-99af-523e61a90da6-kube-api-access-lttln\") pod \"network-check-source-6f8b768455-nqftg\" (UID: \"2a0dbe00-190a-4b21-99af-523e61a90da6\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-nqftg"
Sep 10 21:19:45.111344 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.111298    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d78005f-ee4e-4f99-9c0f-3250fe9eebd7-cert\") pod \"ingress-canary-rg85p\" (UID: \"8d78005f-ee4e-4f99-9c0f-3250fe9eebd7\") " pod="openshift-ingress-canary/ingress-canary-rg85p"
Sep 10 21:19:45.111344 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.111317    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbtfm\" (UniqueName: \"kubernetes.io/projected/8d78005f-ee4e-4f99-9c0f-3250fe9eebd7-kube-api-access-mbtfm\") pod \"ingress-canary-rg85p\" (UID: \"8d78005f-ee4e-4f99-9c0f-3250fe9eebd7\") " pod="openshift-ingress-canary/ingress-canary-rg85p"
Sep 10 21:19:45.114929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.114860    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d78005f-ee4e-4f99-9c0f-3250fe9eebd7-cert\") pod \"ingress-canary-rg85p\" (UID: \"8d78005f-ee4e-4f99-9c0f-3250fe9eebd7\") " pod="openshift-ingress-canary/ingress-canary-rg85p"
Sep 10 21:19:45.116883 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.116863    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:19:45.120164 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.120141    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbtfm\" (UniqueName: \"kubernetes.io/projected/8d78005f-ee4e-4f99-9c0f-3250fe9eebd7-kube-api-access-mbtfm\") pod \"ingress-canary-rg85p\" (UID: \"8d78005f-ee4e-4f99-9c0f-3250fe9eebd7\") " pod="openshift-ingress-canary/ingress-canary-rg85p"
Sep 10 21:19:45.120336 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.120313    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lttln\" (UniqueName: \"kubernetes.io/projected/2a0dbe00-190a-4b21-99af-523e61a90da6-kube-api-access-lttln\") pod \"network-check-source-6f8b768455-nqftg\" (UID: \"2a0dbe00-190a-4b21-99af-523e61a90da6\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-nqftg"
Sep 10 21:19:45.138305 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.137824    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-nqftg"
Sep 10 21:19:45.147699 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.147666    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rg85p"
Sep 10 21:19:45.190237 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.189982    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:19:45.191104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.190811    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:19:45.192684 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.191643    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:19:45.197045 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.196493    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c8fbc\""
Sep 10 21:19:45.197045 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.196501    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kc896\""
Sep 10 21:19:45.197045 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.196548    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 21:19:45.197045 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.196743    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 21:19:45.299476 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.299396    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c"]
Sep 10 21:19:45.303503 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:45.303476    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4bc7c26_6bfe_47cd_bb4e_2a301f4a4f7a.slice/crio-6fa22daba70e424978bd3bef1c9f9a13581ef3ab665ec43ab0aa0054654a1bc0 WatchSource:0}: Error finding container 6fa22daba70e424978bd3bef1c9f9a13581ef3ab665ec43ab0aa0054654a1bc0: Status 404 returned error can't find the container with id 6fa22daba70e424978bd3bef1c9f9a13581ef3ab665ec43ab0aa0054654a1bc0
Sep 10 21:19:45.316753 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.316730    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-bdtx2"]
Sep 10 21:19:45.319073 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:45.319055    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0bf26a3_570a_4d3f_a0b4_b61dd92f81f3.slice/crio-ae37b0b5a9f96d5490b360404c50734a0816921ce7d82f76168a4eabf58f46cb WatchSource:0}: Error finding container ae37b0b5a9f96d5490b360404c50734a0816921ce7d82f76168a4eabf58f46cb: Status 404 returned error can't find the container with id ae37b0b5a9f96d5490b360404c50734a0816921ce7d82f76168a4eabf58f46cb
Sep 10 21:19:45.359347 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.359301    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx"]
Sep 10 21:19:45.361865 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:45.361845    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81cef71_792e_40cd_ae39_887ffd2bf1ea.slice/crio-a2a6c9b7bb535a960fb21797b1c7d61fb227749fd15573cf775f9b9dad11c724 WatchSource:0}: Error finding container a2a6c9b7bb535a960fb21797b1c7d61fb227749fd15573cf775f9b9dad11c724: Status 404 returned error can't find the container with id a2a6c9b7bb535a960fb21797b1c7d61fb227749fd15573cf775f9b9dad11c724
Sep 10 21:19:45.372937 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.372912    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-xgsm5"]
Sep 10 21:19:45.375696 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:45.375676    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c1b5d7_25bb_4890_ac13_247f2d355006.slice/crio-c908b0d3acbeb5f73fa38450ffb0b578b8e3cca061659fa6bfc9108980bcb22e WatchSource:0}: Error finding container c908b0d3acbeb5f73fa38450ffb0b578b8e3cca061659fa6bfc9108980bcb22e: Status 404 returned error can't find the container with id c908b0d3acbeb5f73fa38450ffb0b578b8e3cca061659fa6bfc9108980bcb22e
Sep 10 21:19:45.413857 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.413836    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-vcswn"]
Sep 10 21:19:45.414065 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.414045    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:45.414261 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.414174    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 21:19:45.414261 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.414190    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9fc8977fb-phrdh: secret "image-registry-tls" not found
Sep 10 21:19:45.414261 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.414256    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls podName:6d6729db-ccf2-48d4-a5d6-201937367057 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:46.414238953 +0000 UTC m=+36.616569505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls") pod "image-registry-9fc8977fb-phrdh" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057") : secret "image-registry-tls" not found
Sep 10 21:19:45.414375 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.414262    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 21:19:45.414375 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.414299    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls podName:81d45025-d223-4c98-8cb7-8862526a046d nodeName:}" failed. No retries permitted until 2026-09-10 21:19:46.414287643 +0000 UTC m=+36.616618208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-wf8wk" (UID: "81d45025-d223-4c98-8cb7-8862526a046d") : secret "cluster-monitoring-operator-tls" not found
Sep 10 21:19:45.414375 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.414175    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:45.416269 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:45.416246    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a25009_e9db_4042_ba43_54abf4fcc40b.slice/crio-44e0a5f4c7c472f0267d4ed946566552c45240608c01ba7ff8f9cc8179ffe889 WatchSource:0}: Error finding container 44e0a5f4c7c472f0267d4ed946566552c45240608c01ba7ff8f9cc8179ffe889: Status 404 returned error can't find the container with id 44e0a5f4c7c472f0267d4ed946566552c45240608c01ba7ff8f9cc8179ffe889
Sep 10 21:19:45.441555 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.441535    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-nqftg"]
Sep 10 21:19:45.444259 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:45.444235    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0dbe00_190a_4b21_99af_523e61a90da6.slice/crio-d4e23f645d2b4a4880873892a85564653e1f51f0d98fb204a37baafcbb7726f6 WatchSource:0}: Error finding container d4e23f645d2b4a4880873892a85564653e1f51f0d98fb204a37baafcbb7726f6: Status 404 returned error can't find the container with id d4e23f645d2b4a4880873892a85564653e1f51f0d98fb204a37baafcbb7726f6
Sep 10 21:19:45.444608 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.444586    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rg85p"]
Sep 10 21:19:45.447466 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:19:45.447446    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d78005f_ee4e_4f99_9c0f_3250fe9eebd7.slice/crio-503b252d5c9c8cecd9a721a90a7108c64ca61dade8fe4af79a92d21777c5b7f0 WatchSource:0}: Error finding container 503b252d5c9c8cecd9a721a90a7108c64ca61dade8fe4af79a92d21777c5b7f0: Status 404 returned error can't find the container with id 503b252d5c9c8cecd9a721a90a7108c64ca61dade8fe4af79a92d21777c5b7f0
Sep 10 21:19:45.478340 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.478316    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-xgsm5" event={"ID":"71c1b5d7-25bb-4890-ac13-247f2d355006","Type":"ContainerStarted","Data":"c908b0d3acbeb5f73fa38450ffb0b578b8e3cca061659fa6bfc9108980bcb22e"}
Sep 10 21:19:45.479714 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.479689    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-bdtx2" event={"ID":"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3","Type":"ContainerStarted","Data":"ae37b0b5a9f96d5490b360404c50734a0816921ce7d82f76168a4eabf58f46cb"}
Sep 10 21:19:45.481025 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.481002    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c" event={"ID":"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a","Type":"ContainerStarted","Data":"6fa22daba70e424978bd3bef1c9f9a13581ef3ab665ec43ab0aa0054654a1bc0"}
Sep 10 21:19:45.482246 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.482225    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-vcswn" event={"ID":"05a25009-e9db-4042-ba43-54abf4fcc40b","Type":"ContainerStarted","Data":"44e0a5f4c7c472f0267d4ed946566552c45240608c01ba7ff8f9cc8179ffe889"}
Sep 10 21:19:45.483618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.483594    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rg85p" event={"ID":"8d78005f-ee4e-4f99-9c0f-3250fe9eebd7","Type":"ContainerStarted","Data":"503b252d5c9c8cecd9a721a90a7108c64ca61dade8fe4af79a92d21777c5b7f0"}
Sep 10 21:19:45.484836 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.484809    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-nqftg" event={"ID":"2a0dbe00-190a-4b21-99af-523e61a90da6","Type":"ContainerStarted","Data":"d4e23f645d2b4a4880873892a85564653e1f51f0d98fb204a37baafcbb7726f6"}
Sep 10 21:19:45.486025 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.486007    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx" event={"ID":"e81cef71-792e-40cd-ae39-887ffd2bf1ea","Type":"ContainerStarted","Data":"a2a6c9b7bb535a960fb21797b1c7d61fb227749fd15573cf775f9b9dad11c724"}
Sep 10 21:19:45.515548 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.515526    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:45.515648 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.515562    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:45.515695 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.515675    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 21:19:45.515738 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.515703    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:45.515738 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.515731    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls podName:cca846cb-713a-479b-ac8f-47133f900f05 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:46.515714178 +0000 UTC m=+36.718044772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls") pod "dns-default-45m6w" (UID: "cca846cb-713a-479b-ac8f-47133f900f05") : secret "dns-default-metrics-tls" not found
Sep 10 21:19:45.515828 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.515675    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 21:19:45.515828 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.515794    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:46.515782031 +0000 UTC m=+36.718112580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : secret "router-metrics-certs-default" not found
Sep 10 21:19:45.515828 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:45.515815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:19:45.515952 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.515870    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 21:19:45.515952 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.515908    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls podName:42edae3f-5ced-4adb-980a-0e52280f3c28 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:46.515893217 +0000 UTC m=+36.718223780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xnkbp" (UID: "42edae3f-5ced-4adb-980a-0e52280f3c28") : secret "samples-operator-tls" not found
Sep 10 21:19:45.516061 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:45.515961    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:46.515952062 +0000 UTC m=+36.718282617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : configmap references non-existent config key: service-ca.crt
Sep 10 21:19:46.337394 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.337362    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"]
Sep 10 21:19:46.358831 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.358804    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"]
Sep 10 21:19:46.358981 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.358916    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:19:46.362545 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.361867    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dwpsz\""
Sep 10 21:19:46.362545 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.362129    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 10 21:19:46.362545 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.362361    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 10 21:19:46.423449 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.423414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:46.423603 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.423562    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:46.423721 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.423704    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 21:19:46.423790 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.423777    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls podName:81d45025-d223-4c98-8cb7-8862526a046d nodeName:}" failed. No retries permitted until 2026-09-10 21:19:48.423759518 +0000 UTC m=+38.626090074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-wf8wk" (UID: "81d45025-d223-4c98-8cb7-8862526a046d") : secret "cluster-monitoring-operator-tls" not found
Sep 10 21:19:46.424378 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.424242    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 21:19:46.424378 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.424264    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9fc8977fb-phrdh: secret "image-registry-tls" not found
Sep 10 21:19:46.424378 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.424310    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls podName:6d6729db-ccf2-48d4-a5d6-201937367057 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:48.424294502 +0000 UTC m=+38.626625066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls") pod "image-registry-9fc8977fb-phrdh" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057") : secret "image-registry-tls" not found
Sep 10 21:19:46.524341 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.524309    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:19:46.524508 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.524359    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c20f577d-54db-4161-be6c-d730b05dfb35-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:19:46.524508 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.524418    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:46.524508 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.524452    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:46.524678 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.524521    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:46.524678 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.524553    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:19:46.524786 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.524692    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 21:19:46.524786 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.524747    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls podName:42edae3f-5ced-4adb-980a-0e52280f3c28 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:48.524729485 +0000 UTC m=+38.727060040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xnkbp" (UID: "42edae3f-5ced-4adb-980a-0e52280f3c28") : secret "samples-operator-tls" not found
Sep 10 21:19:46.525231 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.525194    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:48.525176491 +0000 UTC m=+38.727507045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : configmap references non-existent config key: service-ca.crt
Sep 10 21:19:46.525344 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.525290    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 21:19:46.525344 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.525328    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:48.525315955 +0000 UTC m=+38.727646512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : secret "router-metrics-certs-default" not found
Sep 10 21:19:46.525461 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.525395    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 21:19:46.525461 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.525427    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls podName:cca846cb-713a-479b-ac8f-47133f900f05 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:48.525417473 +0000 UTC m=+38.727748027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls") pod "dns-default-45m6w" (UID: "cca846cb-713a-479b-ac8f-47133f900f05") : secret "dns-default-metrics-tls" not found
Sep 10 21:19:46.626127 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.626048    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:19:46.626127 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.626098    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c20f577d-54db-4161-be6c-d730b05dfb35-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:19:46.627022 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:46.626996    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c20f577d-54db-4161-be6c-d730b05dfb35-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:19:46.627138 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.627106    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 21:19:46.627215 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:46.627159    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert podName:c20f577d-54db-4161-be6c-d730b05dfb35 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:47.127142802 +0000 UTC m=+37.329473359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vj9kb" (UID: "c20f577d-54db-4161-be6c-d730b05dfb35") : secret "networking-console-plugin-cert" not found
Sep 10 21:19:47.134098 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:47.133343    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:19:47.134098 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:47.133624    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 21:19:47.134098 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:47.133698    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert podName:c20f577d-54db-4161-be6c-d730b05dfb35 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:48.133680381 +0000 UTC m=+38.336010936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vj9kb" (UID: "c20f577d-54db-4161-be6c-d730b05dfb35") : secret "networking-console-plugin-cert" not found
Sep 10 21:19:48.145773 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:48.145258    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:19:48.145773 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.145434    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 21:19:48.145773 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.145489    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert podName:c20f577d-54db-4161-be6c-d730b05dfb35 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:50.145471121 +0000 UTC m=+40.347801724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vj9kb" (UID: "c20f577d-54db-4161-be6c-d730b05dfb35") : secret "networking-console-plugin-cert" not found
Sep 10 21:19:48.447796 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:48.447674    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:48.447963 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:48.447794    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:48.447963 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.447853    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 21:19:48.447963 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.447932    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls podName:81d45025-d223-4c98-8cb7-8862526a046d nodeName:}" failed. No retries permitted until 2026-09-10 21:19:52.447908691 +0000 UTC m=+42.650239254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-wf8wk" (UID: "81d45025-d223-4c98-8cb7-8862526a046d") : secret "cluster-monitoring-operator-tls" not found
Sep 10 21:19:48.448149 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.447997    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 21:19:48.448149 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.448012    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9fc8977fb-phrdh: secret "image-registry-tls" not found
Sep 10 21:19:48.448149 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.448063    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls podName:6d6729db-ccf2-48d4-a5d6-201937367057 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:52.448046892 +0000 UTC m=+42.650377463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls") pod "image-registry-9fc8977fb-phrdh" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057") : secret "image-registry-tls" not found
Sep 10 21:19:48.548866 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:48.548841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:48.549002 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:48.548876    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:48.549002 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:48.548932    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:48.549002 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:48.548960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:19:48.549002 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.548991    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 21:19:48.549222 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.549047    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 21:19:48.549222 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.549054    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls podName:cca846cb-713a-479b-ac8f-47133f900f05 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:52.549036122 +0000 UTC m=+42.751366691 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls") pod "dns-default-45m6w" (UID: "cca846cb-713a-479b-ac8f-47133f900f05") : secret "dns-default-metrics-tls" not found
Sep 10 21:19:48.549222 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.549064    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 21:19:48.549222 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.549080    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls podName:42edae3f-5ced-4adb-980a-0e52280f3c28 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:52.549070781 +0000 UTC m=+42.751401335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xnkbp" (UID: "42edae3f-5ced-4adb-980a-0e52280f3c28") : secret "samples-operator-tls" not found
Sep 10 21:19:48.549222 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.549094    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:52.54908693 +0000 UTC m=+42.751417482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : configmap references non-existent config key: service-ca.crt
Sep 10 21:19:48.549222 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:48.549120    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:52.549103098 +0000 UTC m=+42.751433662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : secret "router-metrics-certs-default" not found
Sep 10 21:19:50.164144 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:50.164110    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:19:50.164543 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:50.164240    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 21:19:50.164543 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:50.164289    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert podName:c20f577d-54db-4161-be6c-d730b05dfb35 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:54.16427701 +0000 UTC m=+44.366607560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vj9kb" (UID: "c20f577d-54db-4161-be6c-d730b05dfb35") : secret "networking-console-plugin-cert" not found
Sep 10 21:19:52.481353 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:52.481311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:19:52.481818 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:52.481469    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:19:52.481818 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.481484    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 21:19:52.481818 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.481501    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9fc8977fb-phrdh: secret "image-registry-tls" not found
Sep 10 21:19:52.481818 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.481563    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls podName:6d6729db-ccf2-48d4-a5d6-201937367057 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:00.481542782 +0000 UTC m=+50.683873354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls") pod "image-registry-9fc8977fb-phrdh" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057") : secret "image-registry-tls" not found
Sep 10 21:19:52.481818 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.481680    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 21:19:52.481818 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.481771    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls podName:81d45025-d223-4c98-8cb7-8862526a046d nodeName:}" failed. No retries permitted until 2026-09-10 21:20:00.48175105 +0000 UTC m=+50.684081619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-wf8wk" (UID: "81d45025-d223-4c98-8cb7-8862526a046d") : secret "cluster-monitoring-operator-tls" not found
Sep 10 21:19:52.582303 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:52.582263    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:52.582483 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:52.582345    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:19:52.582483 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:52.582382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:19:52.582483 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.582439    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 21:19:52.582629 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.582514    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:00.582492764 +0000 UTC m=+50.784823330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : secret "router-metrics-certs-default" not found
Sep 10 21:19:52.582629 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:52.582541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:19:52.582629 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.582563    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 21:19:52.582629 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.582601    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls podName:42edae3f-5ced-4adb-980a-0e52280f3c28 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:00.582590596 +0000 UTC m=+50.784921146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xnkbp" (UID: "42edae3f-5ced-4adb-980a-0e52280f3c28") : secret "samples-operator-tls" not found
Sep 10 21:19:52.582788 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.582645    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:00.582638797 +0000 UTC m=+50.784969347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : configmap references non-existent config key: service-ca.crt
Sep 10 21:19:52.582788 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.582645    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 21:19:52.582788 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:52.582667    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls podName:cca846cb-713a-479b-ac8f-47133f900f05 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:00.582661274 +0000 UTC m=+50.784991872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls") pod "dns-default-45m6w" (UID: "cca846cb-713a-479b-ac8f-47133f900f05") : secret "dns-default-metrics-tls" not found
Sep 10 21:19:54.194576 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:54.194542    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:19:54.195037 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:54.194668    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 21:19:54.195037 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:54.194735    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert podName:c20f577d-54db-4161-be6c-d730b05dfb35 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:02.194715471 +0000 UTC m=+52.397046043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vj9kb" (UID: "c20f577d-54db-4161-be6c-d730b05dfb35") : secret "networking-console-plugin-cert" not found
Sep 10 21:19:55.519510 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.519480    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/0.log"
Sep 10 21:19:55.519868 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.519528    2568 generic.go:356] "Generic (PLEG): container finished" podID="05a25009-e9db-4042-ba43-54abf4fcc40b" containerID="2f17a24e81a1141bb40335aad2c103f903bf13a9e432d87ba6bfef38c25d7338" exitCode=255
Sep 10 21:19:55.519868 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.519621    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-vcswn" event={"ID":"05a25009-e9db-4042-ba43-54abf4fcc40b","Type":"ContainerDied","Data":"2f17a24e81a1141bb40335aad2c103f903bf13a9e432d87ba6bfef38c25d7338"}
Sep 10 21:19:55.520312 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.519992    2568 scope.go:117] "RemoveContainer" containerID="2f17a24e81a1141bb40335aad2c103f903bf13a9e432d87ba6bfef38c25d7338"
Sep 10 21:19:55.522578 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.522550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rg85p" event={"ID":"8d78005f-ee4e-4f99-9c0f-3250fe9eebd7","Type":"ContainerStarted","Data":"5e1ea842ba7dfbdf373692d1e84e037df745b279951cc11edd907d96e617797e"}
Sep 10 21:19:55.525189 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.525165    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-nqftg" event={"ID":"2a0dbe00-190a-4b21-99af-523e61a90da6","Type":"ContainerStarted","Data":"dc8b403d2a27f4c869dd4decb0e192d789a691a54bbe3b3dd419472a0b9b7b36"}
Sep 10 21:19:55.536780 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.535652    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx" event={"ID":"e81cef71-792e-40cd-ae39-887ffd2bf1ea","Type":"ContainerStarted","Data":"e48ebab5a18256a6be06db6893627f5f103c0daf6390c8583a11b1ce8a9e6cbb"}
Sep 10 21:19:55.545144 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.544591    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm2sf" event={"ID":"c33420a8-f603-42f3-a341-909e91b104e0","Type":"ContainerStarted","Data":"4173af00fe78f759bce4cee4f95bced2c2d2d3d30304c8b52bf627c0ec8e6961"}
Sep 10 21:19:55.548074 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.547714    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-xgsm5" event={"ID":"71c1b5d7-25bb-4890-ac13-247f2d355006","Type":"ContainerStarted","Data":"d353dafa07bf3e378633543ba35069dc19947bfb9da01f2d887d8e10f331ab1b"}
Sep 10 21:19:55.550188 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.549783    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-bdtx2" event={"ID":"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3","Type":"ContainerStarted","Data":"69ac1e37686d4a4ad4ec6c31ad93603aafc3ee2add2539122564f951cbb37f47"}
Sep 10 21:19:55.555763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.555331    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx" podStartSLOduration=23.741650651 podStartE2EDuration="33.555314705s" totalImagesPullingTime="9.813664054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:55.553985515 +0000 UTC m=+45.756316088" watchObservedRunningTime="2026-09-10 21:19:55.555314705 +0000 UTC m=+45.757645277"
Sep 10 21:19:55.557595 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.557528    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c" event={"ID":"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a","Type":"ContainerStarted","Data":"8916041a7b7c4933997dce1d423635126ac4f29e64ba15e4dcb8df018a0b68f0"}
Sep 10 21:19:55.575608 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.574394    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rg85p" podStartSLOduration=1.845778042 podStartE2EDuration="11.574375892s" totalImagesPullingTime="9.72859785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:55.573722311 +0000 UTC m=+45.776052885" watchObservedRunningTime="2026-09-10 21:19:55.574375892 +0000 UTC m=+45.776706465"
Sep 10 21:19:55.624066 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.622699    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-nqftg" podStartSLOduration=23.891002426 podStartE2EDuration="33.622678265s" totalImagesPullingTime="9.731675839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:55.592929439 +0000 UTC m=+45.795260012" watchObservedRunningTime="2026-09-10 21:19:55.622678265 +0000 UTC m=+45.825008838"
Sep 10 21:19:55.659285 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.658806    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-bdtx2" podStartSLOduration=23.801534669 podStartE2EDuration="33.658785677s" totalImagesPullingTime="9.857251008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:55.640995387 +0000 UTC m=+45.843325960" watchObservedRunningTime="2026-09-10 21:19:55.658785677 +0000 UTC m=+45.861116250"
Sep 10 21:19:55.659693 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:55.659496    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c" podStartSLOduration=23.779244916 podStartE2EDuration="33.659480554s" totalImagesPullingTime="9.880235638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:55.657570964 +0000 UTC m=+45.859901538" watchObservedRunningTime="2026-09-10 21:19:55.659480554 +0000 UTC m=+45.861811127"
Sep 10 21:19:56.568059 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:56.568028    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:19:56.568484 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:56.568465    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/0.log"
Sep 10 21:19:56.568538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:56.568508    2568 generic.go:356] "Generic (PLEG): container finished" podID="05a25009-e9db-4042-ba43-54abf4fcc40b" containerID="042e47b09c30d322a46c40790029e716de2666b079fc6667d7248b80cdbc77a9" exitCode=255
Sep 10 21:19:56.568613 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:56.568590    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-vcswn" event={"ID":"05a25009-e9db-4042-ba43-54abf4fcc40b","Type":"ContainerDied","Data":"042e47b09c30d322a46c40790029e716de2666b079fc6667d7248b80cdbc77a9"}
Sep 10 21:19:56.568706 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:56.568690    2568 scope.go:117] "RemoveContainer" containerID="2f17a24e81a1141bb40335aad2c103f903bf13a9e432d87ba6bfef38c25d7338"
Sep 10 21:19:56.568951 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:56.568929    2568 scope.go:117] "RemoveContainer" containerID="042e47b09c30d322a46c40790029e716de2666b079fc6667d7248b80cdbc77a9"
Sep 10 21:19:56.569152 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:56.569127    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-vcswn_openshift-console-operator(05a25009-e9db-4042-ba43-54abf4fcc40b)\"" pod="openshift-console-operator/console-operator-696884fb9c-vcswn" podUID="05a25009-e9db-4042-ba43-54abf4fcc40b"
Sep 10 21:19:56.571978 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:56.571955    2568 generic.go:356] "Generic (PLEG): container finished" podID="c33420a8-f603-42f3-a341-909e91b104e0" containerID="4173af00fe78f759bce4cee4f95bced2c2d2d3d30304c8b52bf627c0ec8e6961" exitCode=0
Sep 10 21:19:56.572105 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:56.572036    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm2sf" event={"ID":"c33420a8-f603-42f3-a341-909e91b104e0","Type":"ContainerDied","Data":"4173af00fe78f759bce4cee4f95bced2c2d2d3d30304c8b52bf627c0ec8e6961"}
Sep 10 21:19:56.585413 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:56.585371    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-xgsm5" podStartSLOduration=24.785394703 podStartE2EDuration="34.585358324s" totalImagesPullingTime="9.799963621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:55.675242868 +0000 UTC m=+45.877573438" watchObservedRunningTime="2026-09-10 21:19:56.585358324 +0000 UTC m=+46.787688955"
Sep 10 21:19:57.082154 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.082124    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6jv9q"]
Sep 10 21:19:57.106538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.106514    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jv9q"]
Sep 10 21:19:57.106661 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.106611    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.108731 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.108711    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 21:19:57.109022 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.109005    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jf9vp\""
Sep 10 21:19:57.109088 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.109053    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 21:19:57.121840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.121814    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.121950 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.121900    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86e5182d-a251-4c66-9ecd-21f4a037f376-crio-socket\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.122010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.121964    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.122010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.122004    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86e5182d-a251-4c66-9ecd-21f4a037f376-data-volume\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.122166 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.122030    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cfvp\" (UniqueName: \"kubernetes.io/projected/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-api-access-7cfvp\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.222667 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.222640    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.222773 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.222697    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86e5182d-a251-4c66-9ecd-21f4a037f376-data-volume\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.222773 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:57.222712    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 21:19:57.222773 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.222723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cfvp\" (UniqueName: \"kubernetes.io/projected/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-api-access-7cfvp\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.222924 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:57.222776    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm podName:86e5182d-a251-4c66-9ecd-21f4a037f376 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:57.722757092 +0000 UTC m=+47.925087659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jv9q" (UID: "86e5182d-a251-4c66-9ecd-21f4a037f376") : configmap "kube-rbac-proxy" not found
Sep 10 21:19:57.222986 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.222917    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.223047 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.222992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86e5182d-a251-4c66-9ecd-21f4a037f376-crio-socket\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.223047 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.223029    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86e5182d-a251-4c66-9ecd-21f4a037f376-data-volume\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.223128 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.223052    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86e5182d-a251-4c66-9ecd-21f4a037f376-crio-socket\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.223128 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:57.223058    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 21:19:57.223128 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:57.223118    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls podName:86e5182d-a251-4c66-9ecd-21f4a037f376 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:57.723101113 +0000 UTC m=+47.925431674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jv9q" (UID: "86e5182d-a251-4c66-9ecd-21f4a037f376") : secret "insights-runtime-extractor-tls" not found
Sep 10 21:19:57.231679 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.231651    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cfvp\" (UniqueName: \"kubernetes.io/projected/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-api-access-7cfvp\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.577158 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.577132    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:19:57.577549 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.577442    2568 scope.go:117] "RemoveContainer" containerID="042e47b09c30d322a46c40790029e716de2666b079fc6667d7248b80cdbc77a9"
Sep 10 21:19:57.577606 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:57.577588    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-vcswn_openshift-console-operator(05a25009-e9db-4042-ba43-54abf4fcc40b)\"" pod="openshift-console-operator/console-operator-696884fb9c-vcswn" podUID="05a25009-e9db-4042-ba43-54abf4fcc40b"
Sep 10 21:19:57.580284 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.580257    2568 generic.go:356] "Generic (PLEG): container finished" podID="c33420a8-f603-42f3-a341-909e91b104e0" containerID="82bd59d748f8d38b1a22220810bd46cbfb30ffdbed7d849598e41481d1e47037" exitCode=0
Sep 10 21:19:57.580418 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.580290    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm2sf" event={"ID":"c33420a8-f603-42f3-a341-909e91b104e0","Type":"ContainerDied","Data":"82bd59d748f8d38b1a22220810bd46cbfb30ffdbed7d849598e41481d1e47037"}
Sep 10 21:19:57.727913 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.727891    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.728016 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:57.727990    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 21:19:57.728016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:57.728003    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:57.728101 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:57.728045    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm podName:86e5182d-a251-4c66-9ecd-21f4a037f376 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:58.72803181 +0000 UTC m=+48.930362360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jv9q" (UID: "86e5182d-a251-4c66-9ecd-21f4a037f376") : configmap "kube-rbac-proxy" not found
Sep 10 21:19:57.728101 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:57.728089    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 21:19:57.728227 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:57.728134    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls podName:86e5182d-a251-4c66-9ecd-21f4a037f376 nodeName:}" failed. No retries permitted until 2026-09-10 21:19:58.728123775 +0000 UTC m=+48.930454324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jv9q" (UID: "86e5182d-a251-4c66-9ecd-21f4a037f376") : secret "insights-runtime-extractor-tls" not found
Sep 10 21:19:58.443009 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:58.442982    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-glgcs_dd2deb30-60af-4074-b910-bd87cebdf4bb/dns-node-resolver/0.log"
Sep 10 21:19:58.587602 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:58.587560    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dm2sf" event={"ID":"c33420a8-f603-42f3-a341-909e91b104e0","Type":"ContainerStarted","Data":"b8fcc149bbc41dccbc30a37e0ba944582badbff880b59f93b1147994c04d3a5d"}
Sep 10 21:19:58.617006 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:58.616932    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dm2sf" podStartSLOduration=8.867741019 podStartE2EDuration="47.616916856s" totalImagesPullingTime="38.749175837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:58.614952081 +0000 UTC m=+48.817282653" watchObservedRunningTime="2026-09-10 21:19:58.616916856 +0000 UTC m=+48.819247428"
Sep 10 21:19:58.735783 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:58.735720    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:58.735783 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:58.735775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:19:58.735947 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:58.735836    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 21:19:58.735947 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:58.735851    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 21:19:58.735947 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:58.735877    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm podName:86e5182d-a251-4c66-9ecd-21f4a037f376 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:00.735865311 +0000 UTC m=+50.938195873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jv9q" (UID: "86e5182d-a251-4c66-9ecd-21f4a037f376") : configmap "kube-rbac-proxy" not found
Sep 10 21:19:58.735947 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:19:58.735896    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls podName:86e5182d-a251-4c66-9ecd-21f4a037f376 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:00.735885081 +0000 UTC m=+50.938215633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jv9q" (UID: "86e5182d-a251-4c66-9ecd-21f4a037f376") : secret "insights-runtime-extractor-tls" not found
Sep 10 21:19:59.841274 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:19:59.841245    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zgtsv_5cd516c0-6d5a-40e1-8ec1-5b00366a50ab/node-ca/0.log"
Sep 10 21:20:00.440221 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:00.440171    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rg85p_8d78005f-ee4e-4f99-9c0f-3250fe9eebd7/serve-healthcheck-canary/0.log"
Sep 10 21:20:00.551299 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:00.551268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:20:00.551455 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:00.551342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:20:00.551455 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.551421    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 21:20:00.551455 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.551437    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 21:20:00.551455 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.551454    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9fc8977fb-phrdh: secret "image-registry-tls" not found
Sep 10 21:20:00.551653 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.551504    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls podName:81d45025-d223-4c98-8cb7-8862526a046d nodeName:}" failed. No retries permitted until 2026-09-10 21:20:16.551473153 +0000 UTC m=+66.753803705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-wf8wk" (UID: "81d45025-d223-4c98-8cb7-8862526a046d") : secret "cluster-monitoring-operator-tls" not found
Sep 10 21:20:00.551653 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.551524    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls podName:6d6729db-ccf2-48d4-a5d6-201937367057 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:16.551514099 +0000 UTC m=+66.753844650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls") pod "image-registry-9fc8977fb-phrdh" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057") : secret "image-registry-tls" not found
Sep 10 21:20:00.652370 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:00.652343    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:20:00.652505 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:00.652380    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:20:00.652505 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:00.652454    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:20:00.652505 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.652474    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 21:20:00.652505 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:00.652484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:20:00.652666 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.652523    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls podName:cca846cb-713a-479b-ac8f-47133f900f05 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:16.652506474 +0000 UTC m=+66.854837024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls") pod "dns-default-45m6w" (UID: "cca846cb-713a-479b-ac8f-47133f900f05") : secret "dns-default-metrics-tls" not found
Sep 10 21:20:00.652666 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.652542    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 21:20:00.652666 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.652571    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 21:20:00.652666 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.652576    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:16.652563378 +0000 UTC m=+66.854893964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : configmap references non-existent config key: service-ca.crt
Sep 10 21:20:00.652666 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.652602    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs podName:ed1605d8-d145-4cc4-8172-d6b03ffa2058 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:16.652594836 +0000 UTC m=+66.854925386 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs") pod "router-default-79cd7487cd-68dhk" (UID: "ed1605d8-d145-4cc4-8172-d6b03ffa2058") : secret "router-metrics-certs-default" not found
Sep 10 21:20:00.652666 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.652614    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls podName:42edae3f-5ced-4adb-980a-0e52280f3c28 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:16.652607852 +0000 UTC m=+66.854938402 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-xnkbp" (UID: "42edae3f-5ced-4adb-980a-0e52280f3c28") : secret "samples-operator-tls" not found
Sep 10 21:20:00.753233 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:00.753168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:20:00.753322 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:00.753271    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:20:00.753322 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.753291    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 21:20:00.753393 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.753331    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls podName:86e5182d-a251-4c66-9ecd-21f4a037f376 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:04.753320978 +0000 UTC m=+54.955651559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jv9q" (UID: "86e5182d-a251-4c66-9ecd-21f4a037f376") : secret "insights-runtime-extractor-tls" not found
Sep 10 21:20:00.753393 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.753367    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 21:20:00.753464 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:00.753404    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm podName:86e5182d-a251-4c66-9ecd-21f4a037f376 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:04.753394757 +0000 UTC m=+54.955725341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6jv9q" (UID: "86e5182d-a251-4c66-9ecd-21f4a037f376") : configmap "kube-rbac-proxy" not found
Sep 10 21:20:02.266340 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:02.266299    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:20:02.266807 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:02.266435    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 21:20:02.266807 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:02.266504    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert podName:c20f577d-54db-4161-be6c-d730b05dfb35 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:18.266489437 +0000 UTC m=+68.468819987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-vj9kb" (UID: "c20f577d-54db-4161-be6c-d730b05dfb35") : secret "networking-console-plugin-cert" not found
Sep 10 21:20:04.788148 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:04.788116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:20:04.788630 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:04.788293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:20:04.788630 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:04.788408    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 21:20:04.788630 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:04.788458    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls podName:86e5182d-a251-4c66-9ecd-21f4a037f376 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:12.788445543 +0000 UTC m=+62.990776098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jv9q" (UID: "86e5182d-a251-4c66-9ecd-21f4a037f376") : secret "insights-runtime-extractor-tls" not found
Sep 10 21:20:04.788737 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:04.788664    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e5182d-a251-4c66-9ecd-21f4a037f376-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:20:05.118005 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:05.117968    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:20:05.118189 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:05.118022    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:20:05.118395 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:05.118382    2568 scope.go:117] "RemoveContainer" containerID="042e47b09c30d322a46c40790029e716de2666b079fc6667d7248b80cdbc77a9"
Sep 10 21:20:05.118555 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:05.118535    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-vcswn_openshift-console-operator(05a25009-e9db-4042-ba43-54abf4fcc40b)\"" pod="openshift-console-operator/console-operator-696884fb9c-vcswn" podUID="05a25009-e9db-4042-ba43-54abf4fcc40b"
Sep 10 21:20:11.483638 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:11.483606    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6m8qb"
Sep 10 21:20:12.856335 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:12.856289    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:20:12.858695 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:12.858670    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e5182d-a251-4c66-9ecd-21f4a037f376-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jv9q\" (UID: \"86e5182d-a251-4c66-9ecd-21f4a037f376\") " pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:20:13.017897 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:13.017875    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jf9vp\""
Sep 10 21:20:13.026114 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:13.026095    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jv9q"
Sep 10 21:20:13.293765 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:13.293691    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jv9q"]
Sep 10 21:20:13.296924 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:13.296900    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e5182d_a251_4c66_9ecd_21f4a037f376.slice/crio-52f4ace93fa9cf0b29f114a53600f5223c8505319701524446f5afc4539d17cc WatchSource:0}: Error finding container 52f4ace93fa9cf0b29f114a53600f5223c8505319701524446f5afc4539d17cc: Status 404 returned error can't find the container with id 52f4ace93fa9cf0b29f114a53600f5223c8505319701524446f5afc4539d17cc
Sep 10 21:20:13.633267 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:13.633231    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jv9q" event={"ID":"86e5182d-a251-4c66-9ecd-21f4a037f376","Type":"ContainerStarted","Data":"c2c5446eaa9fe62d335b3593e429373a223b8272aacafcf8c20c1e99eda23c06"}
Sep 10 21:20:13.633405 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:13.633294    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jv9q" event={"ID":"86e5182d-a251-4c66-9ecd-21f4a037f376","Type":"ContainerStarted","Data":"52f4ace93fa9cf0b29f114a53600f5223c8505319701524446f5afc4539d17cc"}
Sep 10 21:20:14.637939 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:14.637909    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jv9q" event={"ID":"86e5182d-a251-4c66-9ecd-21f4a037f376","Type":"ContainerStarted","Data":"7b780e7d03f6c5986585362d8ae38f0633aa9084e4fc681c873229cc0c0e7db5"}
Sep 10 21:20:15.642408 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:15.642376    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jv9q" event={"ID":"86e5182d-a251-4c66-9ecd-21f4a037f376","Type":"ContainerStarted","Data":"9a41d726157f6585f2d89cd21f6353212bea2faac8787286c0c07c7a98aaee47"}
Sep 10 21:20:15.665864 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:15.665820    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6jv9q" podStartSLOduration=16.512211661 podStartE2EDuration="18.665805565s" totalImagesPullingTime="2.153593904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:15.665093613 +0000 UTC m=+65.867424187" watchObservedRunningTime="2026-09-10 21:20:15.665805565 +0000 UTC m=+65.868136136"
Sep 10 21:20:15.983510 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:15.983432    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:20:15.983510 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:15.983490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:20:15.985880 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:15.985864    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 21:20:15.985936 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:15.985865    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 21:20:15.995736 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:15.995718    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/810abf45-98cd-4b31-99d7-55b358f4183a-metrics-certs\") pod \"network-metrics-daemon-jx9c8\" (UID: \"810abf45-98cd-4b31-99d7-55b358f4183a\") " pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:20:15.995826 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:15.995807    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32820bf3-c33a-4610-b8ba-4e97526b5bd2-original-pull-secret\") pod \"global-pull-secret-syncer-kthqx\" (UID: \"32820bf3-c33a-4610-b8ba-4e97526b5bd2\") " pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:20:16.084193 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.084156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqc5\" (UniqueName: \"kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5\") pod \"network-check-target-r27tz\" (UID: \"b0deb471-f73a-4e0d-9eb5-49527f70f628\") " pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:20:16.086393 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.086365    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpqc5\" (UniqueName: \"kubernetes.io/projected/b0deb471-f73a-4e0d-9eb5-49527f70f628-kube-api-access-gpqc5\") pod \"network-check-target-r27tz\" (UID: \"b0deb471-f73a-4e0d-9eb5-49527f70f628\") " pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:20:16.116158 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.116135    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kc896\""
Sep 10 21:20:16.124139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.124121    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:20:16.128486 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.128471    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kthqx"
Sep 10 21:20:16.143721 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.143701    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c8fbc\""
Sep 10 21:20:16.151655 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.151632    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jx9c8"
Sep 10 21:20:16.395518 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.395488    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r27tz"]
Sep 10 21:20:16.398454 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:16.398431    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0deb471_f73a_4e0d_9eb5_49527f70f628.slice/crio-8e29b56c10646be7f83a3dd7ce174832f0b6c9ea5a684c1b72ca8b8f409e1601 WatchSource:0}: Error finding container 8e29b56c10646be7f83a3dd7ce174832f0b6c9ea5a684c1b72ca8b8f409e1601: Status 404 returned error can't find the container with id 8e29b56c10646be7f83a3dd7ce174832f0b6c9ea5a684c1b72ca8b8f409e1601
Sep 10 21:20:16.405776 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.405750    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kthqx"]
Sep 10 21:20:16.408918 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:16.408900    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32820bf3_c33a_4610_b8ba_4e97526b5bd2.slice/crio-eb3bfbd58f07a8f286239577c7824ca06908ff215ca58c6089b93a75705dfd68 WatchSource:0}: Error finding container eb3bfbd58f07a8f286239577c7824ca06908ff215ca58c6089b93a75705dfd68: Status 404 returned error can't find the container with id eb3bfbd58f07a8f286239577c7824ca06908ff215ca58c6089b93a75705dfd68
Sep 10 21:20:16.451337 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.451315    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jx9c8"]
Sep 10 21:20:16.454539 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:16.454520    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810abf45_98cd_4b31_99d7_55b358f4183a.slice/crio-ab16d961834dd52beeb0a1dafe81f89bc61e9bcefd07c8825dcba452e66840df WatchSource:0}: Error finding container ab16d961834dd52beeb0a1dafe81f89bc61e9bcefd07c8825dcba452e66840df: Status 404 returned error can't find the container with id ab16d961834dd52beeb0a1dafe81f89bc61e9bcefd07c8825dcba452e66840df
Sep 10 21:20:16.588129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.588100    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:20:16.588272 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.588255    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:20:16.590413 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.590386    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/81d45025-d223-4c98-8cb7-8862526a046d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-wf8wk\" (UID: \"81d45025-d223-4c98-8cb7-8862526a046d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:20:16.590504 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.590468    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls\") pod \"image-registry-9fc8977fb-phrdh\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") " pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:20:16.646651 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.646600    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r27tz" event={"ID":"b0deb471-f73a-4e0d-9eb5-49527f70f628","Type":"ContainerStarted","Data":"9db666ef585e1eaa8e1a89c0efc746c26be038bf32b29010d0a22639eeda19ec"}
Sep 10 21:20:16.646947 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.646666    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r27tz" event={"ID":"b0deb471-f73a-4e0d-9eb5-49527f70f628","Type":"ContainerStarted","Data":"8e29b56c10646be7f83a3dd7ce174832f0b6c9ea5a684c1b72ca8b8f409e1601"}
Sep 10 21:20:16.646947 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.646717    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:20:16.647874 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.647848    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jx9c8" event={"ID":"810abf45-98cd-4b31-99d7-55b358f4183a","Type":"ContainerStarted","Data":"ab16d961834dd52beeb0a1dafe81f89bc61e9bcefd07c8825dcba452e66840df"}
Sep 10 21:20:16.648848 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.648826    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kthqx" event={"ID":"32820bf3-c33a-4610-b8ba-4e97526b5bd2","Type":"ContainerStarted","Data":"eb3bfbd58f07a8f286239577c7824ca06908ff215ca58c6089b93a75705dfd68"}
Sep 10 21:20:16.661893 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.661857    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r27tz" podStartSLOduration=65.661843316 podStartE2EDuration="1m5.661843316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:16.661326568 +0000 UTC m=+66.863657140" watchObservedRunningTime="2026-09-10 21:20:16.661843316 +0000 UTC m=+66.864173895"
Sep 10 21:20:16.688930 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.688885    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:20:16.689019 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.688949    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:20:16.689019 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.688969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:20:16.689019 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.689012    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:20:16.689653 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.689604    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1605d8-d145-4cc4-8172-d6b03ffa2058-service-ca-bundle\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:20:16.691140 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.691122    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca846cb-713a-479b-ac8f-47133f900f05-metrics-tls\") pod \"dns-default-45m6w\" (UID: \"cca846cb-713a-479b-ac8f-47133f900f05\") " pod="openshift-dns/dns-default-45m6w"
Sep 10 21:20:16.691337 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.691319    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/42edae3f-5ced-4adb-980a-0e52280f3c28-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-xnkbp\" (UID: \"42edae3f-5ced-4adb-980a-0e52280f3c28\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:20:16.691389 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.691370    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed1605d8-d145-4cc4-8172-d6b03ffa2058-metrics-certs\") pod \"router-default-79cd7487cd-68dhk\" (UID: \"ed1605d8-d145-4cc4-8172-d6b03ffa2058\") " pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:20:16.799069 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.799045    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mvsp2\""
Sep 10 21:20:16.806932 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.806906    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:20:16.821027 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.821008    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g2fsp\""
Sep 10 21:20:16.828806 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.828787    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"
Sep 10 21:20:16.849282 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.849264    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-srzpj\""
Sep 10 21:20:16.858340 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.857687    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:20:16.887472 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.887282    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f6g5g\""
Sep 10 21:20:16.895708 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.895498    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-45m6w"
Sep 10 21:20:16.902374 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.902352    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4lt82\""
Sep 10 21:20:16.910508 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:16.910467    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"
Sep 10 21:20:17.084980 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.084942    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9fc8977fb-phrdh"]
Sep 10 21:20:17.088124 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:17.088095    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6729db_ccf2_48d4_a5d6_201937367057.slice/crio-82a8cddd83e954eea182f371d493c7b58f28e129d92bf70a8daab96f41a9b672 WatchSource:0}: Error finding container 82a8cddd83e954eea182f371d493c7b58f28e129d92bf70a8daab96f41a9b672: Status 404 returned error can't find the container with id 82a8cddd83e954eea182f371d493c7b58f28e129d92bf70a8daab96f41a9b672
Sep 10 21:20:17.112382 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.112346    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk"]
Sep 10 21:20:17.119649 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:17.119620    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d45025_d223_4c98_8cb7_8862526a046d.slice/crio-15c93f3e73370011e1465b17fb70aa256756f072a6b4c4db9aea05c2359771b9 WatchSource:0}: Error finding container 15c93f3e73370011e1465b17fb70aa256756f072a6b4c4db9aea05c2359771b9: Status 404 returned error can't find the container with id 15c93f3e73370011e1465b17fb70aa256756f072a6b4c4db9aea05c2359771b9
Sep 10 21:20:17.147079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.147049    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79cd7487cd-68dhk"]
Sep 10 21:20:17.151080 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:17.151054    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1605d8_d145_4cc4_8172_d6b03ffa2058.slice/crio-d859cd7da226c2e750d7462af9cd2afe21407b87a7dfc097f1012a65a2d3a111 WatchSource:0}: Error finding container d859cd7da226c2e750d7462af9cd2afe21407b87a7dfc097f1012a65a2d3a111: Status 404 returned error can't find the container with id d859cd7da226c2e750d7462af9cd2afe21407b87a7dfc097f1012a65a2d3a111
Sep 10 21:20:17.177970 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.177872    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-45m6w"]
Sep 10 21:20:17.185266 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:17.185179    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca846cb_713a_479b_ac8f_47133f900f05.slice/crio-6fb5b19f25ad673f061495410612e07d21aa454e311d0366e23340dc383f0679 WatchSource:0}: Error finding container 6fb5b19f25ad673f061495410612e07d21aa454e311d0366e23340dc383f0679: Status 404 returned error can't find the container with id 6fb5b19f25ad673f061495410612e07d21aa454e311d0366e23340dc383f0679
Sep 10 21:20:17.202319 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.202261    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp"]
Sep 10 21:20:17.655254 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.655217    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp" event={"ID":"42edae3f-5ced-4adb-980a-0e52280f3c28","Type":"ContainerStarted","Data":"fc281b8606fcb97aefa52c757a90f9ffaf73442bff012c38ac5ecfa4df618f6e"}
Sep 10 21:20:17.657161 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.656995    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh" event={"ID":"6d6729db-ccf2-48d4-a5d6-201937367057","Type":"ContainerStarted","Data":"69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480"}
Sep 10 21:20:17.657161 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.657040    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh" event={"ID":"6d6729db-ccf2-48d4-a5d6-201937367057","Type":"ContainerStarted","Data":"82a8cddd83e954eea182f371d493c7b58f28e129d92bf70a8daab96f41a9b672"}
Sep 10 21:20:17.657394 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.657345    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:20:17.660000 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.659911    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79cd7487cd-68dhk" event={"ID":"ed1605d8-d145-4cc4-8172-d6b03ffa2058","Type":"ContainerStarted","Data":"c09071475236c8a27d5b8eef73228d34767a8f935f441ad5427109fba1409853"}
Sep 10 21:20:17.660000 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.659955    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79cd7487cd-68dhk" event={"ID":"ed1605d8-d145-4cc4-8172-d6b03ffa2058","Type":"ContainerStarted","Data":"d859cd7da226c2e750d7462af9cd2afe21407b87a7dfc097f1012a65a2d3a111"}
Sep 10 21:20:17.661566 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.661537    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk" event={"ID":"81d45025-d223-4c98-8cb7-8862526a046d","Type":"ContainerStarted","Data":"15c93f3e73370011e1465b17fb70aa256756f072a6b4c4db9aea05c2359771b9"}
Sep 10 21:20:17.663301 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.663264    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45m6w" event={"ID":"cca846cb-713a-479b-ac8f-47133f900f05","Type":"ContainerStarted","Data":"6fb5b19f25ad673f061495410612e07d21aa454e311d0366e23340dc383f0679"}
Sep 10 21:20:17.677793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.677260    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh" podStartSLOduration=66.677240816 podStartE2EDuration="1m6.677240816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:17.675850136 +0000 UTC m=+67.878180708" watchObservedRunningTime="2026-09-10 21:20:17.677240816 +0000 UTC m=+67.879571389"
Sep 10 21:20:17.696455 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.696409    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79cd7487cd-68dhk" podStartSLOduration=55.696390598 podStartE2EDuration="55.696390598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:17.695326737 +0000 UTC m=+67.897657310" watchObservedRunningTime="2026-09-10 21:20:17.696390598 +0000 UTC m=+67.898721170"
Sep 10 21:20:17.858738 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.858708    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:20:17.863599 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:17.863399    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:20:18.302694 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:18.302554    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:20:18.310690 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:18.310660    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c20f577d-54db-4161-be6c-d730b05dfb35-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-vj9kb\" (UID: \"c20f577d-54db-4161-be6c-d730b05dfb35\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:20:18.477172 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:18.477142    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dwpsz\""
Sep 10 21:20:18.485818 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:18.485617    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"
Sep 10 21:20:18.672475 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:18.672330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jx9c8" event={"ID":"810abf45-98cd-4b31-99d7-55b358f4183a","Type":"ContainerStarted","Data":"3f7a1b0018862e69d6f7a34df05a100280e7d4430bbb42d753b45b4c6e0e391f"}
Sep 10 21:20:18.672475 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:18.672396    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jx9c8" event={"ID":"810abf45-98cd-4b31-99d7-55b358f4183a","Type":"ContainerStarted","Data":"306d222dab66da0fcf296389f2bde1428264e392849e3b44f0aa3f00f2d6c5ba"}
Sep 10 21:20:18.672475 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:18.672428    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:20:18.674239 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:18.674174    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79cd7487cd-68dhk"
Sep 10 21:20:18.719476 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:18.719110    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jx9c8" podStartSLOduration=66.562060022 podStartE2EDuration="1m7.71908904s" totalImagesPullingTime="1.157029018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:18.718422895 +0000 UTC m=+68.920753466" watchObservedRunningTime="2026-09-10 21:20:18.71908904 +0000 UTC m=+68.921419614"
Sep 10 21:20:18.794507 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:18.794478    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb"]
Sep 10 21:20:19.189964 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:19.189935    2568 scope.go:117] "RemoveContainer" containerID="042e47b09c30d322a46c40790029e716de2666b079fc6667d7248b80cdbc77a9"
Sep 10 21:20:19.747029 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:19.746998    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20f577d_54db_4161_be6c_d730b05dfb35.slice/crio-fe32f6a01046a022a59911334b1a968c5bf762034dd8f4d244e7700248e8f5dd WatchSource:0}: Error finding container fe32f6a01046a022a59911334b1a968c5bf762034dd8f4d244e7700248e8f5dd: Status 404 returned error can't find the container with id fe32f6a01046a022a59911334b1a968c5bf762034dd8f4d244e7700248e8f5dd
Sep 10 21:20:20.681085 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:20.681049    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb" event={"ID":"c20f577d-54db-4161-be6c-d730b05dfb35","Type":"ContainerStarted","Data":"fe32f6a01046a022a59911334b1a968c5bf762034dd8f4d244e7700248e8f5dd"}
Sep 10 21:20:22.691028 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.690989    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kthqx" event={"ID":"32820bf3-c33a-4610-b8ba-4e97526b5bd2","Type":"ContainerStarted","Data":"f11cc8b18eb2008c607f237678d04d043f60350efbe2f0f0ce9231b7ba8b0370"}
Sep 10 21:20:22.692867 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.692839    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45m6w" event={"ID":"cca846cb-713a-479b-ac8f-47133f900f05","Type":"ContainerStarted","Data":"cd62826e0c50e565a0ab3f472027e8570ff5ba1de32b1f140d87db827873a26a"}
Sep 10 21:20:22.692998 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.692886    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45m6w" event={"ID":"cca846cb-713a-479b-ac8f-47133f900f05","Type":"ContainerStarted","Data":"860ee19cf320c4e3308ba9aaef3f5bd9203316cdf3b575acc114fabd99288dc8"}
Sep 10 21:20:22.692998 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.692913    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-45m6w"
Sep 10 21:20:22.694803 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.694776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp" event={"ID":"42edae3f-5ced-4adb-980a-0e52280f3c28","Type":"ContainerStarted","Data":"09ec43df303ea389550e221dce67d9e4a5fa44b0cc5247d350b0aa93d5867a52"}
Sep 10 21:20:22.694908 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.694829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp" event={"ID":"42edae3f-5ced-4adb-980a-0e52280f3c28","Type":"ContainerStarted","Data":"9b3fd66c425e518fc80bd72523748c36e072fd0d91a0123ee83243f786897a86"}
Sep 10 21:20:22.696695 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.696675    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:20:22.696789 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.696772    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-vcswn" event={"ID":"05a25009-e9db-4042-ba43-54abf4fcc40b","Type":"ContainerStarted","Data":"93a2cd585fdfbf376db93d54f5cfa18257743e49773e12afe0669b0df3032042"}
Sep 10 21:20:22.697108 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.697058    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:20:22.698659 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.698635    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb" event={"ID":"c20f577d-54db-4161-be6c-d730b05dfb35","Type":"ContainerStarted","Data":"2b31f0d6911d1e680d852d3ae0bdf2651f6c3b08332cea55cb64bae7196adef9"}
Sep 10 21:20:22.700317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.700293    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk" event={"ID":"81d45025-d223-4c98-8cb7-8862526a046d","Type":"ContainerStarted","Data":"0a6a5c0db73091924fc5bb08ce9ddc1ded0307244024e74bf836d9516cd8bc09"}
Sep 10 21:20:22.703030 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.703013    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-vcswn"
Sep 10 21:20:22.706604 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.706568    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kthqx" podStartSLOduration=66.144424097 podStartE2EDuration="1m11.706555894s" totalImagesPullingTime="5.562131797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:22.705718763 +0000 UTC m=+72.908049337" watchObservedRunningTime="2026-09-10 21:20:22.706555894 +0000 UTC m=+72.908886456"
Sep 10 21:20:22.722103 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.721968    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-vj9kb" podStartSLOduration=34.442867604 podStartE2EDuration="36.721951881s" totalImagesPullingTime="2.279084277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:22.721531696 +0000 UTC m=+72.923862278" watchObservedRunningTime="2026-09-10 21:20:22.721951881 +0000 UTC m=+72.924282455"
Sep 10 21:20:22.743623 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.743584    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-45m6w" podStartSLOduration=33.961718714 podStartE2EDuration="38.743572255s" totalImagesPullingTime="4.781853541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:22.742931476 +0000 UTC m=+72.945262048" watchObservedRunningTime="2026-09-10 21:20:22.743572255 +0000 UTC m=+72.945902848"
Sep 10 21:20:22.764436 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.764398    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-xnkbp" podStartSLOduration=56.026462626 podStartE2EDuration="1m0.76438543s" totalImagesPullingTime="4.737922804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:22.763921379 +0000 UTC m=+72.966251954" watchObservedRunningTime="2026-09-10 21:20:22.76438543 +0000 UTC m=+72.966716002"
Sep 10 21:20:22.788620 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.788581    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-wf8wk" podStartSLOduration=55.938402246 podStartE2EDuration="1m0.78856393s" totalImagesPullingTime="4.850161684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:22.787673727 +0000 UTC m=+72.990004299" watchObservedRunningTime="2026-09-10 21:20:22.78856393 +0000 UTC m=+72.990894502"
Sep 10 21:20:22.807346 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:22.807305    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-vcswn" podStartSLOduration=51.047484417 podStartE2EDuration="1m0.807292486s" totalImagesPullingTime="9.759808069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:22.806639844 +0000 UTC m=+73.008970421" watchObservedRunningTime="2026-09-10 21:20:22.807292486 +0000 UTC m=+73.009623117"
Sep 10 21:20:32.707275 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:32.707245    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-45m6w"
Sep 10 21:20:33.076096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.076068    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"]
Sep 10 21:20:33.078856 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.078839    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.082841 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.082808    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vh5xk\""
Sep 10 21:20:33.082841 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.082814    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 21:20:33.083024 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.082908    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 21:20:33.083024 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.082979    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 21:20:33.092415 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.092392    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"]
Sep 10 21:20:33.139099 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.139076    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bjvgx"]
Sep 10 21:20:33.141275 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.141259    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.143578 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.143561    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 21:20:33.143699 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.143685    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 21:20:33.143998 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.143982    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 21:20:33.144189 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.144177    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zzvmr\""
Sep 10 21:20:33.217971 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.217948    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.218062 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.217979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.218062 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.218005    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqvzp\" (UniqueName: \"kubernetes.io/projected/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-kube-api-access-nqvzp\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.218062 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.218028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.319115 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319089    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.319115 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319116    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16d4de75-ad29-4906-9e1e-58d23af68145-sys\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.319303 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.319303 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319159    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.319303 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319179    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-textfile\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.319303 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319221    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.319303 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:33.319297    2568 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 10 21:20:33.319538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319334    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-tls\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.319538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319353    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvzp\" (UniqueName: \"kubernetes.io/projected/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-kube-api-access-nqvzp\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.319538 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:20:33.319375    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-openshift-state-metrics-tls podName:d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537 nodeName:}" failed. No retries permitted until 2026-09-10 21:20:33.819354147 +0000 UTC m=+84.021684714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-d5wbp" (UID: "d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537") : secret "openshift-state-metrics-tls" not found
Sep 10 21:20:33.319538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319422    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16d4de75-ad29-4906-9e1e-58d23af68145-metrics-client-ca\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.319538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319458    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16d4de75-ad29-4906-9e1e-58d23af68145-root\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.319538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319480    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-wtmp\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.319538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.319880 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319588    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rtfk\" (UniqueName: \"kubernetes.io/projected/16d4de75-ad29-4906-9e1e-58d23af68145-kube-api-access-6rtfk\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.319938 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.319903    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.321821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.321801    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.330414 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.330365    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvzp\" (UniqueName: \"kubernetes.io/projected/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-kube-api-access-nqvzp\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.420576 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420548    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.420692 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-tls\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.420692 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420598    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16d4de75-ad29-4906-9e1e-58d23af68145-metrics-client-ca\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.420692 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16d4de75-ad29-4906-9e1e-58d23af68145-root\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.420692 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420645    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-wtmp\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.420692 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420685    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rtfk\" (UniqueName: \"kubernetes.io/projected/16d4de75-ad29-4906-9e1e-58d23af68145-kube-api-access-6rtfk\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.420946 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420707    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16d4de75-ad29-4906-9e1e-58d23af68145-root\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.420946 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16d4de75-ad29-4906-9e1e-58d23af68145-sys\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.420946 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420788    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16d4de75-ad29-4906-9e1e-58d23af68145-sys\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.420946 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420819    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.420946 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420849    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-wtmp\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.420946 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.420890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-textfile\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.421261 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.421239    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16d4de75-ad29-4906-9e1e-58d23af68145-metrics-client-ca\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.421261 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.421241    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-textfile\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.421361 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.421292    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.422834 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.422815    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-tls\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.422994 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.422977    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16d4de75-ad29-4906-9e1e-58d23af68145-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.429371 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.429351    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rtfk\" (UniqueName: \"kubernetes.io/projected/16d4de75-ad29-4906-9e1e-58d23af68145-kube-api-access-6rtfk\") pod \"node-exporter-bjvgx\" (UID: \"16d4de75-ad29-4906-9e1e-58d23af68145\") " pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.449044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.449012    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjvgx"
Sep 10 21:20:33.459374 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:33.459354    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d4de75_ad29_4906_9e1e_58d23af68145.slice/crio-09d6416579e790a0e845679a927231234e5eb05e09c44bb2cfc9d0e01ef735e8 WatchSource:0}: Error finding container 09d6416579e790a0e845679a927231234e5eb05e09c44bb2cfc9d0e01ef735e8: Status 404 returned error can't find the container with id 09d6416579e790a0e845679a927231234e5eb05e09c44bb2cfc9d0e01ef735e8
Sep 10 21:20:33.739960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.739889    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjvgx" event={"ID":"16d4de75-ad29-4906-9e1e-58d23af68145","Type":"ContainerStarted","Data":"09d6416579e790a0e845679a927231234e5eb05e09c44bb2cfc9d0e01ef735e8"}
Sep 10 21:20:33.823503 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.823478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.825849 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.825827    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-d5wbp\" (UID: \"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:33.988304 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:33.988277    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"
Sep 10 21:20:34.178402 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.178366    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:20:34.181710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.181689    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.185071 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.185045    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 21:20:34.185213 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.185085    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 21:20:34.185384 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.185321    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 21:20:34.185384 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.185361    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 21:20:34.185518 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.185393    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 21:20:34.185518 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.185416    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8ktxl\""
Sep 10 21:20:34.185518 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.185438    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 21:20:34.185664 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.185552    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 21:20:34.185664 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.185606    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 21:20:34.186000 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.185980    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 21:20:34.204140 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.204080    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:20:34.274931 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.274906    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp"]
Sep 10 21:20:34.276753 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:34.276730    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd487c9f8_2c44_4bdb_aa6d_b3abc2f6d537.slice/crio-3bedf421770958a30ca94ce91af3e11fe9c59a55ec9cdc8cd36aa207a4a02e62 WatchSource:0}: Error finding container 3bedf421770958a30ca94ce91af3e11fe9c59a55ec9cdc8cd36aa207a4a02e62: Status 404 returned error can't find the container with id 3bedf421770958a30ca94ce91af3e11fe9c59a55ec9cdc8cd36aa207a4a02e62
Sep 10 21:20:34.330291 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330183    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330291 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330257    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330475 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330360    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330475 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330475 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330444    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj7gn\" (UniqueName: \"kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-kube-api-access-hj7gn\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330552    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-volume\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330637    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-web-config\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330691    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-out\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330715    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.330990 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.330802    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.431484 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.431484 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.431731 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431532    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.431731 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431567    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.431731 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.431731 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj7gn\" (UniqueName: \"kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-kube-api-access-hj7gn\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.431731 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.431731 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.431731 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431703    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-volume\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.432091 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-web-config\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.432091 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431758    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.432091 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431779    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-out\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.432091 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.431800    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.433014 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.432692    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.433014 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.432767    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.433466 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.433442    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.436731 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.436706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-volume\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.436823 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.436749    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.437321 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.436935    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-out\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.437321 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.437266    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.437321 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.437272    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.437538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.437393    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.437538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.437509    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.437726 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.437690    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-web-config\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.438870 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.438842    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.444464 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.444442    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj7gn\" (UniqueName: \"kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-kube-api-access-hj7gn\") pod \"alertmanager-main-0\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.494952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.494925    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:20:34.746500 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.746469    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp" event={"ID":"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537","Type":"ContainerStarted","Data":"c2b37da38f0dc383cf09ee18c1b03eaf6968a0c670436ef1ac86e5c080745f9d"}
Sep 10 21:20:34.746900 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.746577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp" event={"ID":"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537","Type":"ContainerStarted","Data":"b0a80c09eb0ae0afb966d69e50a2fd4c39c7af22e6381e011ba16eb860882dba"}
Sep 10 21:20:34.746900 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.746599    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp" event={"ID":"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537","Type":"ContainerStarted","Data":"3bedf421770958a30ca94ce91af3e11fe9c59a55ec9cdc8cd36aa207a4a02e62"}
Sep 10 21:20:34.748165 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.748143    2568 generic.go:356] "Generic (PLEG): container finished" podID="16d4de75-ad29-4906-9e1e-58d23af68145" containerID="495a8d37bdbd3899c56e1413499ae3c5fe78e94e9f269d0aa1625a73ef952bd5" exitCode=0
Sep 10 21:20:34.748295 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.748181    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjvgx" event={"ID":"16d4de75-ad29-4906-9e1e-58d23af68145","Type":"ContainerDied","Data":"495a8d37bdbd3899c56e1413499ae3c5fe78e94e9f269d0aa1625a73ef952bd5"}
Sep 10 21:20:34.819824 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:34.819798    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:20:34.821696 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:34.821668    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68064131_7159_4d12_ae06_ae4a9b2a1fc7.slice/crio-eb5a6fe1e43fd9e715bb5f43c950f7619e879be3d997e7389b91fa29213b54c1 WatchSource:0}: Error finding container eb5a6fe1e43fd9e715bb5f43c950f7619e879be3d997e7389b91fa29213b54c1: Status 404 returned error can't find the container with id eb5a6fe1e43fd9e715bb5f43c950f7619e879be3d997e7389b91fa29213b54c1
Sep 10 21:20:35.753653 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:35.753621    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerStarted","Data":"eb5a6fe1e43fd9e715bb5f43c950f7619e879be3d997e7389b91fa29213b54c1"}
Sep 10 21:20:35.756186 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:35.756150    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjvgx" event={"ID":"16d4de75-ad29-4906-9e1e-58d23af68145","Type":"ContainerStarted","Data":"f1e2895bf7da15427bf79bd095faa9d60518db0d4884c373f71da788c158839b"}
Sep 10 21:20:35.756327 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:35.756229    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjvgx" event={"ID":"16d4de75-ad29-4906-9e1e-58d23af68145","Type":"ContainerStarted","Data":"5f1f36b341a65bf77854ef4a9114a55f5f088aec2c84ead8b7e6269fdf197203"}
Sep 10 21:20:35.758543 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:35.758505    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp" event={"ID":"d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537","Type":"ContainerStarted","Data":"7a6ec2a9050fc7cb7bbc582b1bf23c4cd9a32df09e2e1a4a109346ccd84c3c24"}
Sep 10 21:20:35.779251 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:35.779171    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bjvgx" podStartSLOduration=1.5934148700000001 podStartE2EDuration="2.779154408s" totalImagesPullingTime="1.125764659s" totalInitContainerRuntime="59.974879ms" isStatefulPod=true podCreationTimestamp="2026-09-10 21:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:35.776471269 +0000 UTC m=+85.978801843" watchObservedRunningTime="2026-09-10 21:20:35.779154408 +0000 UTC m=+85.981484981"
Sep 10 21:20:35.797138 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:35.797097    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-d5wbp" podStartSLOduration=1.776049733 podStartE2EDuration="2.797083003s" totalImagesPullingTime="1.02103327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:35.796016336 +0000 UTC m=+85.998346911" watchObservedRunningTime="2026-09-10 21:20:35.797083003 +0000 UTC m=+85.999413574"
Sep 10 21:20:36.764702 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:36.764616    2568 generic.go:356] "Generic (PLEG): container finished" podID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerID="f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a" exitCode=0
Sep 10 21:20:36.765175 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:36.764709    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerDied","Data":"f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a"}
Sep 10 21:20:37.862422 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.862383    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"]
Sep 10 21:20:37.865272 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.865249    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"
Sep 10 21:20:37.868564 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.868536    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 10 21:20:37.868729 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.868547    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8bjr7\""
Sep 10 21:20:37.877093 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.877069    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"]
Sep 10 21:20:37.899805 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.899781    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f784bb8f7-lrxcn"]
Sep 10 21:20:37.902117 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.902097    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:37.904792 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.904755    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 21:20:37.905149 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.905003    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 21:20:37.905149 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.905003    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9wqqs\""
Sep 10 21:20:37.905149 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.905061    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 21:20:37.905711 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.905691    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 21:20:37.905824 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.905733    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 21:20:37.905824 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.905779    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 21:20:37.906094 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.906065    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 21:20:37.910931 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.910911    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 21:20:37.915665 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.915642    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f784bb8f7-lrxcn"]
Sep 10 21:20:37.962399 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.962375    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4c61f7c-f7ad-4646-9bf6-5e2010807bd7-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-rtbgk\" (UID: \"b4c61f7c-f7ad-4646-9bf6-5e2010807bd7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"
Sep 10 21:20:37.962523 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:37.962421    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xkwn\" (UniqueName: \"kubernetes.io/projected/b4c61f7c-f7ad-4646-9bf6-5e2010807bd7-kube-api-access-7xkwn\") pod \"monitoring-plugin-5d85778b9d-rtbgk\" (UID: \"b4c61f7c-f7ad-4646-9bf6-5e2010807bd7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"
Sep 10 21:20:38.063163 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.063128    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xkwn\" (UniqueName: \"kubernetes.io/projected/b4c61f7c-f7ad-4646-9bf6-5e2010807bd7-kube-api-access-7xkwn\") pod \"monitoring-plugin-5d85778b9d-rtbgk\" (UID: \"b4c61f7c-f7ad-4646-9bf6-5e2010807bd7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"
Sep 10 21:20:38.063303 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.063171    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-oauth-config\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.063303 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.063215    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-service-ca\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.063303 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.063245    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-trusted-ca-bundle\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.063419 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.063366    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkc9d\" (UniqueName: \"kubernetes.io/projected/c05ad7e3-5e9e-442a-a635-475b6584b45b-kube-api-access-rkc9d\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.063419 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.063412    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4c61f7c-f7ad-4646-9bf6-5e2010807bd7-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-rtbgk\" (UID: \"b4c61f7c-f7ad-4646-9bf6-5e2010807bd7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"
Sep 10 21:20:38.063489 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.063434    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-config\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.063527 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.063481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-serving-cert\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.063527 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.063520    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-oauth-serving-cert\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.065738 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.065716    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4c61f7c-f7ad-4646-9bf6-5e2010807bd7-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-rtbgk\" (UID: \"b4c61f7c-f7ad-4646-9bf6-5e2010807bd7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"
Sep 10 21:20:38.076181 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.076163    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xkwn\" (UniqueName: \"kubernetes.io/projected/b4c61f7c-f7ad-4646-9bf6-5e2010807bd7-kube-api-access-7xkwn\") pod \"monitoring-plugin-5d85778b9d-rtbgk\" (UID: \"b4c61f7c-f7ad-4646-9bf6-5e2010807bd7\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"
Sep 10 21:20:38.164505 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.164479    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-config\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.164614 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.164518    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-serving-cert\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.164614 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.164541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-oauth-serving-cert\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.164614 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.164564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-oauth-config\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.164614 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.164583    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-service-ca\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.164614 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.164600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-trusted-ca-bundle\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.164872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.164657    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkc9d\" (UniqueName: \"kubernetes.io/projected/c05ad7e3-5e9e-442a-a635-475b6584b45b-kube-api-access-rkc9d\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.165275 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.165252    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-service-ca\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.165369 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.165252    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-oauth-serving-cert\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.165585 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.165558    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-trusted-ca-bundle\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.165660 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.165566    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-config\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.167141 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.167122    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-oauth-config\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.167270 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.167189    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-serving-cert\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.172382 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.172360    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkc9d\" (UniqueName: \"kubernetes.io/projected/c05ad7e3-5e9e-442a-a635-475b6584b45b-kube-api-access-rkc9d\") pod \"console-f784bb8f7-lrxcn\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") " pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.175028 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.175006    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"
Sep 10 21:20:38.214642 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.214620    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:38.447798 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.447776    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"]
Sep 10 21:20:38.450059 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:38.450034    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c61f7c_f7ad_4646_9bf6_5e2010807bd7.slice/crio-881f3347c1b8a63b797163299a9b606206fd3a653af056ed33c9e2b0c4ee62dc WatchSource:0}: Error finding container 881f3347c1b8a63b797163299a9b606206fd3a653af056ed33c9e2b0c4ee62dc: Status 404 returned error can't find the container with id 881f3347c1b8a63b797163299a9b606206fd3a653af056ed33c9e2b0c4ee62dc
Sep 10 21:20:38.492685 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.492657    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f784bb8f7-lrxcn"]
Sep 10 21:20:38.495222 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:20:38.495173    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05ad7e3_5e9e_442a_a635_475b6584b45b.slice/crio-4de59bb334ed549f3c60f83e9dfb4da84513b81e25b4a16d3926fc56735bca76 WatchSource:0}: Error finding container 4de59bb334ed549f3c60f83e9dfb4da84513b81e25b4a16d3926fc56735bca76: Status 404 returned error can't find the container with id 4de59bb334ed549f3c60f83e9dfb4da84513b81e25b4a16d3926fc56735bca76
Sep 10 21:20:38.676828 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.676776    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:20:38.776856 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.776830    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerStarted","Data":"1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3"}
Sep 10 21:20:38.776986 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.776888    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerStarted","Data":"69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f"}
Sep 10 21:20:38.776986 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.776927    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerStarted","Data":"47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581"}
Sep 10 21:20:38.776986 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.776962    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerStarted","Data":"264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129"}
Sep 10 21:20:38.777095 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.776989    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerStarted","Data":"21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58"}
Sep 10 21:20:38.778030 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.778006    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f784bb8f7-lrxcn" event={"ID":"c05ad7e3-5e9e-442a-a635-475b6584b45b","Type":"ContainerStarted","Data":"4de59bb334ed549f3c60f83e9dfb4da84513b81e25b4a16d3926fc56735bca76"}
Sep 10 21:20:38.779106 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:38.779086    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk" event={"ID":"b4c61f7c-f7ad-4646-9bf6-5e2010807bd7","Type":"ContainerStarted","Data":"881f3347c1b8a63b797163299a9b606206fd3a653af056ed33c9e2b0c4ee62dc"}
Sep 10 21:20:39.788593 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:39.788441    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerStarted","Data":"74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23"}
Sep 10 21:20:39.815844 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:39.815788    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.311874362 podStartE2EDuration="5.815770176s" totalImagesPullingTime="3.483204712s" totalInitContainerRuntime="20.691102ms" isStatefulPod=false podCreationTimestamp="2026-09-10 21:20:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:39.813485153 +0000 UTC m=+90.015815725" watchObservedRunningTime="2026-09-10 21:20:39.815770176 +0000 UTC m=+90.018100749"
Sep 10 21:20:40.795053 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:40.794978    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk" event={"ID":"b4c61f7c-f7ad-4646-9bf6-5e2010807bd7","Type":"ContainerStarted","Data":"4350bca2aacda5a8251d5e645a2c7c7f7035abd04e1aa6436c2562bdff7fb39f"}
Sep 10 21:20:40.795546 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:40.795509    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"
Sep 10 21:20:40.801248 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:40.801224    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk"
Sep 10 21:20:40.821123 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:40.821083    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-rtbgk" podStartSLOduration=2.414196759 podStartE2EDuration="3.821069526s" totalImagesPullingTime="1.406872767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:40.820172707 +0000 UTC m=+91.022503281" watchObservedRunningTime="2026-09-10 21:20:40.821069526 +0000 UTC m=+91.023400114"
Sep 10 21:20:41.800805 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:41.800772    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f784bb8f7-lrxcn" event={"ID":"c05ad7e3-5e9e-442a-a635-475b6584b45b","Type":"ContainerStarted","Data":"7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9"}
Sep 10 21:20:41.823338 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:41.819611    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f784bb8f7-lrxcn" podStartSLOduration=1.865189806 podStartE2EDuration="4.819593135s" totalImagesPullingTime="2.954403329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:41.818281698 +0000 UTC m=+92.020612274" watchObservedRunningTime="2026-09-10 21:20:41.819593135 +0000 UTC m=+92.021923709"
Sep 10 21:20:42.162420 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:42.162351    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9fc8977fb-phrdh"]
Sep 10 21:20:47.665449 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:47.665421    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r27tz"
Sep 10 21:20:48.215174 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:48.215141    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:48.215347 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:48.215194    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:48.219677 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:48.219658    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:20:48.838353 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:20:48.838324    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:21:06.910722 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:06.910653    2568 generic.go:356] "Generic (PLEG): container finished" podID="e81cef71-792e-40cd-ae39-887ffd2bf1ea" containerID="e48ebab5a18256a6be06db6893627f5f103c0daf6390c8583a11b1ce8a9e6cbb" exitCode=0
Sep 10 21:21:06.910722 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:06.910693    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx" event={"ID":"e81cef71-792e-40cd-ae39-887ffd2bf1ea","Type":"ContainerDied","Data":"e48ebab5a18256a6be06db6893627f5f103c0daf6390c8583a11b1ce8a9e6cbb"}
Sep 10 21:21:06.911079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:06.910954    2568 scope.go:117] "RemoveContainer" containerID="e48ebab5a18256a6be06db6893627f5f103c0daf6390c8583a11b1ce8a9e6cbb"
Sep 10 21:21:07.181288 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.181187    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh" podUID="6d6729db-ccf2-48d4-a5d6-201937367057" containerName="registry" containerID="cri-o://69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480" gracePeriod=30
Sep 10 21:21:07.429713 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.429687    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:21:07.476684 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.476623    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-trusted-ca\") pod \"6d6729db-ccf2-48d4-a5d6-201937367057\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") "
Sep 10 21:21:07.476684 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.476677    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-installation-pull-secrets\") pod \"6d6729db-ccf2-48d4-a5d6-201937367057\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") "
Sep 10 21:21:07.476862 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.476700    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-registry-certificates\") pod \"6d6729db-ccf2-48d4-a5d6-201937367057\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") "
Sep 10 21:21:07.476862 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.476807    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d6729db-ccf2-48d4-a5d6-201937367057-ca-trust-extracted\") pod \"6d6729db-ccf2-48d4-a5d6-201937367057\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") "
Sep 10 21:21:07.476862 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.476839    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls\") pod \"6d6729db-ccf2-48d4-a5d6-201937367057\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") "
Sep 10 21:21:07.477015 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.476876    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4wjp\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-kube-api-access-j4wjp\") pod \"6d6729db-ccf2-48d4-a5d6-201937367057\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") "
Sep 10 21:21:07.477015 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.476916    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-bound-sa-token\") pod \"6d6729db-ccf2-48d4-a5d6-201937367057\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") "
Sep 10 21:21:07.477015 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.476942    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-image-registry-private-configuration\") pod \"6d6729db-ccf2-48d4-a5d6-201937367057\" (UID: \"6d6729db-ccf2-48d4-a5d6-201937367057\") "
Sep 10 21:21:07.477283 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.477158    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6d6729db-ccf2-48d4-a5d6-201937367057" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:07.477283 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.477165    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6d6729db-ccf2-48d4-a5d6-201937367057" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:07.479588 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.479530    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6d6729db-ccf2-48d4-a5d6-201937367057" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:07.479588 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.479568    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6d6729db-ccf2-48d4-a5d6-201937367057" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:07.479728 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.479671    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-kube-api-access-j4wjp" (OuterVolumeSpecName: "kube-api-access-j4wjp") pod "6d6729db-ccf2-48d4-a5d6-201937367057" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057"). InnerVolumeSpecName "kube-api-access-j4wjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:07.479728 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.479701    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6d6729db-ccf2-48d4-a5d6-201937367057" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:07.479804 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.479788    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6d6729db-ccf2-48d4-a5d6-201937367057" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:07.485156 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.485133    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d6729db-ccf2-48d4-a5d6-201937367057-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6d6729db-ccf2-48d4-a5d6-201937367057" (UID: "6d6729db-ccf2-48d4-a5d6-201937367057"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:07.577501 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.577479    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-trusted-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:07.577501 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.577499    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-installation-pull-secrets\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:07.577660 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.577509    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d6729db-ccf2-48d4-a5d6-201937367057-registry-certificates\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:07.577660 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.577519    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d6729db-ccf2-48d4-a5d6-201937367057-ca-trust-extracted\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:07.577660 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.577527    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-registry-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:07.577660 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.577537    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4wjp\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-kube-api-access-j4wjp\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:07.577660 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.577545    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d6729db-ccf2-48d4-a5d6-201937367057-bound-sa-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:07.577660 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.577554    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d6729db-ccf2-48d4-a5d6-201937367057-image-registry-private-configuration\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:07.915679 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.915648    2568 generic.go:356] "Generic (PLEG): container finished" podID="6d6729db-ccf2-48d4-a5d6-201937367057" containerID="69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480" exitCode=0
Sep 10 21:21:07.916194 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.915692    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh"
Sep 10 21:21:07.916194 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.915737    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh" event={"ID":"6d6729db-ccf2-48d4-a5d6-201937367057","Type":"ContainerDied","Data":"69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480"}
Sep 10 21:21:07.916194 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.915805    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9fc8977fb-phrdh" event={"ID":"6d6729db-ccf2-48d4-a5d6-201937367057","Type":"ContainerDied","Data":"82a8cddd83e954eea182f371d493c7b58f28e129d92bf70a8daab96f41a9b672"}
Sep 10 21:21:07.916194 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.915836    2568 scope.go:117] "RemoveContainer" containerID="69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480"
Sep 10 21:21:07.917963 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.917940    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dr2wx" event={"ID":"e81cef71-792e-40cd-ae39-887ffd2bf1ea","Type":"ContainerStarted","Data":"2cfa99dcd7a6227faae7db80edc535bbc8c8db3e278c90874d23ebff51c4fd51"}
Sep 10 21:21:07.925180 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.925161    2568 scope.go:117] "RemoveContainer" containerID="69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480"
Sep 10 21:21:07.925486 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:21:07.925466    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480\": container with ID starting with 69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480 not found: ID does not exist" containerID="69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480"
Sep 10 21:21:07.925525 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.925495    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480"} err="failed to get container status \"69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480\": rpc error: code = NotFound desc = could not find container \"69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480\": container with ID starting with 69cb85aca275cb80de0206a93062729180f7eb94c8a6efdd063aa8dc0b4f8480 not found: ID does not exist"
Sep 10 21:21:07.950620 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.950597    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9fc8977fb-phrdh"]
Sep 10 21:21:07.957262 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:07.957241    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9fc8977fb-phrdh"]
Sep 10 21:21:08.195429 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:08.195362    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d6729db-ccf2-48d4-a5d6-201937367057" path="/var/lib/kubelet/pods/6d6729db-ccf2-48d4-a5d6-201937367057/volumes"
Sep 10 21:21:21.972642 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:21.972584    2568 generic.go:356] "Generic (PLEG): container finished" podID="e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a" containerID="8916041a7b7c4933997dce1d423635126ac4f29e64ba15e4dcb8df018a0b68f0" exitCode=0
Sep 10 21:21:21.973059 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:21.972656    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c" event={"ID":"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a","Type":"ContainerDied","Data":"8916041a7b7c4933997dce1d423635126ac4f29e64ba15e4dcb8df018a0b68f0"}
Sep 10 21:21:21.973059 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:21.972930    2568 scope.go:117] "RemoveContainer" containerID="8916041a7b7c4933997dce1d423635126ac4f29e64ba15e4dcb8df018a0b68f0"
Sep 10 21:21:22.983478 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:22.983442    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-h944c" event={"ID":"e4bc7c26-6bfe-47cd-bb4e-2a301f4a4f7a","Type":"ContainerStarted","Data":"2666538317ed80600c3ee8e590a45043f8aebee9538cb775e9c7d3a16c07b895"}
Sep 10 21:21:27.001405 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:27.001370    2568 generic.go:356] "Generic (PLEG): container finished" podID="c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3" containerID="69ac1e37686d4a4ad4ec6c31ad93603aafc3ee2add2539122564f951cbb37f47" exitCode=0
Sep 10 21:21:27.001883 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:27.001446    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-bdtx2" event={"ID":"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3","Type":"ContainerDied","Data":"69ac1e37686d4a4ad4ec6c31ad93603aafc3ee2add2539122564f951cbb37f47"}
Sep 10 21:21:27.001883 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:27.001843    2568 scope.go:117] "RemoveContainer" containerID="69ac1e37686d4a4ad4ec6c31ad93603aafc3ee2add2539122564f951cbb37f47"
Sep 10 21:21:28.009286 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:28.009251    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-bdtx2" event={"ID":"c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3","Type":"ContainerStarted","Data":"e8d84d2c48523efb58a774e650ce0719f897037b13c82ee0d503fcb3274a1b17"}
Sep 10 21:21:53.347906 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:53.347871    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:21:53.348402 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:53.348157    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="alertmanager" containerID="cri-o://21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58" gracePeriod=120
Sep 10 21:21:53.348402 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:53.348227    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy-metric" containerID="cri-o://1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3" gracePeriod=120
Sep 10 21:21:53.348402 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:53.348265    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy-web" containerID="cri-o://47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581" gracePeriod=120
Sep 10 21:21:53.348402 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:53.348297    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="prom-label-proxy" containerID="cri-o://74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23" gracePeriod=120
Sep 10 21:21:53.348402 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:53.348316    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy" containerID="cri-o://69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f" gracePeriod=120
Sep 10 21:21:53.348658 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:53.348445    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="config-reloader" containerID="cri-o://264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129" gracePeriod=120
Sep 10 21:21:54.119039 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.119007    2568 generic.go:356] "Generic (PLEG): container finished" podID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerID="74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23" exitCode=0
Sep 10 21:21:54.119039 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.119033    2568 generic.go:356] "Generic (PLEG): container finished" podID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerID="69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f" exitCode=0
Sep 10 21:21:54.119039 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.119039    2568 generic.go:356] "Generic (PLEG): container finished" podID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerID="264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129" exitCode=0
Sep 10 21:21:54.119039 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.119044    2568 generic.go:356] "Generic (PLEG): container finished" podID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerID="21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58" exitCode=0
Sep 10 21:21:54.119383 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.119084    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerDied","Data":"74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23"}
Sep 10 21:21:54.119383 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.119161    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerDied","Data":"69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f"}
Sep 10 21:21:54.119383 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.119219    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerDied","Data":"264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129"}
Sep 10 21:21:54.119383 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.119256    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerDied","Data":"21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58"}
Sep 10 21:21:54.599024 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.599000    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:54.735860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.735790    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-main-tls\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.735860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.735826    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-metrics-client-ca\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.735860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.735846    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-cluster-tls-config\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.736249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.735878    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-web\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.736249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.735913    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-main-db\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.736249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.735943    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-trusted-ca-bundle\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.736249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.735974    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.736249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.736003    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj7gn\" (UniqueName: \"kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-kube-api-access-hj7gn\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.736249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.736039    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.736249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.736079    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-tls-assets\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.736249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.736141    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-out\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.736249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.736187    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-web-config\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.736249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.736257    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-volume\") pod \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\" (UID: \"68064131-7159-4d12-ae06-ae4a9b2a1fc7\") "
Sep 10 21:21:54.736763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.736300    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:54.736763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.736333    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:54.736763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.736516    2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-main-db\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.736763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.736534    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-metrics-client-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.736763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.736653    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:54.738923 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.738888    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:54.739255 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.739191    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:54.739641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.739596    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:54.739784 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.739748    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-volume" (OuterVolumeSpecName: "config-volume") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:54.739876 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.739782    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-out" (OuterVolumeSpecName: "config-out") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:54.739969 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.739951    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:54.740383 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.740361    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-kube-api-access-hj7gn" (OuterVolumeSpecName: "kube-api-access-hj7gn") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "kube-api-access-hj7gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:54.740483 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.740468    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:54.743648 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.743627    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:54.750135 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.750112    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-web-config" (OuterVolumeSpecName: "web-config") pod "68064131-7159-4d12-ae06-ae4a9b2a1fc7" (UID: "68064131-7159-4d12-ae06-ae4a9b2a1fc7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:54.837682 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.837652    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.837682 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.837678    2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-tls-assets\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.837682 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.837688    2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-out\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.837863 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.837696    2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-web-config\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.837863 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.837704    2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-config-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.837863 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.837712    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-main-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.837863 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.837721    2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-cluster-tls-config\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.837863 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.837730    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.837863 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.837740    2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68064131-7159-4d12-ae06-ae4a9b2a1fc7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.837863 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.837749    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68064131-7159-4d12-ae06-ae4a9b2a1fc7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:54.837863 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:54.837758    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj7gn\" (UniqueName: \"kubernetes.io/projected/68064131-7159-4d12-ae06-ae4a9b2a1fc7-kube-api-access-hj7gn\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:21:55.127182 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.127144    2568 generic.go:356] "Generic (PLEG): container finished" podID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerID="1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3" exitCode=0
Sep 10 21:21:55.127182 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.127172    2568 generic.go:356] "Generic (PLEG): container finished" podID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerID="47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581" exitCode=0
Sep 10 21:21:55.127437 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.127219    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerDied","Data":"1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3"}
Sep 10 21:21:55.127437 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.127251    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.127437 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.127282    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerDied","Data":"47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581"}
Sep 10 21:21:55.127437 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.127314    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68064131-7159-4d12-ae06-ae4a9b2a1fc7","Type":"ContainerDied","Data":"eb5a6fe1e43fd9e715bb5f43c950f7619e879be3d997e7389b91fa29213b54c1"}
Sep 10 21:21:55.127437 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.127353    2568 scope.go:117] "RemoveContainer" containerID="74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23"
Sep 10 21:21:55.135332 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.135179    2568 scope.go:117] "RemoveContainer" containerID="1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3"
Sep 10 21:21:55.142291 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.142267    2568 scope.go:117] "RemoveContainer" containerID="69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f"
Sep 10 21:21:55.149087 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.149070    2568 scope.go:117] "RemoveContainer" containerID="47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581"
Sep 10 21:21:55.151144 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.151124    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:21:55.155075 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.155054    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:21:55.156550 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.156534    2568 scope.go:117] "RemoveContainer" containerID="264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129"
Sep 10 21:21:55.163233 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.163217    2568 scope.go:117] "RemoveContainer" containerID="21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58"
Sep 10 21:21:55.171675 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.171646    2568 scope.go:117] "RemoveContainer" containerID="f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a"
Sep 10 21:21:55.178878 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.178860    2568 scope.go:117] "RemoveContainer" containerID="74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23"
Sep 10 21:21:55.179136 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:21:55.179118    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23\": container with ID starting with 74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23 not found: ID does not exist" containerID="74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23"
Sep 10 21:21:55.179188 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.179145    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23"} err="failed to get container status \"74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23\": rpc error: code = NotFound desc = could not find container \"74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23\": container with ID starting with 74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23 not found: ID does not exist"
Sep 10 21:21:55.179188 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.179162    2568 scope.go:117] "RemoveContainer" containerID="1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3"
Sep 10 21:21:55.179417 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:21:55.179403    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3\": container with ID starting with 1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3 not found: ID does not exist" containerID="1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3"
Sep 10 21:21:55.179505 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.179419    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3"} err="failed to get container status \"1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3\": rpc error: code = NotFound desc = could not find container \"1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3\": container with ID starting with 1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3 not found: ID does not exist"
Sep 10 21:21:55.179505 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.179431    2568 scope.go:117] "RemoveContainer" containerID="69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f"
Sep 10 21:21:55.179642 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:21:55.179627    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f\": container with ID starting with 69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f not found: ID does not exist" containerID="69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f"
Sep 10 21:21:55.179689 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.179645    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f"} err="failed to get container status \"69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f\": rpc error: code = NotFound desc = could not find container \"69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f\": container with ID starting with 69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f not found: ID does not exist"
Sep 10 21:21:55.179689 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.179657    2568 scope.go:117] "RemoveContainer" containerID="47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581"
Sep 10 21:21:55.180085 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:21:55.180054    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581\": container with ID starting with 47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581 not found: ID does not exist" containerID="47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581"
Sep 10 21:21:55.180194 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.180086    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581"} err="failed to get container status \"47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581\": rpc error: code = NotFound desc = could not find container \"47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581\": container with ID starting with 47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581 not found: ID does not exist"
Sep 10 21:21:55.180194 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.180108    2568 scope.go:117] "RemoveContainer" containerID="264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129"
Sep 10 21:21:55.180534 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:21:55.180510    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129\": container with ID starting with 264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129 not found: ID does not exist" containerID="264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129"
Sep 10 21:21:55.180620 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.180538    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129"} err="failed to get container status \"264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129\": rpc error: code = NotFound desc = could not find container \"264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129\": container with ID starting with 264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129 not found: ID does not exist"
Sep 10 21:21:55.180620 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.180551    2568 scope.go:117] "RemoveContainer" containerID="21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58"
Sep 10 21:21:55.180822 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:21:55.180806    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58\": container with ID starting with 21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58 not found: ID does not exist" containerID="21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58"
Sep 10 21:21:55.180869 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.180824    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58"} err="failed to get container status \"21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58\": rpc error: code = NotFound desc = could not find container \"21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58\": container with ID starting with 21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58 not found: ID does not exist"
Sep 10 21:21:55.180869 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.180838    2568 scope.go:117] "RemoveContainer" containerID="f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a"
Sep 10 21:21:55.181115 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:21:55.181097    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a\": container with ID starting with f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a not found: ID does not exist" containerID="f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a"
Sep 10 21:21:55.181165 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.181119    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a"} err="failed to get container status \"f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a\": rpc error: code = NotFound desc = could not find container \"f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a\": container with ID starting with f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a not found: ID does not exist"
Sep 10 21:21:55.181165 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.181134    2568 scope.go:117] "RemoveContainer" containerID="74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23"
Sep 10 21:21:55.181417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.181399    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23"} err="failed to get container status \"74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23\": rpc error: code = NotFound desc = could not find container \"74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23\": container with ID starting with 74a70ce0f5b9562235ea594f33d59773b8232790f4a73836abb71d0ddf528d23 not found: ID does not exist"
Sep 10 21:21:55.181465 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.181417    2568 scope.go:117] "RemoveContainer" containerID="1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3"
Sep 10 21:21:55.181651 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.181636    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3"} err="failed to get container status \"1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3\": rpc error: code = NotFound desc = could not find container \"1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3\": container with ID starting with 1da76b3fd5a124bb228325e7ff6eb018431af44607ba46e3966933a31c8a13a3 not found: ID does not exist"
Sep 10 21:21:55.181697 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.181650    2568 scope.go:117] "RemoveContainer" containerID="69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f"
Sep 10 21:21:55.181743 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.181707    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:21:55.181835 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.181818    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f"} err="failed to get container status \"69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f\": rpc error: code = NotFound desc = could not find container \"69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f\": container with ID starting with 69ac81cb95bd9dbc4cae4749d64f53228d85d86d8f4643edd6f07e7802e1157f not found: ID does not exist"
Sep 10 21:21:55.181918 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.181835    2568 scope.go:117] "RemoveContainer" containerID="47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581"
Sep 10 21:21:55.182015 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.181999    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6729db-ccf2-48d4-a5d6-201937367057" containerName="registry"
Sep 10 21:21:55.182067 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182018    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6729db-ccf2-48d4-a5d6-201937367057" containerName="registry"
Sep 10 21:21:55.182067 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182030    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy-metric"
Sep 10 21:21:55.182067 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182038    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy-metric"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182072    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="config-reloader"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182082    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="config-reloader"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182096    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="prom-label-proxy"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182103    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="prom-label-proxy"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182112    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="init-config-reloader"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182118    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="init-config-reloader"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182123    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy-web"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182128    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy-web"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182137    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="alertmanager"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182144    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="alertmanager"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182152    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy"
Sep 10 21:21:55.182168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182161    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy"
Sep 10 21:21:55.182601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182074    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581"} err="failed to get container status \"47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581\": rpc error: code = NotFound desc = could not find container \"47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581\": container with ID starting with 47d72b5a077965f9d7d0ccaa5b381f1f7df45a8dbbca0346c432dc8a84553581 not found: ID does not exist"
Sep 10 21:21:55.182601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182225    2568 scope.go:117] "RemoveContainer" containerID="264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129"
Sep 10 21:21:55.182601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182240    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6729db-ccf2-48d4-a5d6-201937367057" containerName="registry"
Sep 10 21:21:55.182601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182253    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy-web"
Sep 10 21:21:55.182601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182262    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy"
Sep 10 21:21:55.182601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182271    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="prom-label-proxy"
Sep 10 21:21:55.182601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182280    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="alertmanager"
Sep 10 21:21:55.182601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182289    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="config-reloader"
Sep 10 21:21:55.182601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182295    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" containerName="kube-rbac-proxy-metric"
Sep 10 21:21:55.182601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182507    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129"} err="failed to get container status \"264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129\": rpc error: code = NotFound desc = could not find container \"264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129\": container with ID starting with 264953ee9bac0246915e8f1b5aa311f659dc86757a5c3081cf90669d779b5129 not found: ID does not exist"
Sep 10 21:21:55.182601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182523    2568 scope.go:117] "RemoveContainer" containerID="21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58"
Sep 10 21:21:55.182956 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182725    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58"} err="failed to get container status \"21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58\": rpc error: code = NotFound desc = could not find container \"21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58\": container with ID starting with 21c0263255eb890a39bfc1fe76c47d9d65f11ff17fa8c5ff06242b12f8ae5b58 not found: ID does not exist"
Sep 10 21:21:55.182956 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182737    2568 scope.go:117] "RemoveContainer" containerID="f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a"
Sep 10 21:21:55.182956 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.182934    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a"} err="failed to get container status \"f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a\": rpc error: code = NotFound desc = could not find container \"f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a\": container with ID starting with f065b9fc603cc2fd5383fac4f4239dedf0b02625170e6bd48568dff7a686567a not found: ID does not exist"
Sep 10 21:21:55.187170 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.187155    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.189692 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.189618    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8ktxl\""
Sep 10 21:21:55.189692 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.189618    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 21:21:55.189692 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.189652    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 21:21:55.189692 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.189670    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 21:21:55.189692 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.189682    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 21:21:55.190016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.189694    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 21:21:55.190016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.189652    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 21:21:55.190016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.189623    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 21:21:55.190129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.190058    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 21:21:55.194837 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.194814    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 21:21:55.200997 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.200843    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:21:55.342153 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342124    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342153 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342155    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735c823e-db53-49c4-b92c-7bca13a45dee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342378 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342177    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342378 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342245    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342378 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/735c823e-db53-49c4-b92c-7bca13a45dee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342378 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342305    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342378 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342339    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-config-volume\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342378 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342361    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85rn2\" (UniqueName: \"kubernetes.io/projected/735c823e-db53-49c4-b92c-7bca13a45dee-kube-api-access-85rn2\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342566 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342390    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342566 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-web-config\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342566 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342488    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/735c823e-db53-49c4-b92c-7bca13a45dee-config-out\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342566 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342515    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/735c823e-db53-49c4-b92c-7bca13a45dee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.342566 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.342529    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/735c823e-db53-49c4-b92c-7bca13a45dee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.443795 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.443767    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.443795 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.443797    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735c823e-db53-49c4-b92c-7bca13a45dee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.443925 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.443818    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.443925 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.443835    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.443925 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.443878    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/735c823e-db53-49c4-b92c-7bca13a45dee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.444047 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.444028    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.444099 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.444084    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-config-volume\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.444160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.444125    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85rn2\" (UniqueName: \"kubernetes.io/projected/735c823e-db53-49c4-b92c-7bca13a45dee-kube-api-access-85rn2\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.444246 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.444156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.444246 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.444187    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-web-config\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.444352 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.444256    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/735c823e-db53-49c4-b92c-7bca13a45dee-config-out\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.444352 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.444308    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/735c823e-db53-49c4-b92c-7bca13a45dee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.444352 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.444332    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/735c823e-db53-49c4-b92c-7bca13a45dee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.445588 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.445010    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/735c823e-db53-49c4-b92c-7bca13a45dee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.445588 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.445064    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735c823e-db53-49c4-b92c-7bca13a45dee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.447058 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.446875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.447058 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.446990    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.447058 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.446997    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.447285 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.447056    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.447285 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.447060    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/735c823e-db53-49c4-b92c-7bca13a45dee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.447384 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.447290    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/735c823e-db53-49c4-b92c-7bca13a45dee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.447651 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.447629    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-web-config\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.447723 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.447694    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-config-volume\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.447873 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.447853    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/735c823e-db53-49c4-b92c-7bca13a45dee-config-out\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.448838 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.448820    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/735c823e-db53-49c4-b92c-7bca13a45dee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.453007 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.452991    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85rn2\" (UniqueName: \"kubernetes.io/projected/735c823e-db53-49c4-b92c-7bca13a45dee-kube-api-access-85rn2\") pod \"alertmanager-main-0\" (UID: \"735c823e-db53-49c4-b92c-7bca13a45dee\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.497524 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.497503    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 21:21:55.774244 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:55.774148    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 21:21:55.776295 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:21:55.776259    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735c823e_db53_49c4_b92c_7bca13a45dee.slice/crio-14de22353aa7f42e920948405368805b86359bb1cee26e447ba3f78fb1bedf6d WatchSource:0}: Error finding container 14de22353aa7f42e920948405368805b86359bb1cee26e447ba3f78fb1bedf6d: Status 404 returned error can't find the container with id 14de22353aa7f42e920948405368805b86359bb1cee26e447ba3f78fb1bedf6d
Sep 10 21:21:56.132838 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:56.132806    2568 generic.go:356] "Generic (PLEG): container finished" podID="735c823e-db53-49c4-b92c-7bca13a45dee" containerID="899fd8c2fcb9d66bb87ec1b20f209f3f4db335093e63b4d2076ab12d7a7bed0c" exitCode=0
Sep 10 21:21:56.132970 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:56.132872    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735c823e-db53-49c4-b92c-7bca13a45dee","Type":"ContainerDied","Data":"899fd8c2fcb9d66bb87ec1b20f209f3f4db335093e63b4d2076ab12d7a7bed0c"}
Sep 10 21:21:56.132970 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:56.132940    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735c823e-db53-49c4-b92c-7bca13a45dee","Type":"ContainerStarted","Data":"14de22353aa7f42e920948405368805b86359bb1cee26e447ba3f78fb1bedf6d"}
Sep 10 21:21:56.196388 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:56.196358    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68064131-7159-4d12-ae06-ae4a9b2a1fc7" path="/var/lib/kubelet/pods/68064131-7159-4d12-ae06-ae4a9b2a1fc7/volumes"
Sep 10 21:21:57.141630 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.141599    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735c823e-db53-49c4-b92c-7bca13a45dee","Type":"ContainerStarted","Data":"d1d7841e495b78fc73ca57cf26d53ea6af58898baeffda6a8b8c46978a1cc2b8"}
Sep 10 21:21:57.141984 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.141687    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735c823e-db53-49c4-b92c-7bca13a45dee","Type":"ContainerStarted","Data":"beee1ee19041b8080a7de03073bbedf38204b5becf09180eeb66beec91320f21"}
Sep 10 21:21:57.141984 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.141713    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735c823e-db53-49c4-b92c-7bca13a45dee","Type":"ContainerStarted","Data":"63f9d0a4762c3424fa02a8b849ddc65aaa606efe4d2b3d8f5f5ab1c3a40c09a5"}
Sep 10 21:21:57.141984 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.141743    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735c823e-db53-49c4-b92c-7bca13a45dee","Type":"ContainerStarted","Data":"45432b8c6508520d20e8cbd31a4587ac385a2590e99582b1dae75cd679e1f721"}
Sep 10 21:21:57.141984 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.141767    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735c823e-db53-49c4-b92c-7bca13a45dee","Type":"ContainerStarted","Data":"fd9923c100a59fca76f6227c1f367ffcbb58ca5930b6c03362b2544926e8cf3e"}
Sep 10 21:21:57.141984 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.141790    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735c823e-db53-49c4-b92c-7bca13a45dee","Type":"ContainerStarted","Data":"3388a7434ff07651565ee5bba1597925489c30df9972638c60b14d798251e3e3"}
Sep 10 21:21:57.168024 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.167975    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.153573896 podStartE2EDuration="2.167959985s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.386089ms" isStatefulPod=false podCreationTimestamp="2026-09-10 21:21:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:21:57.166489037 +0000 UTC m=+167.368819608" watchObservedRunningTime="2026-09-10 21:21:57.167959985 +0000 UTC m=+167.370290556"
Sep 10 21:21:57.353349 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.353308    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"]
Sep 10 21:21:57.357186 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.357166    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.360296 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.360269    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 21:21:57.360649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.360420    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 21:21:57.360649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.360522    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 21:21:57.360649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.360560    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 21:21:57.360649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.360559    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 21:21:57.360917 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.360829    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9vrrr\""
Sep 10 21:21:57.365133 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.365111    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 21:21:57.369170 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.369144    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"]
Sep 10 21:21:57.461607 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.461543    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q98v\" (UniqueName: \"kubernetes.io/projected/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-kube-api-access-9q98v\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.461607 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.461575    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-telemeter-client-tls\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.461607 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.461594    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-metrics-client-ca\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.461777 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.461673    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-federate-client-tls\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.461777 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.461732    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-secret-telemeter-client\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.461777 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.461756    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.461869 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.461793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.461869 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.461825    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-serving-certs-ca-bundle\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.562843 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.562816    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-telemeter-client-tls\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.562948 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.562846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-metrics-client-ca\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.562948 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.562877    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-federate-client-tls\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.562948 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.562899    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-secret-telemeter-client\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.563078 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.562942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.563078 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.562989    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.563078 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.563029    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-serving-certs-ca-bundle\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.563226 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.563083    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q98v\" (UniqueName: \"kubernetes.io/projected/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-kube-api-access-9q98v\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.563730 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.563697    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-metrics-client-ca\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.563842 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.563791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-serving-certs-ca-bundle\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.563919 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.563901    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.565539 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.565514    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-secret-telemeter-client\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.565612 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.565517    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-telemeter-client-tls\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.565878 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.565857    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.565917 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.565906    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-federate-client-tls\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.570385 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.570363    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q98v\" (UniqueName: \"kubernetes.io/projected/e3e6d994-a696-43dc-957a-f8be6fcfd7c4-kube-api-access-9q98v\") pod \"telemeter-client-54bf4879dd-4tt7g\" (UID: \"e3e6d994-a696-43dc-957a-f8be6fcfd7c4\") " pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.668608 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.668586    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"
Sep 10 21:21:57.944502 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:57.944477    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54bf4879dd-4tt7g"]
Sep 10 21:21:57.946572 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:21:57.946542    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e6d994_a696_43dc_957a_f8be6fcfd7c4.slice/crio-6276dc1230e3b132af2f2277d58e02b1b7491a68193fdbd546d4c87a9fae5f90 WatchSource:0}: Error finding container 6276dc1230e3b132af2f2277d58e02b1b7491a68193fdbd546d4c87a9fae5f90: Status 404 returned error can't find the container with id 6276dc1230e3b132af2f2277d58e02b1b7491a68193fdbd546d4c87a9fae5f90
Sep 10 21:21:58.147860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:21:58.147832    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g" event={"ID":"e3e6d994-a696-43dc-957a-f8be6fcfd7c4","Type":"ContainerStarted","Data":"6276dc1230e3b132af2f2277d58e02b1b7491a68193fdbd546d4c87a9fae5f90"}
Sep 10 21:22:00.157811 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.157777    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g" event={"ID":"e3e6d994-a696-43dc-957a-f8be6fcfd7c4","Type":"ContainerStarted","Data":"8f7d28fcead8ec2186551afa19a9f773bffb1cae2248a12382d022cd79dd2c58"}
Sep 10 21:22:00.158158 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.157867    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g" event={"ID":"e3e6d994-a696-43dc-957a-f8be6fcfd7c4","Type":"ContainerStarted","Data":"6200fdce1aff7f1cfd39e99712a259b770156cbeabdcfc698cdc47c70feb7605"}
Sep 10 21:22:00.158158 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.157886    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g" event={"ID":"e3e6d994-a696-43dc-957a-f8be6fcfd7c4","Type":"ContainerStarted","Data":"ee1d0f350d9ba8cd40eabcad34c6e369f723a316dfaa732ab92e51b041828d4d"}
Sep 10 21:22:00.183322 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.183277    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-54bf4879dd-4tt7g" podStartSLOduration=1.350727249 podStartE2EDuration="3.183261559s" totalImagesPullingTime="1.83253431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:00.182591527 +0000 UTC m=+170.384922100" watchObservedRunningTime="2026-09-10 21:22:00.183261559 +0000 UTC m=+170.385592125"
Sep 10 21:22:00.285254 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.285227    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c546f9d68-mv2dk"]
Sep 10 21:22:00.288610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.288591    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.306869 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.306845    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c546f9d68-mv2dk"]
Sep 10 21:22:00.383758 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.383728    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-oauth-serving-cert\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.383885 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.383802    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvcvw\" (UniqueName: \"kubernetes.io/projected/859c5b0f-cd2c-4da0-963e-2a528fc2647a-kube-api-access-tvcvw\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.383885 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.383828    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-service-ca\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.383994 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.383888    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-oauth-config\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.383994 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.383946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-serving-cert\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.384104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.384033    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-trusted-ca-bundle\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.384104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.384068    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-config\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.485097 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.485039    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-oauth-serving-cert\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.485097 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.485085    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvcvw\" (UniqueName: \"kubernetes.io/projected/859c5b0f-cd2c-4da0-963e-2a528fc2647a-kube-api-access-tvcvw\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.485281 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.485102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-service-ca\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.485281 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.485123    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-oauth-config\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.485281 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.485146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-serving-cert\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.485281 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.485181    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-trusted-ca-bundle\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.485281 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.485232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-config\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.485888 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.485862    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-oauth-serving-cert\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.485977 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.485897    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-service-ca\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.485977 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.485939    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-config\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.486227 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.486181    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-trusted-ca-bundle\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.487545 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.487523    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-oauth-config\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.487682 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.487664    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-serving-cert\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.498751 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.498727    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvcvw\" (UniqueName: \"kubernetes.io/projected/859c5b0f-cd2c-4da0-963e-2a528fc2647a-kube-api-access-tvcvw\") pod \"console-5c546f9d68-mv2dk\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") " pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.598996 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.598965    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:00.868710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:00.868644    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c546f9d68-mv2dk"]
Sep 10 21:22:00.870831 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:22:00.870805    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859c5b0f_cd2c_4da0_963e_2a528fc2647a.slice/crio-78e8c7e6781b8179583bd508b3cbff7b010962661de244bdf750f5dce6706159 WatchSource:0}: Error finding container 78e8c7e6781b8179583bd508b3cbff7b010962661de244bdf750f5dce6706159: Status 404 returned error can't find the container with id 78e8c7e6781b8179583bd508b3cbff7b010962661de244bdf750f5dce6706159
Sep 10 21:22:01.168428 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:01.168337    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c546f9d68-mv2dk" event={"ID":"859c5b0f-cd2c-4da0-963e-2a528fc2647a","Type":"ContainerStarted","Data":"71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be"}
Sep 10 21:22:01.168791 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:01.168428    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c546f9d68-mv2dk" event={"ID":"859c5b0f-cd2c-4da0-963e-2a528fc2647a","Type":"ContainerStarted","Data":"78e8c7e6781b8179583bd508b3cbff7b010962661de244bdf750f5dce6706159"}
Sep 10 21:22:01.188263 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:01.188220    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c546f9d68-mv2dk" podStartSLOduration=1.1881920400000001 podStartE2EDuration="1.18819204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:22:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:01.186864903 +0000 UTC m=+171.389195478" watchObservedRunningTime="2026-09-10 21:22:01.18819204 +0000 UTC m=+171.390522612"
Sep 10 21:22:10.599121 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:10.599088    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:10.599516 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:10.599146    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:10.603816 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:10.603791    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:11.218325 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:11.218299    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:22:11.271015 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:11.270983    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f784bb8f7-lrxcn"]
Sep 10 21:22:36.293367 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.293304    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f784bb8f7-lrxcn" podUID="c05ad7e3-5e9e-442a-a635-475b6584b45b" containerName="console" containerID="cri-o://7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9" gracePeriod=15
Sep 10 21:22:36.539517 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.539494    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:22:36.651818 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.651787    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkc9d\" (UniqueName: \"kubernetes.io/projected/c05ad7e3-5e9e-442a-a635-475b6584b45b-kube-api-access-rkc9d\") pod \"c05ad7e3-5e9e-442a-a635-475b6584b45b\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") "
Sep 10 21:22:36.651965 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.651856    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-config\") pod \"c05ad7e3-5e9e-442a-a635-475b6584b45b\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") "
Sep 10 21:22:36.651965 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.651881    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-trusted-ca-bundle\") pod \"c05ad7e3-5e9e-442a-a635-475b6584b45b\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") "
Sep 10 21:22:36.651965 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.651907    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-service-ca\") pod \"c05ad7e3-5e9e-442a-a635-475b6584b45b\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") "
Sep 10 21:22:36.652142 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.652118    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-serving-cert\") pod \"c05ad7e3-5e9e-442a-a635-475b6584b45b\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") "
Sep 10 21:22:36.652232 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.652175    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-oauth-serving-cert\") pod \"c05ad7e3-5e9e-442a-a635-475b6584b45b\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") "
Sep 10 21:22:36.652295 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.652242    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-oauth-config\") pod \"c05ad7e3-5e9e-442a-a635-475b6584b45b\" (UID: \"c05ad7e3-5e9e-442a-a635-475b6584b45b\") "
Sep 10 21:22:36.652365 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.652338    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-service-ca" (OuterVolumeSpecName: "service-ca") pod "c05ad7e3-5e9e-442a-a635-475b6584b45b" (UID: "c05ad7e3-5e9e-442a-a635-475b6584b45b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:36.652424 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.652385    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-config" (OuterVolumeSpecName: "console-config") pod "c05ad7e3-5e9e-442a-a635-475b6584b45b" (UID: "c05ad7e3-5e9e-442a-a635-475b6584b45b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:36.652424 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.652347    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c05ad7e3-5e9e-442a-a635-475b6584b45b" (UID: "c05ad7e3-5e9e-442a-a635-475b6584b45b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:36.652608 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.652581    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c05ad7e3-5e9e-442a-a635-475b6584b45b" (UID: "c05ad7e3-5e9e-442a-a635-475b6584b45b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:36.652704 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.652653    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-config\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:22:36.652704 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.652673    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-trusted-ca-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:22:36.652704 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.652688    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:22:36.654190 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.654166    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c05ad7e3-5e9e-442a-a635-475b6584b45b-kube-api-access-rkc9d" (OuterVolumeSpecName: "kube-api-access-rkc9d") pod "c05ad7e3-5e9e-442a-a635-475b6584b45b" (UID: "c05ad7e3-5e9e-442a-a635-475b6584b45b"). InnerVolumeSpecName "kube-api-access-rkc9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:22:36.654393 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.654188    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c05ad7e3-5e9e-442a-a635-475b6584b45b" (UID: "c05ad7e3-5e9e-442a-a635-475b6584b45b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:22:36.654393 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.654320    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c05ad7e3-5e9e-442a-a635-475b6584b45b" (UID: "c05ad7e3-5e9e-442a-a635-475b6584b45b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:22:36.753172 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.753145    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-serving-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:22:36.753172 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.753168    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c05ad7e3-5e9e-442a-a635-475b6584b45b-oauth-serving-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:22:36.753327 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.753182    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c05ad7e3-5e9e-442a-a635-475b6584b45b-console-oauth-config\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:22:36.753327 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:36.753195    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkc9d\" (UniqueName: \"kubernetes.io/projected/c05ad7e3-5e9e-442a-a635-475b6584b45b-kube-api-access-rkc9d\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:22:37.325134 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:37.325093    2568 generic.go:356] "Generic (PLEG): container finished" podID="c05ad7e3-5e9e-442a-a635-475b6584b45b" containerID="7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9" exitCode=0
Sep 10 21:22:37.325559 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:37.325155    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f784bb8f7-lrxcn"
Sep 10 21:22:37.325559 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:37.325172    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f784bb8f7-lrxcn" event={"ID":"c05ad7e3-5e9e-442a-a635-475b6584b45b","Type":"ContainerDied","Data":"7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9"}
Sep 10 21:22:37.325559 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:37.325261    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f784bb8f7-lrxcn" event={"ID":"c05ad7e3-5e9e-442a-a635-475b6584b45b","Type":"ContainerDied","Data":"4de59bb334ed549f3c60f83e9dfb4da84513b81e25b4a16d3926fc56735bca76"}
Sep 10 21:22:37.325559 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:37.325282    2568 scope.go:117] "RemoveContainer" containerID="7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9"
Sep 10 21:22:37.336461 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:37.335698    2568 scope.go:117] "RemoveContainer" containerID="7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9"
Sep 10 21:22:37.336860 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:22:37.336839    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9\": container with ID starting with 7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9 not found: ID does not exist" containerID="7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9"
Sep 10 21:22:37.336936 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:37.336868    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9"} err="failed to get container status \"7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9\": rpc error: code = NotFound desc = could not find container \"7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9\": container with ID starting with 7248a23e44bf19ded125decd46a3cb4c6cc299643558790c59681478e82ee8c9 not found: ID does not exist"
Sep 10 21:22:37.346854 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:37.346794    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f784bb8f7-lrxcn"]
Sep 10 21:22:37.348569 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:37.348549    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f784bb8f7-lrxcn"]
Sep 10 21:22:38.195296 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:22:38.195263    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c05ad7e3-5e9e-442a-a635-475b6584b45b" path="/var/lib/kubelet/pods/c05ad7e3-5e9e-442a-a635-475b6584b45b/volumes"
Sep 10 21:23:16.495637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.495601    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69d86c4478-rks2n"]
Sep 10 21:23:16.496126 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.496100    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c05ad7e3-5e9e-442a-a635-475b6584b45b" containerName="console"
Sep 10 21:23:16.496126 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.496119    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c05ad7e3-5e9e-442a-a635-475b6584b45b" containerName="console"
Sep 10 21:23:16.496278 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.496228    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c05ad7e3-5e9e-442a-a635-475b6584b45b" containerName="console"
Sep 10 21:23:16.498845 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.498824    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.519873 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.519843    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d86c4478-rks2n"]
Sep 10 21:23:16.636625 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.636583    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-oauth-serving-cert\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.636625 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.636629    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-service-ca\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.636868 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.636701    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-trusted-ca-bundle\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.636868 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.636747    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-serving-cert\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.636868 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.636801    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvzhg\" (UniqueName: \"kubernetes.io/projected/dbb205fc-a352-4ded-8ef2-034f13e0ec27-kube-api-access-xvzhg\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.636868 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.636835    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-oauth-config\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.636868 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.636863    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-config\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.737572 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.737532    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-oauth-serving-cert\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.737572 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.737575    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-service-ca\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.737754 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.737627    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-trusted-ca-bundle\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.737754 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.737656    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-serving-cert\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.737754 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.737682    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvzhg\" (UniqueName: \"kubernetes.io/projected/dbb205fc-a352-4ded-8ef2-034f13e0ec27-kube-api-access-xvzhg\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.737754 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.737703    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-oauth-config\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.737754 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.737731    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-config\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.738423 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.738393    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-service-ca\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.738545 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.738455    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-config\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.738545 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.738497    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-trusted-ca-bundle\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.738545 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.738529    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-oauth-serving-cert\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.740155 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.740137    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-serving-cert\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.740263 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.740158    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-oauth-config\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.747117 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.747067    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvzhg\" (UniqueName: \"kubernetes.io/projected/dbb205fc-a352-4ded-8ef2-034f13e0ec27-kube-api-access-xvzhg\") pod \"console-69d86c4478-rks2n\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") " pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:16.808440 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:16.808418    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:17.090658 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:17.090636    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d86c4478-rks2n"]
Sep 10 21:23:17.093287 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:23:17.093260    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb205fc_a352_4ded_8ef2_034f13e0ec27.slice/crio-f359c0cddac5f17a702815d758cbc9bf72c7cad01f2d2f55b4972e54ef4ae634 WatchSource:0}: Error finding container f359c0cddac5f17a702815d758cbc9bf72c7cad01f2d2f55b4972e54ef4ae634: Status 404 returned error can't find the container with id f359c0cddac5f17a702815d758cbc9bf72c7cad01f2d2f55b4972e54ef4ae634
Sep 10 21:23:17.487654 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:17.487573    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d86c4478-rks2n" event={"ID":"dbb205fc-a352-4ded-8ef2-034f13e0ec27","Type":"ContainerStarted","Data":"49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55"}
Sep 10 21:23:17.487654 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:17.487620    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d86c4478-rks2n" event={"ID":"dbb205fc-a352-4ded-8ef2-034f13e0ec27","Type":"ContainerStarted","Data":"f359c0cddac5f17a702815d758cbc9bf72c7cad01f2d2f55b4972e54ef4ae634"}
Sep 10 21:23:17.512928 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:17.512879    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69d86c4478-rks2n" podStartSLOduration=1.51286418 podStartE2EDuration="1.51286418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:23:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:23:17.51063824 +0000 UTC m=+247.712968811" watchObservedRunningTime="2026-09-10 21:23:17.51286418 +0000 UTC m=+247.715194749"
Sep 10 21:23:26.808594 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:26.808562    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:26.808974 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:26.808611    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:26.813313 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:26.813291    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:27.530025 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:27.529992    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:23:27.577097 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:27.577060    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c546f9d68-mv2dk"]
Sep 10 21:23:52.597909 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:52.597871    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c546f9d68-mv2dk" podUID="859c5b0f-cd2c-4da0-963e-2a528fc2647a" containerName="console" containerID="cri-o://71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be" gracePeriod=15
Sep 10 21:23:52.834392 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:52.834365    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:23:52.999429 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:52.999364    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-trusted-ca-bundle\") pod \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") "
Sep 10 21:23:52.999542 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:52.999436    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-oauth-serving-cert\") pod \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") "
Sep 10 21:23:52.999542 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:52.999528    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvcvw\" (UniqueName: \"kubernetes.io/projected/859c5b0f-cd2c-4da0-963e-2a528fc2647a-kube-api-access-tvcvw\") pod \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") "
Sep 10 21:23:52.999623 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:52.999557    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-config\") pod \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") "
Sep 10 21:23:52.999623 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:52.999604    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-service-ca\") pod \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") "
Sep 10 21:23:52.999718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:52.999634    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-serving-cert\") pod \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") "
Sep 10 21:23:52.999718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:52.999664    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-oauth-config\") pod \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\" (UID: \"859c5b0f-cd2c-4da0-963e-2a528fc2647a\") "
Sep 10 21:23:52.999822 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:52.999720    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "859c5b0f-cd2c-4da0-963e-2a528fc2647a" (UID: "859c5b0f-cd2c-4da0-963e-2a528fc2647a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:23:52.999822 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:52.999777    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "859c5b0f-cd2c-4da0-963e-2a528fc2647a" (UID: "859c5b0f-cd2c-4da0-963e-2a528fc2647a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:23:53.000053 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.000034    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-trusted-ca-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:23:53.000112 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.000061    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-oauth-serving-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:23:53.000112 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.000030    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-service-ca" (OuterVolumeSpecName: "service-ca") pod "859c5b0f-cd2c-4da0-963e-2a528fc2647a" (UID: "859c5b0f-cd2c-4da0-963e-2a528fc2647a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:23:53.000112 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.000045    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-config" (OuterVolumeSpecName: "console-config") pod "859c5b0f-cd2c-4da0-963e-2a528fc2647a" (UID: "859c5b0f-cd2c-4da0-963e-2a528fc2647a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:23:53.001601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.001574    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/859c5b0f-cd2c-4da0-963e-2a528fc2647a-kube-api-access-tvcvw" (OuterVolumeSpecName: "kube-api-access-tvcvw") pod "859c5b0f-cd2c-4da0-963e-2a528fc2647a" (UID: "859c5b0f-cd2c-4da0-963e-2a528fc2647a"). InnerVolumeSpecName "kube-api-access-tvcvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:23:53.001701 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.001655    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "859c5b0f-cd2c-4da0-963e-2a528fc2647a" (UID: "859c5b0f-cd2c-4da0-963e-2a528fc2647a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:23:53.001760 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.001724    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "859c5b0f-cd2c-4da0-963e-2a528fc2647a" (UID: "859c5b0f-cd2c-4da0-963e-2a528fc2647a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:23:53.100547 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.100515    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvcvw\" (UniqueName: \"kubernetes.io/projected/859c5b0f-cd2c-4da0-963e-2a528fc2647a-kube-api-access-tvcvw\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:23:53.100547 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.100541    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-config\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:23:53.100547 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.100550    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/859c5b0f-cd2c-4da0-963e-2a528fc2647a-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:23:53.100740 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.100558    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-serving-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:23:53.100740 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.100566    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/859c5b0f-cd2c-4da0-963e-2a528fc2647a-console-oauth-config\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:23:53.627670 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.627637    2568 generic.go:356] "Generic (PLEG): container finished" podID="859c5b0f-cd2c-4da0-963e-2a528fc2647a" containerID="71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be" exitCode=0
Sep 10 21:23:53.628045 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.627678    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c546f9d68-mv2dk"
Sep 10 21:23:53.628045 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.627692    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c546f9d68-mv2dk" event={"ID":"859c5b0f-cd2c-4da0-963e-2a528fc2647a","Type":"ContainerDied","Data":"71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be"}
Sep 10 21:23:53.628045 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.627729    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c546f9d68-mv2dk" event={"ID":"859c5b0f-cd2c-4da0-963e-2a528fc2647a","Type":"ContainerDied","Data":"78e8c7e6781b8179583bd508b3cbff7b010962661de244bdf750f5dce6706159"}
Sep 10 21:23:53.628045 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.627749    2568 scope.go:117] "RemoveContainer" containerID="71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be"
Sep 10 21:23:53.636714 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.636698    2568 scope.go:117] "RemoveContainer" containerID="71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be"
Sep 10 21:23:53.637002 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:23:53.636973    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be\": container with ID starting with 71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be not found: ID does not exist" containerID="71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be"
Sep 10 21:23:53.637040 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.637011    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be"} err="failed to get container status \"71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be\": rpc error: code = NotFound desc = could not find container \"71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be\": container with ID starting with 71aa855bc4e19dfbf2b9a25ec0b7917665528ca6ad40759480b6de1581b3b7be not found: ID does not exist"
Sep 10 21:23:53.649174 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.649153    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c546f9d68-mv2dk"]
Sep 10 21:23:53.655492 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:53.655471    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c546f9d68-mv2dk"]
Sep 10 21:23:54.194853 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:54.194822    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="859c5b0f-cd2c-4da0-963e-2a528fc2647a" path="/var/lib/kubelet/pods/859c5b0f-cd2c-4da0-963e-2a528fc2647a/volumes"
Sep 10 21:23:58.188981 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.188945    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"]
Sep 10 21:23:58.189449 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.189270    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="859c5b0f-cd2c-4da0-963e-2a528fc2647a" containerName="console"
Sep 10 21:23:58.189449 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.189282    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="859c5b0f-cd2c-4da0-963e-2a528fc2647a" containerName="console"
Sep 10 21:23:58.189449 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.189379    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="859c5b0f-cd2c-4da0-963e-2a528fc2647a" containerName="console"
Sep 10 21:23:58.193881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.193862    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:23:58.196897 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.196868    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:23:58.197586 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.197565    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zt45\""
Sep 10 21:23:58.197707 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.197568    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:23:58.202278 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.202254    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"]
Sep 10 21:23:58.234294 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.234275    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:23:58.234402 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.234301    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz77l\" (UniqueName: \"kubernetes.io/projected/bd67c222-cd88-40ef-a076-6f78d6ec73d9-kube-api-access-tz77l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:23:58.234402 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.234340    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:23:58.335381 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.335346    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:23:58.335491 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.335405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:23:58.335491 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.335427    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz77l\" (UniqueName: \"kubernetes.io/projected/bd67c222-cd88-40ef-a076-6f78d6ec73d9-kube-api-access-tz77l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:23:58.335684 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.335666    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:23:58.335743 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.335725    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:23:58.344010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.343982    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz77l\" (UniqueName: \"kubernetes.io/projected/bd67c222-cd88-40ef-a076-6f78d6ec73d9-kube-api-access-tz77l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:23:58.503945 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.503887    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:23:58.772152 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:58.772081    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"]
Sep 10 21:23:58.775181 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:23:58.775155    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd67c222_cd88_40ef_a076_6f78d6ec73d9.slice/crio-5ac1ef50ca4aad3fcb2fc2aefe21595d584c392a832502f7382c4af90d537b1e WatchSource:0}: Error finding container 5ac1ef50ca4aad3fcb2fc2aefe21595d584c392a832502f7382c4af90d537b1e: Status 404 returned error can't find the container with id 5ac1ef50ca4aad3fcb2fc2aefe21595d584c392a832502f7382c4af90d537b1e
Sep 10 21:23:59.654983 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:23:59.654945    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr" event={"ID":"bd67c222-cd88-40ef-a076-6f78d6ec73d9","Type":"ContainerStarted","Data":"5ac1ef50ca4aad3fcb2fc2aefe21595d584c392a832502f7382c4af90d537b1e"}
Sep 10 21:24:04.681672 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:04.681592    2568 generic.go:356] "Generic (PLEG): container finished" podID="bd67c222-cd88-40ef-a076-6f78d6ec73d9" containerID="d05a8ade6b0000e45b7b002507107f7bf972239f397199d66f289132140b6c62" exitCode=0
Sep 10 21:24:04.681672 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:04.681626    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr" event={"ID":"bd67c222-cd88-40ef-a076-6f78d6ec73d9","Type":"ContainerDied","Data":"d05a8ade6b0000e45b7b002507107f7bf972239f397199d66f289132140b6c62"}
Sep 10 21:24:06.692605 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:06.692576    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr" event={"ID":"bd67c222-cd88-40ef-a076-6f78d6ec73d9","Type":"ContainerStarted","Data":"5b0181a30e807ccad55afcc4640a2f71354a4135650f842b716a60912d4510d1"}
Sep 10 21:24:07.699225 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:07.699173    2568 generic.go:356] "Generic (PLEG): container finished" podID="bd67c222-cd88-40ef-a076-6f78d6ec73d9" containerID="5b0181a30e807ccad55afcc4640a2f71354a4135650f842b716a60912d4510d1" exitCode=0
Sep 10 21:24:07.699710 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:07.699234    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr" event={"ID":"bd67c222-cd88-40ef-a076-6f78d6ec73d9","Type":"ContainerDied","Data":"5b0181a30e807ccad55afcc4640a2f71354a4135650f842b716a60912d4510d1"}
Sep 10 21:24:10.143173 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:10.143144    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:24:10.143606 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:10.143589    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:24:10.155082 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:10.155059    2568 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 21:24:15.739706 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:15.739675    2568 generic.go:356] "Generic (PLEG): container finished" podID="bd67c222-cd88-40ef-a076-6f78d6ec73d9" containerID="f513e1a20b0bc216f5fd9d314a1cec17ccda7e31c90c71dbe1d88ce2e3eeb820" exitCode=0
Sep 10 21:24:15.740083 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:15.739733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr" event={"ID":"bd67c222-cd88-40ef-a076-6f78d6ec73d9","Type":"ContainerDied","Data":"f513e1a20b0bc216f5fd9d314a1cec17ccda7e31c90c71dbe1d88ce2e3eeb820"}
Sep 10 21:24:16.862602 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:16.862550    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:24:16.979931 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:16.979906    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz77l\" (UniqueName: \"kubernetes.io/projected/bd67c222-cd88-40ef-a076-6f78d6ec73d9-kube-api-access-tz77l\") pod \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") "
Sep 10 21:24:16.980089 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:16.979943    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-bundle\") pod \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") "
Sep 10 21:24:16.980089 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:16.979980    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-util\") pod \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\" (UID: \"bd67c222-cd88-40ef-a076-6f78d6ec73d9\") "
Sep 10 21:24:16.980611 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:16.980579    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-bundle" (OuterVolumeSpecName: "bundle") pod "bd67c222-cd88-40ef-a076-6f78d6ec73d9" (UID: "bd67c222-cd88-40ef-a076-6f78d6ec73d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:24:16.982173 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:16.982145    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd67c222-cd88-40ef-a076-6f78d6ec73d9-kube-api-access-tz77l" (OuterVolumeSpecName: "kube-api-access-tz77l") pod "bd67c222-cd88-40ef-a076-6f78d6ec73d9" (UID: "bd67c222-cd88-40ef-a076-6f78d6ec73d9"). InnerVolumeSpecName "kube-api-access-tz77l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:24:16.985039 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:16.985016    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-util" (OuterVolumeSpecName: "util") pod "bd67c222-cd88-40ef-a076-6f78d6ec73d9" (UID: "bd67c222-cd88-40ef-a076-6f78d6ec73d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:24:17.080714 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:17.080690    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz77l\" (UniqueName: \"kubernetes.io/projected/bd67c222-cd88-40ef-a076-6f78d6ec73d9-kube-api-access-tz77l\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:24:17.080714 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:17.080713    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:24:17.080836 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:17.080723    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd67c222-cd88-40ef-a076-6f78d6ec73d9-util\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:24:17.749192 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:17.749166    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr"
Sep 10 21:24:17.749349 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:17.749214    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gxnkr" event={"ID":"bd67c222-cd88-40ef-a076-6f78d6ec73d9","Type":"ContainerDied","Data":"5ac1ef50ca4aad3fcb2fc2aefe21595d584c392a832502f7382c4af90d537b1e"}
Sep 10 21:24:17.749349 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:17.749261    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ac1ef50ca4aad3fcb2fc2aefe21595d584c392a832502f7382c4af90d537b1e"
Sep 10 21:24:21.384461 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.384430    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929"]
Sep 10 21:24:21.384832 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.384737    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd67c222-cd88-40ef-a076-6f78d6ec73d9" containerName="util"
Sep 10 21:24:21.384832 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.384748    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd67c222-cd88-40ef-a076-6f78d6ec73d9" containerName="util"
Sep 10 21:24:21.384832 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.384759    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd67c222-cd88-40ef-a076-6f78d6ec73d9" containerName="extract"
Sep 10 21:24:21.384832 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.384765    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd67c222-cd88-40ef-a076-6f78d6ec73d9" containerName="extract"
Sep 10 21:24:21.384832 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.384772    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd67c222-cd88-40ef-a076-6f78d6ec73d9" containerName="pull"
Sep 10 21:24:21.384832 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.384779    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd67c222-cd88-40ef-a076-6f78d6ec73d9" containerName="pull"
Sep 10 21:24:21.385016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.384836    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd67c222-cd88-40ef-a076-6f78d6ec73d9" containerName="extract"
Sep 10 21:24:21.433002 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.432976    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929"]
Sep 10 21:24:21.433132 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.433061    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929"
Sep 10 21:24:21.437310 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.437290    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-skv77\""
Sep 10 21:24:21.437436 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.437417    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:24:21.437520 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.437500    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 21:24:21.511435 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.511415    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5c7e619-3acb-44c7-a8da-06880b0d8c7e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg929\" (UID: \"e5c7e619-3acb-44c7-a8da-06880b0d8c7e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929"
Sep 10 21:24:21.511544 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.511449    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkn4b\" (UniqueName: \"kubernetes.io/projected/e5c7e619-3acb-44c7-a8da-06880b0d8c7e-kube-api-access-wkn4b\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg929\" (UID: \"e5c7e619-3acb-44c7-a8da-06880b0d8c7e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929"
Sep 10 21:24:21.612157 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.612128    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5c7e619-3acb-44c7-a8da-06880b0d8c7e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg929\" (UID: \"e5c7e619-3acb-44c7-a8da-06880b0d8c7e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929"
Sep 10 21:24:21.612286 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.612163    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkn4b\" (UniqueName: \"kubernetes.io/projected/e5c7e619-3acb-44c7-a8da-06880b0d8c7e-kube-api-access-wkn4b\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg929\" (UID: \"e5c7e619-3acb-44c7-a8da-06880b0d8c7e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929"
Sep 10 21:24:21.612513 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.612494    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5c7e619-3acb-44c7-a8da-06880b0d8c7e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg929\" (UID: \"e5c7e619-3acb-44c7-a8da-06880b0d8c7e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929"
Sep 10 21:24:21.632296 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.632271    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkn4b\" (UniqueName: \"kubernetes.io/projected/e5c7e619-3acb-44c7-a8da-06880b0d8c7e-kube-api-access-wkn4b\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg929\" (UID: \"e5c7e619-3acb-44c7-a8da-06880b0d8c7e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929"
Sep 10 21:24:21.742061 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:21.742005    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929"
Sep 10 21:24:22.040156 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:22.040130    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929"]
Sep 10 21:24:22.042191 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:24:22.042160    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c7e619_3acb_44c7_a8da_06880b0d8c7e.slice/crio-86a43c2530f286802494f1edb034291e93be7c1c147414bc1ded562b62530f3d WatchSource:0}: Error finding container 86a43c2530f286802494f1edb034291e93be7c1c147414bc1ded562b62530f3d: Status 404 returned error can't find the container with id 86a43c2530f286802494f1edb034291e93be7c1c147414bc1ded562b62530f3d
Sep 10 21:24:22.044875 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:22.044859    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:24:22.772587 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:22.772552    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929" event={"ID":"e5c7e619-3acb-44c7-a8da-06880b0d8c7e","Type":"ContainerStarted","Data":"86a43c2530f286802494f1edb034291e93be7c1c147414bc1ded562b62530f3d"}
Sep 10 21:24:24.783986 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:24.783949    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929" event={"ID":"e5c7e619-3acb-44c7-a8da-06880b0d8c7e","Type":"ContainerStarted","Data":"10705ec78e3054d935a6f3feb5e7bfc513e6b284a9704a15e80d7447a349e218"}
Sep 10 21:24:24.806632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:24.806576    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg929" podStartSLOduration=1.985926391 podStartE2EDuration="3.806557107s" totalImagesPullingTime="1.820630716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:24:24.80581995 +0000 UTC m=+315.008150534" watchObservedRunningTime="2026-09-10 21:24:24.806557107 +0000 UTC m=+315.008887670"
Sep 10 21:24:25.892348 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:25.892310    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"]
Sep 10 21:24:25.894809 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:25.894792    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:25.897113 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:25.897089    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:24:25.897113 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:25.897094    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:24:25.897393 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:25.897379    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zt45\""
Sep 10 21:24:25.906213 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:25.904485    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"]
Sep 10 21:24:25.944892 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:25.944867    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mjbv\" (UniqueName: \"kubernetes.io/projected/303ad85e-eec5-49ac-803f-9ea753883a43-kube-api-access-4mjbv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:25.945016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:25.944913    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:25.945016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:25.944935    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:26.046184 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:26.046157    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mjbv\" (UniqueName: \"kubernetes.io/projected/303ad85e-eec5-49ac-803f-9ea753883a43-kube-api-access-4mjbv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:26.046324 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:26.046220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:26.046324 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:26.046243    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:26.046556 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:26.046517    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:26.046641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:26.046592    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:26.058056 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:26.058027    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mjbv\" (UniqueName: \"kubernetes.io/projected/303ad85e-eec5-49ac-803f-9ea753883a43-kube-api-access-4mjbv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:26.207096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:26.207027    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:26.478448 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:26.478268    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"]
Sep 10 21:24:26.480680 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:24:26.480653    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303ad85e_eec5_49ac_803f_9ea753883a43.slice/crio-1b5bff7b6fbf55b307a3a930a51e590dd7918ad3c0c76db4b61e91ad8b389bb2 WatchSource:0}: Error finding container 1b5bff7b6fbf55b307a3a930a51e590dd7918ad3c0c76db4b61e91ad8b389bb2: Status 404 returned error can't find the container with id 1b5bff7b6fbf55b307a3a930a51e590dd7918ad3c0c76db4b61e91ad8b389bb2
Sep 10 21:24:26.793997 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:26.793916    2568 generic.go:356] "Generic (PLEG): container finished" podID="303ad85e-eec5-49ac-803f-9ea753883a43" containerID="abe2a91fdfda633e3cf68c798b256e5882bcb6529b11f755dc7dee33118c9418" exitCode=0
Sep 10 21:24:26.793997 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:26.793970    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw" event={"ID":"303ad85e-eec5-49ac-803f-9ea753883a43","Type":"ContainerDied","Data":"abe2a91fdfda633e3cf68c798b256e5882bcb6529b11f755dc7dee33118c9418"}
Sep 10 21:24:26.794175 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:26.794011    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw" event={"ID":"303ad85e-eec5-49ac-803f-9ea753883a43","Type":"ContainerStarted","Data":"1b5bff7b6fbf55b307a3a930a51e590dd7918ad3c0c76db4b61e91ad8b389bb2"}
Sep 10 21:24:27.277931 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.277882    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq"]
Sep 10 21:24:27.280348 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.280324    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq"
Sep 10 21:24:27.282651 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.282613    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 21:24:27.282753 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.282723    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 21:24:27.282804 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.282725    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kstfl\""
Sep 10 21:24:27.290153 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.290119    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq"]
Sep 10 21:24:27.357216 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.357108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nnfc\" (UniqueName: \"kubernetes.io/projected/0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3-kube-api-access-6nnfc\") pod \"cert-manager-cainjector-559cdd8c87-fpxcq\" (UID: \"0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq"
Sep 10 21:24:27.357216 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.357176    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fpxcq\" (UID: \"0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq"
Sep 10 21:24:27.458297 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.458264    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nnfc\" (UniqueName: \"kubernetes.io/projected/0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3-kube-api-access-6nnfc\") pod \"cert-manager-cainjector-559cdd8c87-fpxcq\" (UID: \"0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq"
Sep 10 21:24:27.458460 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.458320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fpxcq\" (UID: \"0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq"
Sep 10 21:24:27.466881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.466855    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fpxcq\" (UID: \"0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq"
Sep 10 21:24:27.466881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.466870    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nnfc\" (UniqueName: \"kubernetes.io/projected/0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3-kube-api-access-6nnfc\") pod \"cert-manager-cainjector-559cdd8c87-fpxcq\" (UID: \"0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq"
Sep 10 21:24:27.595921 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.595893    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq"
Sep 10 21:24:27.875187 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:27.875113    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq"]
Sep 10 21:24:28.541568 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:24:28.541529    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d0fc7ae_8c3b_4d95_a9e9_dea9f7c3b4e3.slice/crio-5c185094f1e27de6d3e0755eb83de7080ac22f6be3518a568e1f2647a8f2ce55 WatchSource:0}: Error finding container 5c185094f1e27de6d3e0755eb83de7080ac22f6be3518a568e1f2647a8f2ce55: Status 404 returned error can't find the container with id 5c185094f1e27de6d3e0755eb83de7080ac22f6be3518a568e1f2647a8f2ce55
Sep 10 21:24:28.806443 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:28.806413    2568 generic.go:356] "Generic (PLEG): container finished" podID="303ad85e-eec5-49ac-803f-9ea753883a43" containerID="2d5db8388f1fb8ee79f8f33516645b43072ed0ce725d4b976eea9eb682623fcc" exitCode=0
Sep 10 21:24:28.806582 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:28.806503    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw" event={"ID":"303ad85e-eec5-49ac-803f-9ea753883a43","Type":"ContainerDied","Data":"2d5db8388f1fb8ee79f8f33516645b43072ed0ce725d4b976eea9eb682623fcc"}
Sep 10 21:24:28.807758 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:28.807738    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq" event={"ID":"0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3","Type":"ContainerStarted","Data":"5c185094f1e27de6d3e0755eb83de7080ac22f6be3518a568e1f2647a8f2ce55"}
Sep 10 21:24:29.815884 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:29.815851    2568 generic.go:356] "Generic (PLEG): container finished" podID="303ad85e-eec5-49ac-803f-9ea753883a43" containerID="efacf333cb7e44c0e2b2925fde5b43d5ac8491efc9d17e2ac05e3aae084720cb" exitCode=0
Sep 10 21:24:29.816293 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:29.815923    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw" event={"ID":"303ad85e-eec5-49ac-803f-9ea753883a43","Type":"ContainerDied","Data":"efacf333cb7e44c0e2b2925fde5b43d5ac8491efc9d17e2ac05e3aae084720cb"}
Sep 10 21:24:31.164757 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.164732    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:31.286126 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.286098    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-util\") pod \"303ad85e-eec5-49ac-803f-9ea753883a43\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") "
Sep 10 21:24:31.286271 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.286238    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-bundle\") pod \"303ad85e-eec5-49ac-803f-9ea753883a43\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") "
Sep 10 21:24:31.286344 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.286288    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mjbv\" (UniqueName: \"kubernetes.io/projected/303ad85e-eec5-49ac-803f-9ea753883a43-kube-api-access-4mjbv\") pod \"303ad85e-eec5-49ac-803f-9ea753883a43\" (UID: \"303ad85e-eec5-49ac-803f-9ea753883a43\") "
Sep 10 21:24:31.286860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.286592    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-bundle" (OuterVolumeSpecName: "bundle") pod "303ad85e-eec5-49ac-803f-9ea753883a43" (UID: "303ad85e-eec5-49ac-803f-9ea753883a43"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:24:31.286978 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.286877    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:24:31.288558 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.288536    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/303ad85e-eec5-49ac-803f-9ea753883a43-kube-api-access-4mjbv" (OuterVolumeSpecName: "kube-api-access-4mjbv") pod "303ad85e-eec5-49ac-803f-9ea753883a43" (UID: "303ad85e-eec5-49ac-803f-9ea753883a43"). InnerVolumeSpecName "kube-api-access-4mjbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:24:31.292210 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.292178    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-util" (OuterVolumeSpecName: "util") pod "303ad85e-eec5-49ac-803f-9ea753883a43" (UID: "303ad85e-eec5-49ac-803f-9ea753883a43"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:24:31.387884 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.387852    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mjbv\" (UniqueName: \"kubernetes.io/projected/303ad85e-eec5-49ac-803f-9ea753883a43-kube-api-access-4mjbv\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:24:31.387884 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.387890    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/303ad85e-eec5-49ac-803f-9ea753883a43-util\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:24:31.828104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.828068    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw" event={"ID":"303ad85e-eec5-49ac-803f-9ea753883a43","Type":"ContainerDied","Data":"1b5bff7b6fbf55b307a3a930a51e590dd7918ad3c0c76db4b61e91ad8b389bb2"}
Sep 10 21:24:31.828301 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.828120    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b5bff7b6fbf55b307a3a930a51e590dd7918ad3c0c76db4b61e91ad8b389bb2"
Sep 10 21:24:31.828301 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.828087    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvzzgw"
Sep 10 21:24:31.829790 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.829750    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq" event={"ID":"0d0fc7ae-8c3b-4d95-a9e9-dea9f7c3b4e3","Type":"ContainerStarted","Data":"f1f3d7b15d7523c7de4b323d0759a00b09734fde0140262666beac2cbb2c2858"}
Sep 10 21:24:31.845726 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:31.845683    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fpxcq" podStartSLOduration=2.20798797 podStartE2EDuration="4.845671145s" totalImagesPullingTime="2.637683175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:24:31.843718616 +0000 UTC m=+322.046049190" watchObservedRunningTime="2026-09-10 21:24:31.845671145 +0000 UTC m=+322.048001715"
Sep 10 21:24:35.728260 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.728229    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4tvbl"]
Sep 10 21:24:35.728618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.728569    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="303ad85e-eec5-49ac-803f-9ea753883a43" containerName="pull"
Sep 10 21:24:35.728618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.728582    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="303ad85e-eec5-49ac-803f-9ea753883a43" containerName="pull"
Sep 10 21:24:35.728618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.728591    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="303ad85e-eec5-49ac-803f-9ea753883a43" containerName="extract"
Sep 10 21:24:35.728618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.728596    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="303ad85e-eec5-49ac-803f-9ea753883a43" containerName="extract"
Sep 10 21:24:35.728618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.728608    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="303ad85e-eec5-49ac-803f-9ea753883a43" containerName="util"
Sep 10 21:24:35.728618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.728614    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="303ad85e-eec5-49ac-803f-9ea753883a43" containerName="util"
Sep 10 21:24:35.728802 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.728670    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="303ad85e-eec5-49ac-803f-9ea753883a43" containerName="extract"
Sep 10 21:24:35.731487 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.731471    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4tvbl"
Sep 10 21:24:35.733742 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.733719    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-96s2j\""
Sep 10 21:24:35.738686 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.738665    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4tvbl"]
Sep 10 21:24:35.821569 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.821536    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72hdv\" (UniqueName: \"kubernetes.io/projected/6f69e498-acf2-41fb-932b-60c7efa40dc2-kube-api-access-72hdv\") pod \"cert-manager-55b4d954d5-4tvbl\" (UID: \"6f69e498-acf2-41fb-932b-60c7efa40dc2\") " pod="cert-manager/cert-manager-55b4d954d5-4tvbl"
Sep 10 21:24:35.821711 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.821585    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f69e498-acf2-41fb-932b-60c7efa40dc2-bound-sa-token\") pod \"cert-manager-55b4d954d5-4tvbl\" (UID: \"6f69e498-acf2-41fb-932b-60c7efa40dc2\") " pod="cert-manager/cert-manager-55b4d954d5-4tvbl"
Sep 10 21:24:35.922781 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.922752    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72hdv\" (UniqueName: \"kubernetes.io/projected/6f69e498-acf2-41fb-932b-60c7efa40dc2-kube-api-access-72hdv\") pod \"cert-manager-55b4d954d5-4tvbl\" (UID: \"6f69e498-acf2-41fb-932b-60c7efa40dc2\") " pod="cert-manager/cert-manager-55b4d954d5-4tvbl"
Sep 10 21:24:35.922903 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.922799    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f69e498-acf2-41fb-932b-60c7efa40dc2-bound-sa-token\") pod \"cert-manager-55b4d954d5-4tvbl\" (UID: \"6f69e498-acf2-41fb-932b-60c7efa40dc2\") " pod="cert-manager/cert-manager-55b4d954d5-4tvbl"
Sep 10 21:24:35.930686 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.930662    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f69e498-acf2-41fb-932b-60c7efa40dc2-bound-sa-token\") pod \"cert-manager-55b4d954d5-4tvbl\" (UID: \"6f69e498-acf2-41fb-932b-60c7efa40dc2\") " pod="cert-manager/cert-manager-55b4d954d5-4tvbl"
Sep 10 21:24:35.930791 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:35.930741    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72hdv\" (UniqueName: \"kubernetes.io/projected/6f69e498-acf2-41fb-932b-60c7efa40dc2-kube-api-access-72hdv\") pod \"cert-manager-55b4d954d5-4tvbl\" (UID: \"6f69e498-acf2-41fb-932b-60c7efa40dc2\") " pod="cert-manager/cert-manager-55b4d954d5-4tvbl"
Sep 10 21:24:36.041171 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:36.041113    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4tvbl"
Sep 10 21:24:36.311003 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:36.310977    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4tvbl"]
Sep 10 21:24:36.313149 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:24:36.313122    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f69e498_acf2_41fb_932b_60c7efa40dc2.slice/crio-d531b81369ef75be112781947084f7c5f355cb5a3c07ee5585a77ca04e19b3dd WatchSource:0}: Error finding container d531b81369ef75be112781947084f7c5f355cb5a3c07ee5585a77ca04e19b3dd: Status 404 returned error can't find the container with id d531b81369ef75be112781947084f7c5f355cb5a3c07ee5585a77ca04e19b3dd
Sep 10 21:24:36.853830 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:36.853796    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4tvbl" event={"ID":"6f69e498-acf2-41fb-932b-60c7efa40dc2","Type":"ContainerStarted","Data":"94e86df33df83b6eced4c41bb242a4491f434856b96fff3fad1d4906fa5ce1d1"}
Sep 10 21:24:36.854191 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:36.853836    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4tvbl" event={"ID":"6f69e498-acf2-41fb-932b-60c7efa40dc2","Type":"ContainerStarted","Data":"d531b81369ef75be112781947084f7c5f355cb5a3c07ee5585a77ca04e19b3dd"}
Sep 10 21:24:36.870101 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:36.870054    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4tvbl" podStartSLOduration=1.8700403780000001 podStartE2EDuration="1.870040378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:24:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:24:36.868303745 +0000 UTC m=+327.070634318" watchObservedRunningTime="2026-09-10 21:24:36.870040378 +0000 UTC m=+327.072370949"
Sep 10 21:24:38.661262 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.661230    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t"]
Sep 10 21:24:38.664489 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.664472    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t"
Sep 10 21:24:38.666870 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.666843    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 21:24:38.666870 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.666842    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:24:38.667750 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.667724    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qjt7h\""
Sep 10 21:24:38.673943 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.673918    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t"]
Sep 10 21:24:38.746799 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.746769    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjndq\" (UniqueName: \"kubernetes.io/projected/64ce1aca-d4df-4bf4-ab90-999520a4efae-kube-api-access-fjndq\") pod \"openshift-lws-operator-fd8ccff4c-v8f5t\" (UID: \"64ce1aca-d4df-4bf4-ab90-999520a4efae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t"
Sep 10 21:24:38.746911 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.746806    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64ce1aca-d4df-4bf4-ab90-999520a4efae-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v8f5t\" (UID: \"64ce1aca-d4df-4bf4-ab90-999520a4efae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t"
Sep 10 21:24:38.848001 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.847974    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjndq\" (UniqueName: \"kubernetes.io/projected/64ce1aca-d4df-4bf4-ab90-999520a4efae-kube-api-access-fjndq\") pod \"openshift-lws-operator-fd8ccff4c-v8f5t\" (UID: \"64ce1aca-d4df-4bf4-ab90-999520a4efae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t"
Sep 10 21:24:38.848110 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.848009    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64ce1aca-d4df-4bf4-ab90-999520a4efae-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v8f5t\" (UID: \"64ce1aca-d4df-4bf4-ab90-999520a4efae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t"
Sep 10 21:24:38.848435 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.848419    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64ce1aca-d4df-4bf4-ab90-999520a4efae-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v8f5t\" (UID: \"64ce1aca-d4df-4bf4-ab90-999520a4efae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t"
Sep 10 21:24:38.857526 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.857511    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjndq\" (UniqueName: \"kubernetes.io/projected/64ce1aca-d4df-4bf4-ab90-999520a4efae-kube-api-access-fjndq\") pod \"openshift-lws-operator-fd8ccff4c-v8f5t\" (UID: \"64ce1aca-d4df-4bf4-ab90-999520a4efae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t"
Sep 10 21:24:38.973721 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:38.973665    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t"
Sep 10 21:24:39.241139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:39.241068    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t"]
Sep 10 21:24:39.244296 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:24:39.244265    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64ce1aca_d4df_4bf4_ab90_999520a4efae.slice/crio-7c1d4c4ddf6e7a3dd5de5228beb88a963eeafd1da67e898df96f5bed3db53326 WatchSource:0}: Error finding container 7c1d4c4ddf6e7a3dd5de5228beb88a963eeafd1da67e898df96f5bed3db53326: Status 404 returned error can't find the container with id 7c1d4c4ddf6e7a3dd5de5228beb88a963eeafd1da67e898df96f5bed3db53326
Sep 10 21:24:39.869558 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:39.869516    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t" event={"ID":"64ce1aca-d4df-4bf4-ab90-999520a4efae","Type":"ContainerStarted","Data":"7c1d4c4ddf6e7a3dd5de5228beb88a963eeafd1da67e898df96f5bed3db53326"}
Sep 10 21:24:40.876586 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:40.876547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t" event={"ID":"64ce1aca-d4df-4bf4-ab90-999520a4efae","Type":"ContainerStarted","Data":"c7c5f7a1944de4ab354f5d02e235f798ff0ca543c08d32633ff44f9a183c92b9"}
Sep 10 21:24:40.897293 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:40.897240    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v8f5t" podStartSLOduration=1.454188675 podStartE2EDuration="2.897226371s" totalImagesPullingTime="1.443037696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:24:40.895117303 +0000 UTC m=+331.097447875" watchObservedRunningTime="2026-09-10 21:24:40.897226371 +0000 UTC m=+331.099556943"
Sep 10 21:24:46.233650 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.233617    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"]
Sep 10 21:24:46.236052 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.236034    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:46.238460 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.238427    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zt45\""
Sep 10 21:24:46.238876 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.238836    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:24:46.239274 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.239248    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:24:46.247674 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.247647    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"]
Sep 10 21:24:46.302825 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.302795    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:46.302949 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.302854    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfx27\" (UniqueName: \"kubernetes.io/projected/3484b286-885b-4b2d-8655-f8a95096dd6a-kube-api-access-kfx27\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:46.302949 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.302919    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:46.403293 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.403266    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfx27\" (UniqueName: \"kubernetes.io/projected/3484b286-885b-4b2d-8655-f8a95096dd6a-kube-api-access-kfx27\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:46.403402 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.403314    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:46.403518 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.403495    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:46.403700 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.403685    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:46.403796 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.403780    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:46.411438 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.411420    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfx27\" (UniqueName: \"kubernetes.io/projected/3484b286-885b-4b2d-8655-f8a95096dd6a-kube-api-access-kfx27\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:46.548747 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.548692    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:46.816747 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.816726    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"]
Sep 10 21:24:46.818773 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:24:46.818744    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3484b286_885b_4b2d_8655_f8a95096dd6a.slice/crio-daf3d9003211258cac307dcf2d79525c29c66252b9242671657948376585f0aa WatchSource:0}: Error finding container daf3d9003211258cac307dcf2d79525c29c66252b9242671657948376585f0aa: Status 404 returned error can't find the container with id daf3d9003211258cac307dcf2d79525c29c66252b9242671657948376585f0aa
Sep 10 21:24:46.908245 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.908187    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b" event={"ID":"3484b286-885b-4b2d-8655-f8a95096dd6a","Type":"ContainerStarted","Data":"cc72823013b98c8bc47e430ab9d1324aa38fa2a6dabbc43c808d969cfe90864c"}
Sep 10 21:24:46.908407 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:46.908269    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b" event={"ID":"3484b286-885b-4b2d-8655-f8a95096dd6a","Type":"ContainerStarted","Data":"daf3d9003211258cac307dcf2d79525c29c66252b9242671657948376585f0aa"}
Sep 10 21:24:47.913668 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:47.913632    2568 generic.go:356] "Generic (PLEG): container finished" podID="3484b286-885b-4b2d-8655-f8a95096dd6a" containerID="cc72823013b98c8bc47e430ab9d1324aa38fa2a6dabbc43c808d969cfe90864c" exitCode=0
Sep 10 21:24:47.914087 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:47.913713    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b" event={"ID":"3484b286-885b-4b2d-8655-f8a95096dd6a","Type":"ContainerDied","Data":"cc72823013b98c8bc47e430ab9d1324aa38fa2a6dabbc43c808d969cfe90864c"}
Sep 10 21:24:48.920729 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:48.920698    2568 generic.go:356] "Generic (PLEG): container finished" podID="3484b286-885b-4b2d-8655-f8a95096dd6a" containerID="b98c0c64cbd5a340578416e5aad507987d1666c83b25ecc03602264c62ab3fff" exitCode=0
Sep 10 21:24:48.921115 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:48.920781    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b" event={"ID":"3484b286-885b-4b2d-8655-f8a95096dd6a","Type":"ContainerDied","Data":"b98c0c64cbd5a340578416e5aad507987d1666c83b25ecc03602264c62ab3fff"}
Sep 10 21:24:49.927730 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:49.927695    2568 generic.go:356] "Generic (PLEG): container finished" podID="3484b286-885b-4b2d-8655-f8a95096dd6a" containerID="b21fcfbae35d46cd268f8b0c79175aff067d27c64647b9ceeaf36ef99a7535b6" exitCode=0
Sep 10 21:24:49.928130 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:49.927785    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b" event={"ID":"3484b286-885b-4b2d-8655-f8a95096dd6a","Type":"ContainerDied","Data":"b21fcfbae35d46cd268f8b0c79175aff067d27c64647b9ceeaf36ef99a7535b6"}
Sep 10 21:24:51.055036 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.055013    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:51.138339 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.138313    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-util\") pod \"3484b286-885b-4b2d-8655-f8a95096dd6a\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") "
Sep 10 21:24:51.138465 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.138383    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-bundle\") pod \"3484b286-885b-4b2d-8655-f8a95096dd6a\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") "
Sep 10 21:24:51.138465 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.138421    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfx27\" (UniqueName: \"kubernetes.io/projected/3484b286-885b-4b2d-8655-f8a95096dd6a-kube-api-access-kfx27\") pod \"3484b286-885b-4b2d-8655-f8a95096dd6a\" (UID: \"3484b286-885b-4b2d-8655-f8a95096dd6a\") "
Sep 10 21:24:51.139066 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.139033    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-bundle" (OuterVolumeSpecName: "bundle") pod "3484b286-885b-4b2d-8655-f8a95096dd6a" (UID: "3484b286-885b-4b2d-8655-f8a95096dd6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:24:51.140421 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.140399    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3484b286-885b-4b2d-8655-f8a95096dd6a-kube-api-access-kfx27" (OuterVolumeSpecName: "kube-api-access-kfx27") pod "3484b286-885b-4b2d-8655-f8a95096dd6a" (UID: "3484b286-885b-4b2d-8655-f8a95096dd6a"). InnerVolumeSpecName "kube-api-access-kfx27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:24:51.143948 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.143907    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-util" (OuterVolumeSpecName: "util") pod "3484b286-885b-4b2d-8655-f8a95096dd6a" (UID: "3484b286-885b-4b2d-8655-f8a95096dd6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:24:51.239135 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.239079    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:24:51.239135 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.239104    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfx27\" (UniqueName: \"kubernetes.io/projected/3484b286-885b-4b2d-8655-f8a95096dd6a-kube-api-access-kfx27\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:24:51.239135 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.239115    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3484b286-885b-4b2d-8655-f8a95096dd6a-util\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:24:51.938981 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.938955    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b"
Sep 10 21:24:51.939174 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.938954    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn5n4b" event={"ID":"3484b286-885b-4b2d-8655-f8a95096dd6a","Type":"ContainerDied","Data":"daf3d9003211258cac307dcf2d79525c29c66252b9242671657948376585f0aa"}
Sep 10 21:24:51.939174 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:51.939071    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daf3d9003211258cac307dcf2d79525c29c66252b9242671657948376585f0aa"
Sep 10 21:24:56.670035 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.669985    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"]
Sep 10 21:24:56.670790 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.670495    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3484b286-885b-4b2d-8655-f8a95096dd6a" containerName="util"
Sep 10 21:24:56.670790 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.670514    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3484b286-885b-4b2d-8655-f8a95096dd6a" containerName="util"
Sep 10 21:24:56.670790 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.670557    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3484b286-885b-4b2d-8655-f8a95096dd6a" containerName="extract"
Sep 10 21:24:56.670790 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.670566    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3484b286-885b-4b2d-8655-f8a95096dd6a" containerName="extract"
Sep 10 21:24:56.670790 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.670597    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3484b286-885b-4b2d-8655-f8a95096dd6a" containerName="pull"
Sep 10 21:24:56.670790 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.670605    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3484b286-885b-4b2d-8655-f8a95096dd6a" containerName="pull"
Sep 10 21:24:56.670790 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.670699    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3484b286-885b-4b2d-8655-f8a95096dd6a" containerName="extract"
Sep 10 21:24:56.676305 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.676282    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:24:56.678724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.678704    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:24:56.679742 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.679720    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zt45\""
Sep 10 21:24:56.679885 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.679783    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:24:56.681958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.681933    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"]
Sep 10 21:24:56.782246 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.782219    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9677x\" (UniqueName: \"kubernetes.io/projected/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-kube-api-access-9677x\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:24:56.782407 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.782288    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:24:56.782407 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.782349    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:24:56.883523 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.883483    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:24:56.883674 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.883537    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:24:56.883674 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.883577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9677x\" (UniqueName: \"kubernetes.io/projected/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-kube-api-access-9677x\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:24:56.883938 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.883912    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:24:56.883994 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.883920    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:24:56.891256 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.891233    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9677x\" (UniqueName: \"kubernetes.io/projected/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-kube-api-access-9677x\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:24:56.990632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:56.990560    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:24:57.264735 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:57.264710    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"]
Sep 10 21:24:57.266558 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:24:57.266530    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1e41ff_1d89_48f7_9949_6b89e5d2d1b4.slice/crio-b4da75207a9caf907e848196051fe5dc85434e9fc9fd6ed554c84bde96b55c1b WatchSource:0}: Error finding container b4da75207a9caf907e848196051fe5dc85434e9fc9fd6ed554c84bde96b55c1b: Status 404 returned error can't find the container with id b4da75207a9caf907e848196051fe5dc85434e9fc9fd6ed554c84bde96b55c1b
Sep 10 21:24:57.966525 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:57.966493    2568 generic.go:356] "Generic (PLEG): container finished" podID="6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" containerID="92a06324353d09db6c0fab06610832e4ab3d3979ab1776de7265bce4c0015ef2" exitCode=0
Sep 10 21:24:57.966870 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:57.966551    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx" event={"ID":"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4","Type":"ContainerDied","Data":"92a06324353d09db6c0fab06610832e4ab3d3979ab1776de7265bce4c0015ef2"}
Sep 10 21:24:57.966870 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:57.966595    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx" event={"ID":"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4","Type":"ContainerStarted","Data":"b4da75207a9caf907e848196051fe5dc85434e9fc9fd6ed554c84bde96b55c1b"}
Sep 10 21:24:58.793104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.793076    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"]
Sep 10 21:24:58.796405 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.796367    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:58.799720 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.799700    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 21:24:58.800038 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.799904    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 21:24:58.800228 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.800194    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 21:24:58.800332 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.800225    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jn67t\""
Sep 10 21:24:58.800332 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.800301    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 21:24:58.825351 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.825329    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"]
Sep 10 21:24:58.899239 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.899213    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f16b6ddc-b350-48c7-a25b-f411445bef34-webhook-cert\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:58.899351 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.899245    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4tnx\" (UniqueName: \"kubernetes.io/projected/f16b6ddc-b350-48c7-a25b-f411445bef34-kube-api-access-d4tnx\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:58.899351 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.899319    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f16b6ddc-b350-48c7-a25b-f411445bef34-manifests\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:58.899429 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.899361    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f16b6ddc-b350-48c7-a25b-f411445bef34-tmp\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:58.899429 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.899383    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f16b6ddc-b350-48c7-a25b-f411445bef34-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:58.974059 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.974034    2568 generic.go:356] "Generic (PLEG): container finished" podID="6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" containerID="5738e1214c4d59fb8b7002f25403d3d8ccbb2084e44a33e3450119abadafc719" exitCode=0
Sep 10 21:24:58.974418 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:58.974113    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx" event={"ID":"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4","Type":"ContainerDied","Data":"5738e1214c4d59fb8b7002f25403d3d8ccbb2084e44a33e3450119abadafc719"}
Sep 10 21:24:59.000699 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.000678    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f16b6ddc-b350-48c7-a25b-f411445bef34-manifests\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:59.000793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.000717    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f16b6ddc-b350-48c7-a25b-f411445bef34-tmp\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:59.000793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.000734    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f16b6ddc-b350-48c7-a25b-f411445bef34-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:59.000793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.000787    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f16b6ddc-b350-48c7-a25b-f411445bef34-webhook-cert\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:59.000935 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.000807    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4tnx\" (UniqueName: \"kubernetes.io/projected/f16b6ddc-b350-48c7-a25b-f411445bef34-kube-api-access-d4tnx\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:59.001105 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.001076    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f16b6ddc-b350-48c7-a25b-f411445bef34-manifests\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:59.002757 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.002722    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f16b6ddc-b350-48c7-a25b-f411445bef34-tmp\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:59.003187 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.003167    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f16b6ddc-b350-48c7-a25b-f411445bef34-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:59.003266 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.003167    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f16b6ddc-b350-48c7-a25b-f411445bef34-webhook-cert\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:59.008963 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.008942    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4tnx\" (UniqueName: \"kubernetes.io/projected/f16b6ddc-b350-48c7-a25b-f411445bef34-kube-api-access-d4tnx\") pod \"opendatahub-operator-controller-manager-56fc979fdc-29x7b\" (UID: \"f16b6ddc-b350-48c7-a25b-f411445bef34\") " pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:59.107294 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.107266    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:24:59.388977 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.388949    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"]
Sep 10 21:24:59.390761 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:24:59.390736    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16b6ddc_b350_48c7_a25b_f411445bef34.slice/crio-9e6dc624299a78f2d79cc0cfa6cfee90707772cf628f7e0631d228e6da06f7a5 WatchSource:0}: Error finding container 9e6dc624299a78f2d79cc0cfa6cfee90707772cf628f7e0631d228e6da06f7a5: Status 404 returned error can't find the container with id 9e6dc624299a78f2d79cc0cfa6cfee90707772cf628f7e0631d228e6da06f7a5
Sep 10 21:24:59.985657 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.985383    2568 generic.go:356] "Generic (PLEG): container finished" podID="6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" containerID="eb23b84d19748b63a8ee2cb18b0e5993519f4bdac20d9f658ac6ab3bb26581bf" exitCode=0
Sep 10 21:24:59.986133 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.985659    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx" event={"ID":"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4","Type":"ContainerDied","Data":"eb23b84d19748b63a8ee2cb18b0e5993519f4bdac20d9f658ac6ab3bb26581bf"}
Sep 10 21:24:59.987322 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:24:59.987286    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b" event={"ID":"f16b6ddc-b350-48c7-a25b-f411445bef34","Type":"ContainerStarted","Data":"9e6dc624299a78f2d79cc0cfa6cfee90707772cf628f7e0631d228e6da06f7a5"}
Sep 10 21:25:02.320400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:02.320375    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:25:02.430480 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:02.430448    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-bundle\") pod \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") "
Sep 10 21:25:02.430569 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:02.430513    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-util\") pod \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") "
Sep 10 21:25:02.430634 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:02.430574    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9677x\" (UniqueName: \"kubernetes.io/projected/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-kube-api-access-9677x\") pod \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\" (UID: \"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4\") "
Sep 10 21:25:02.431209 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:02.431167    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-bundle" (OuterVolumeSpecName: "bundle") pod "6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" (UID: "6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:02.432658 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:02.432627    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-kube-api-access-9677x" (OuterVolumeSpecName: "kube-api-access-9677x") pod "6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" (UID: "6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4"). InnerVolumeSpecName "kube-api-access-9677x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:02.437872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:02.437845    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-util" (OuterVolumeSpecName: "util") pod "6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" (UID: "6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:02.531908 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:02.531887    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9677x\" (UniqueName: \"kubernetes.io/projected/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-kube-api-access-9677x\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:25:02.531908 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:02.531907    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:25:02.532030 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:02.531918    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4-util\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:25:03.006170 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:03.006069    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b" event={"ID":"f16b6ddc-b350-48c7-a25b-f411445bef34","Type":"ContainerStarted","Data":"32dad66b6740c91c8965af459812c55dbcc088894f489b69469616f7d03f2ca2"}
Sep 10 21:25:03.007896 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:03.007865    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx" event={"ID":"6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4","Type":"ContainerDied","Data":"b4da75207a9caf907e848196051fe5dc85434e9fc9fd6ed554c84bde96b55c1b"}
Sep 10 21:25:03.007896 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:03.007892    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wcxtx"
Sep 10 21:25:03.008040 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:03.007905    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4da75207a9caf907e848196051fe5dc85434e9fc9fd6ed554c84bde96b55c1b"
Sep 10 21:25:04.014063 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:04.014025    2568 generic.go:356] "Generic (PLEG): container finished" podID="f16b6ddc-b350-48c7-a25b-f411445bef34" containerID="32dad66b6740c91c8965af459812c55dbcc088894f489b69469616f7d03f2ca2" exitCode=0
Sep 10 21:25:04.014455 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:04.014105    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b" event={"ID":"f16b6ddc-b350-48c7-a25b-f411445bef34","Type":"ContainerDied","Data":"32dad66b6740c91c8965af459812c55dbcc088894f489b69469616f7d03f2ca2"}
Sep 10 21:25:05.021389 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:05.021356    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b" event={"ID":"f16b6ddc-b350-48c7-a25b-f411445bef34","Type":"ContainerStarted","Data":"f297a2aca026c2b2f1054675c4db4ecae2a39758409220a6f2f27969ec757a5d"}
Sep 10 21:25:05.021763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:05.021492    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:25:05.044798 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:05.044748    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b" podStartSLOduration=2.71028346 podStartE2EDuration="7.044734597s" totalImagesPullingTime="3.328671117s" totalInitContainerRuntime="1.00578002s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:24:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:25:05.043276313 +0000 UTC m=+355.245606884" watchObservedRunningTime="2026-09-10 21:25:05.044734597 +0000 UTC m=+355.247065169"
Sep 10 21:25:16.028943 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:16.028915    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56fc979fdc-29x7b"
Sep 10 21:25:18.555012 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.554973    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-745b97c954-k7w65"]
Sep 10 21:25:18.555403 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.555338    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" containerName="pull"
Sep 10 21:25:18.555403 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.555351    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" containerName="pull"
Sep 10 21:25:18.555403 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.555363    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" containerName="util"
Sep 10 21:25:18.555403 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.555369    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" containerName="util"
Sep 10 21:25:18.555403 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.555383    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" containerName="extract"
Sep 10 21:25:18.555403 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.555388    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" containerName="extract"
Sep 10 21:25:18.555622 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.555446    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a1e41ff-1d89-48f7-9949-6b89e5d2d1b4" containerName="extract"
Sep 10 21:25:18.565465 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.565445    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:18.570550 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.570526    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 21:25:18.570664 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.570527    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 21:25:18.582007 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.581986    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-745b97c954-k7w65"]
Sep 10 21:25:18.655504 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.655472    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-tls-certs\") pod \"kube-auth-proxy-745b97c954-k7w65\" (UID: \"343364d4-a6e0-4e3c-ad8b-489929d1bb6a\") " pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:18.655651 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.655512    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-tmp\") pod \"kube-auth-proxy-745b97c954-k7w65\" (UID: \"343364d4-a6e0-4e3c-ad8b-489929d1bb6a\") " pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:18.655651 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.655624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd6wr\" (UniqueName: \"kubernetes.io/projected/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-kube-api-access-wd6wr\") pod \"kube-auth-proxy-745b97c954-k7w65\" (UID: \"343364d4-a6e0-4e3c-ad8b-489929d1bb6a\") " pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:18.755989 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.755960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6wr\" (UniqueName: \"kubernetes.io/projected/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-kube-api-access-wd6wr\") pod \"kube-auth-proxy-745b97c954-k7w65\" (UID: \"343364d4-a6e0-4e3c-ad8b-489929d1bb6a\") " pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:18.756117 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.755997    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-tls-certs\") pod \"kube-auth-proxy-745b97c954-k7w65\" (UID: \"343364d4-a6e0-4e3c-ad8b-489929d1bb6a\") " pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:18.756117 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.756022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-tmp\") pod \"kube-auth-proxy-745b97c954-k7w65\" (UID: \"343364d4-a6e0-4e3c-ad8b-489929d1bb6a\") " pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:18.756236 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:25:18.756118    2568 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 10 21:25:18.756236 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:25:18.756194    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-tls-certs podName:343364d4-a6e0-4e3c-ad8b-489929d1bb6a nodeName:}" failed. No retries permitted until 2026-09-10 21:25:19.256175778 +0000 UTC m=+369.458506329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-tls-certs") pod "kube-auth-proxy-745b97c954-k7w65" (UID: "343364d4-a6e0-4e3c-ad8b-489929d1bb6a") : secret "kube-auth-proxy-tls" not found
Sep 10 21:25:18.758139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.758120    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-tmp\") pod \"kube-auth-proxy-745b97c954-k7w65\" (UID: \"343364d4-a6e0-4e3c-ad8b-489929d1bb6a\") " pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:18.768147 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:18.768127    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd6wr\" (UniqueName: \"kubernetes.io/projected/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-kube-api-access-wd6wr\") pod \"kube-auth-proxy-745b97c954-k7w65\" (UID: \"343364d4-a6e0-4e3c-ad8b-489929d1bb6a\") " pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:19.260152 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:19.260118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-tls-certs\") pod \"kube-auth-proxy-745b97c954-k7w65\" (UID: \"343364d4-a6e0-4e3c-ad8b-489929d1bb6a\") " pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:19.262499 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:19.262476    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/343364d4-a6e0-4e3c-ad8b-489929d1bb6a-tls-certs\") pod \"kube-auth-proxy-745b97c954-k7w65\" (UID: \"343364d4-a6e0-4e3c-ad8b-489929d1bb6a\") " pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:19.474799 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:19.474771    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65"
Sep 10 21:25:19.753572 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:19.753549    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-745b97c954-k7w65"]
Sep 10 21:25:19.755700 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:25:19.755670    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod343364d4_a6e0_4e3c_ad8b_489929d1bb6a.slice/crio-12b875684cd6bd7488e60a5305610ba45faf0abb455f8fe4eab0b7d37eb381f1 WatchSource:0}: Error finding container 12b875684cd6bd7488e60a5305610ba45faf0abb455f8fe4eab0b7d37eb381f1: Status 404 returned error can't find the container with id 12b875684cd6bd7488e60a5305610ba45faf0abb455f8fe4eab0b7d37eb381f1
Sep 10 21:25:20.101369 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.101333    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65" event={"ID":"343364d4-a6e0-4e3c-ad8b-489929d1bb6a","Type":"ContainerStarted","Data":"12b875684cd6bd7488e60a5305610ba45faf0abb455f8fe4eab0b7d37eb381f1"}
Sep 10 21:25:20.230494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.230465    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"]
Sep 10 21:25:20.235079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.235061    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.243615 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.243594    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 21:25:20.243720 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.243674    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 21:25:20.243776 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.243720    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 21:25:20.244464 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.244447    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 21:25:20.244534 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.244454    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-58hrr\""
Sep 10 21:25:20.268935 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.268908    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.269044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.268957    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.269088 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.269064    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78hln\" (UniqueName: \"kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-kube-api-access-78hln\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.269136 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.269098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.269136 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.269121    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.269258 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.269244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.269307 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.269269    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.275767 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.275747    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"]
Sep 10 21:25:20.369964 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.369896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.369964 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.369930    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78hln\" (UniqueName: \"kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-kube-api-access-78hln\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.369964 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.369958    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.370274 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.369983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.370417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.370391    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.370551 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.370438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.370551 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.370499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.370755 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.370725    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.373058 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.373031    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.373168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.373105    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.373313 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.373159    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.373561 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.373541    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.382570 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.382548    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.382773 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.382746    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78hln\" (UniqueName: \"kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-kube-api-access-78hln\") pod \"istiod-openshift-gateway-7b7995d5cd-ztdpb\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.544810 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.544780    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:20.832854 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:20.832559    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"]
Sep 10 21:25:20.836468 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:25:20.836435    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9375f3f1_c4b3_4acf_8912_fcd1379bf38d.slice/crio-756e19e5dff393618bd87dcf87551609f55b1ffa17abc793f47c43eaa0bf9c6d WatchSource:0}: Error finding container 756e19e5dff393618bd87dcf87551609f55b1ffa17abc793f47c43eaa0bf9c6d: Status 404 returned error can't find the container with id 756e19e5dff393618bd87dcf87551609f55b1ffa17abc793f47c43eaa0bf9c6d
Sep 10 21:25:21.109279 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:21.109176    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb" event={"ID":"9375f3f1-c4b3-4acf-8912-fcd1379bf38d","Type":"ContainerStarted","Data":"756e19e5dff393618bd87dcf87551609f55b1ffa17abc793f47c43eaa0bf9c6d"}
Sep 10 21:25:23.122249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:23.122193    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65" event={"ID":"343364d4-a6e0-4e3c-ad8b-489929d1bb6a","Type":"ContainerStarted","Data":"630425224c7ab754085e84a1b6724843592385d97eccfc82ecd381b066c9ffc7"}
Sep 10 21:25:23.140930 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:23.140884    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-745b97c954-k7w65" podStartSLOduration=2.22119323 podStartE2EDuration="5.140869338s" totalImagesPullingTime="2.919676108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:25:23.138363974 +0000 UTC m=+373.340694542" watchObservedRunningTime="2026-09-10 21:25:23.140869338 +0000 UTC m=+373.343199909"
Sep 10 21:25:24.455147 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:24.455107    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:25:24.455460 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:24.455178    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:25:25.137039 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:25.136973    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb" event={"ID":"9375f3f1-c4b3-4acf-8912-fcd1379bf38d","Type":"ContainerStarted","Data":"54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac"}
Sep 10 21:25:25.139321 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:25.139267    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:25.139872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:25.139847    2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-ztdpb container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:25:25.140081 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:25.140055    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb" podUID="9375f3f1-c4b3-4acf-8912-fcd1379bf38d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:25:25.162572 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:25.162528    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb" podStartSLOduration=1.54714272 podStartE2EDuration="5.162514422s" totalImagesPullingTime="3.615371702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:25:25.159236205 +0000 UTC m=+375.361566780" watchObservedRunningTime="2026-09-10 21:25:25.162514422 +0000 UTC m=+375.364844993"
Sep 10 21:25:26.143032 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:26.143001    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:32.622515 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.622484    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-577756c9bf-t94ds"]
Sep 10 21:25:32.627874 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.627849    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.635331 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.635310    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577756c9bf-t94ds"]
Sep 10 21:25:32.678160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.678127    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f2510b2-06d6-492d-9b81-17d0a0918fd7-console-serving-cert\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.678427 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.678405    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-oauth-serving-cert\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.678614 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.678581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f2510b2-06d6-492d-9b81-17d0a0918fd7-console-oauth-config\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.678770 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.678642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjfsd\" (UniqueName: \"kubernetes.io/projected/7f2510b2-06d6-492d-9b81-17d0a0918fd7-kube-api-access-jjfsd\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.678770 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.678670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-trusted-ca-bundle\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.678770 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.678716    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-console-config\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.678770 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.678745    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-service-ca\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.779757 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.779726    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-console-config\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.779757 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.779764    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-service-ca\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.779983 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.779826    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f2510b2-06d6-492d-9b81-17d0a0918fd7-console-serving-cert\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.779983 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.779841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-oauth-serving-cert\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.779983 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.779859    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f2510b2-06d6-492d-9b81-17d0a0918fd7-console-oauth-config\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.779983 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.779908    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfsd\" (UniqueName: \"kubernetes.io/projected/7f2510b2-06d6-492d-9b81-17d0a0918fd7-kube-api-access-jjfsd\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.779983 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.779931    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-trusted-ca-bundle\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.780615 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.780585    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-console-config\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.780748 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.780616    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-service-ca\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.780748 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.780685    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-oauth-serving-cert\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.780932 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.780912    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f2510b2-06d6-492d-9b81-17d0a0918fd7-trusted-ca-bundle\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.782556 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.782523    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f2510b2-06d6-492d-9b81-17d0a0918fd7-console-oauth-config\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.782661 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.782563    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f2510b2-06d6-492d-9b81-17d0a0918fd7-console-serving-cert\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.788576 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.788556    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjfsd\" (UniqueName: \"kubernetes.io/projected/7f2510b2-06d6-492d-9b81-17d0a0918fd7-kube-api-access-jjfsd\") pod \"console-577756c9bf-t94ds\" (UID: \"7f2510b2-06d6-492d-9b81-17d0a0918fd7\") " pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:32.939030 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:32.938945    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:33.215107 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:33.215085    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577756c9bf-t94ds"]
Sep 10 21:25:33.216773 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:25:33.216750    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2510b2_06d6_492d_9b81_17d0a0918fd7.slice/crio-472b905c0c5021e08abfafcf08009143a78547c1a5f8a7aebe0562f73231cf51 WatchSource:0}: Error finding container 472b905c0c5021e08abfafcf08009143a78547c1a5f8a7aebe0562f73231cf51: Status 404 returned error can't find the container with id 472b905c0c5021e08abfafcf08009143a78547c1a5f8a7aebe0562f73231cf51
Sep 10 21:25:34.196295 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:34.196265    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577756c9bf-t94ds" event={"ID":"7f2510b2-06d6-492d-9b81-17d0a0918fd7","Type":"ContainerStarted","Data":"40f7688c672c901c93791d1fe19d599bc479ad1f3a9bf2c48ab4a26922cd8969"}
Sep 10 21:25:34.196708 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:34.196307    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577756c9bf-t94ds" event={"ID":"7f2510b2-06d6-492d-9b81-17d0a0918fd7","Type":"ContainerStarted","Data":"472b905c0c5021e08abfafcf08009143a78547c1a5f8a7aebe0562f73231cf51"}
Sep 10 21:25:34.210800 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:34.210759    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-577756c9bf-t94ds" podStartSLOduration=2.210743563 podStartE2EDuration="2.210743563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:25:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:25:34.209561024 +0000 UTC m=+384.411891611" watchObservedRunningTime="2026-09-10 21:25:34.210743563 +0000 UTC m=+384.413074136"
Sep 10 21:25:39.516427 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.516394    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"]
Sep 10 21:25:39.522914 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.522892    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"
Sep 10 21:25:39.526321 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.526296    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 21:25:39.526432 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.526394    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9dv67\""
Sep 10 21:25:39.528366 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.528344    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"]
Sep 10 21:25:39.530531 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.530511    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"
Sep 10 21:25:39.533342 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.533323    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7b4zw\""
Sep 10 21:25:39.533469 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.533437    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 21:25:39.535954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.535932    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"]
Sep 10 21:25:39.543142 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.543118    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"]
Sep 10 21:25:39.643560 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.643533    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrp8l\" (UniqueName: \"kubernetes.io/projected/8a061114-c7aa-4b66-a83e-61a2d16fba8b-kube-api-access-nrp8l\") pod \"llmisvc-controller-manager-777c6bd7d5-hpfhj\" (UID: \"8a061114-c7aa-4b66-a83e-61a2d16fba8b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"
Sep 10 21:25:39.643690 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.643566    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a061114-c7aa-4b66-a83e-61a2d16fba8b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hpfhj\" (UID: \"8a061114-c7aa-4b66-a83e-61a2d16fba8b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"
Sep 10 21:25:39.643690 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.643593    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65ee96ae-2b1b-4538-828a-7498b50fe26d-cert\") pod \"kserve-controller-manager-d6f4b65b8-2c2gr\" (UID: \"65ee96ae-2b1b-4538-828a-7498b50fe26d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"
Sep 10 21:25:39.643785 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.643687    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r56t4\" (UniqueName: \"kubernetes.io/projected/65ee96ae-2b1b-4538-828a-7498b50fe26d-kube-api-access-r56t4\") pod \"kserve-controller-manager-d6f4b65b8-2c2gr\" (UID: \"65ee96ae-2b1b-4538-828a-7498b50fe26d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"
Sep 10 21:25:39.744482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.744461    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r56t4\" (UniqueName: \"kubernetes.io/projected/65ee96ae-2b1b-4538-828a-7498b50fe26d-kube-api-access-r56t4\") pod \"kserve-controller-manager-d6f4b65b8-2c2gr\" (UID: \"65ee96ae-2b1b-4538-828a-7498b50fe26d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"
Sep 10 21:25:39.744602 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.744519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrp8l\" (UniqueName: \"kubernetes.io/projected/8a061114-c7aa-4b66-a83e-61a2d16fba8b-kube-api-access-nrp8l\") pod \"llmisvc-controller-manager-777c6bd7d5-hpfhj\" (UID: \"8a061114-c7aa-4b66-a83e-61a2d16fba8b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"
Sep 10 21:25:39.744602 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.744541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a061114-c7aa-4b66-a83e-61a2d16fba8b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hpfhj\" (UID: \"8a061114-c7aa-4b66-a83e-61a2d16fba8b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"
Sep 10 21:25:39.744602 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.744565    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65ee96ae-2b1b-4538-828a-7498b50fe26d-cert\") pod \"kserve-controller-manager-d6f4b65b8-2c2gr\" (UID: \"65ee96ae-2b1b-4538-828a-7498b50fe26d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"
Sep 10 21:25:39.744748 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:25:39.744735    2568 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 10 21:25:39.744796 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:25:39.744787    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a061114-c7aa-4b66-a83e-61a2d16fba8b-cert podName:8a061114-c7aa-4b66-a83e-61a2d16fba8b nodeName:}" failed. No retries permitted until 2026-09-10 21:25:40.244773809 +0000 UTC m=+390.447104372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a061114-c7aa-4b66-a83e-61a2d16fba8b-cert") pod "llmisvc-controller-manager-777c6bd7d5-hpfhj" (UID: "8a061114-c7aa-4b66-a83e-61a2d16fba8b") : secret "llmisvc-webhook-server-cert" not found
Sep 10 21:25:39.744847 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:25:39.744827    2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 10 21:25:39.744895 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:25:39.744886    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ee96ae-2b1b-4538-828a-7498b50fe26d-cert podName:65ee96ae-2b1b-4538-828a-7498b50fe26d nodeName:}" failed. No retries permitted until 2026-09-10 21:25:40.244871346 +0000 UTC m=+390.447201906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/65ee96ae-2b1b-4538-828a-7498b50fe26d-cert") pod "kserve-controller-manager-d6f4b65b8-2c2gr" (UID: "65ee96ae-2b1b-4538-828a-7498b50fe26d") : secret "kserve-webhook-server-cert" not found
Sep 10 21:25:39.757071 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.757046    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrp8l\" (UniqueName: \"kubernetes.io/projected/8a061114-c7aa-4b66-a83e-61a2d16fba8b-kube-api-access-nrp8l\") pod \"llmisvc-controller-manager-777c6bd7d5-hpfhj\" (UID: \"8a061114-c7aa-4b66-a83e-61a2d16fba8b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"
Sep 10 21:25:39.757170 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:39.757151    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r56t4\" (UniqueName: \"kubernetes.io/projected/65ee96ae-2b1b-4538-828a-7498b50fe26d-kube-api-access-r56t4\") pod \"kserve-controller-manager-d6f4b65b8-2c2gr\" (UID: \"65ee96ae-2b1b-4538-828a-7498b50fe26d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"
Sep 10 21:25:40.248062 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:40.248019    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a061114-c7aa-4b66-a83e-61a2d16fba8b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hpfhj\" (UID: \"8a061114-c7aa-4b66-a83e-61a2d16fba8b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"
Sep 10 21:25:40.248062 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:40.248071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65ee96ae-2b1b-4538-828a-7498b50fe26d-cert\") pod \"kserve-controller-manager-d6f4b65b8-2c2gr\" (UID: \"65ee96ae-2b1b-4538-828a-7498b50fe26d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"
Sep 10 21:25:40.250561 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:40.250538    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65ee96ae-2b1b-4538-828a-7498b50fe26d-cert\") pod \"kserve-controller-manager-d6f4b65b8-2c2gr\" (UID: \"65ee96ae-2b1b-4538-828a-7498b50fe26d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"
Sep 10 21:25:40.250667 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:40.250539    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a061114-c7aa-4b66-a83e-61a2d16fba8b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hpfhj\" (UID: \"8a061114-c7aa-4b66-a83e-61a2d16fba8b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"
Sep 10 21:25:40.435004 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:40.434980    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"
Sep 10 21:25:40.445052 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:40.445026    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"
Sep 10 21:25:40.709806 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:40.709768    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"]
Sep 10 21:25:40.712274 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:25:40.712238    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ee96ae_2b1b_4538_828a_7498b50fe26d.slice/crio-1b6551e962c9e26d6c8f54dc33e76bf0cb398f58e3812dcbe9d5d2bddcd054cd WatchSource:0}: Error finding container 1b6551e962c9e26d6c8f54dc33e76bf0cb398f58e3812dcbe9d5d2bddcd054cd: Status 404 returned error can't find the container with id 1b6551e962c9e26d6c8f54dc33e76bf0cb398f58e3812dcbe9d5d2bddcd054cd
Sep 10 21:25:40.724470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:40.724448    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"]
Sep 10 21:25:40.726115 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:25:40.726091    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a061114_c7aa_4b66_a83e_61a2d16fba8b.slice/crio-08fb5295c3fdb0c9cfb0efcee5058c6ffc56d0a6b3e005420f3c1b0ba533c191 WatchSource:0}: Error finding container 08fb5295c3fdb0c9cfb0efcee5058c6ffc56d0a6b3e005420f3c1b0ba533c191: Status 404 returned error can't find the container with id 08fb5295c3fdb0c9cfb0efcee5058c6ffc56d0a6b3e005420f3c1b0ba533c191
Sep 10 21:25:41.228822 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.228783    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj" event={"ID":"8a061114-c7aa-4b66-a83e-61a2d16fba8b","Type":"ContainerStarted","Data":"08fb5295c3fdb0c9cfb0efcee5058c6ffc56d0a6b3e005420f3c1b0ba533c191"}
Sep 10 21:25:41.229966 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.229938    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr" event={"ID":"65ee96ae-2b1b-4538-828a-7498b50fe26d","Type":"ContainerStarted","Data":"1b6551e962c9e26d6c8f54dc33e76bf0cb398f58e3812dcbe9d5d2bddcd054cd"}
Sep 10 21:25:41.434955 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.434917    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"]
Sep 10 21:25:41.435177 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.435148    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb" podUID="9375f3f1-c4b3-4acf-8912-fcd1379bf38d" containerName="discovery" containerID="cri-o://54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac" gracePeriod=30
Sep 10 21:25:41.798634 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.798571    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:41.868567 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.868505    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-dns-cert\") pod \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") "
Sep 10 21:25:41.868567 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.868567    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78hln\" (UniqueName: \"kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-kube-api-access-78hln\") pod \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") "
Sep 10 21:25:41.868801 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.868643    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-token\") pod \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") "
Sep 10 21:25:41.868801 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.868717    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-cacerts\") pod \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") "
Sep 10 21:25:41.868801 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.868744    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-kubeconfig\") pod \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") "
Sep 10 21:25:41.868801 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.868787    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-local-certs\") pod \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") "
Sep 10 21:25:41.869005 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.868869    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-ca-configmap\") pod \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\" (UID: \"9375f3f1-c4b3-4acf-8912-fcd1379bf38d\") "
Sep 10 21:25:41.870070 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.870038    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "9375f3f1-c4b3-4acf-8912-fcd1379bf38d" (UID: "9375f3f1-c4b3-4acf-8912-fcd1379bf38d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:41.873096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.873050    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-token" (OuterVolumeSpecName: "istio-token") pod "9375f3f1-c4b3-4acf-8912-fcd1379bf38d" (UID: "9375f3f1-c4b3-4acf-8912-fcd1379bf38d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:41.873224 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.873131    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-cacerts" (OuterVolumeSpecName: "cacerts") pod "9375f3f1-c4b3-4acf-8912-fcd1379bf38d" (UID: "9375f3f1-c4b3-4acf-8912-fcd1379bf38d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:25:41.873224 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.873142    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-local-certs" (OuterVolumeSpecName: "local-certs") pod "9375f3f1-c4b3-4acf-8912-fcd1379bf38d" (UID: "9375f3f1-c4b3-4acf-8912-fcd1379bf38d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:41.873497 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.873452    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-kube-api-access-78hln" (OuterVolumeSpecName: "kube-api-access-78hln") pod "9375f3f1-c4b3-4acf-8912-fcd1379bf38d" (UID: "9375f3f1-c4b3-4acf-8912-fcd1379bf38d"). InnerVolumeSpecName "kube-api-access-78hln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:41.875071 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.875041    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "9375f3f1-c4b3-4acf-8912-fcd1379bf38d" (UID: "9375f3f1-c4b3-4acf-8912-fcd1379bf38d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:25:41.875735 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.875663    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "9375f3f1-c4b3-4acf-8912-fcd1379bf38d" (UID: "9375f3f1-c4b3-4acf-8912-fcd1379bf38d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:25:41.969952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.969907    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:25:41.969952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.969940    2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-cacerts\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:25:41.969952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.969956    2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-kubeconfig\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:25:41.970269 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.969968    2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-local-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:25:41.970269 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.969983    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-ca-configmap\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:25:41.970269 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.970001    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-istio-csr-dns-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:25:41.970269 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:41.970012    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78hln\" (UniqueName: \"kubernetes.io/projected/9375f3f1-c4b3-4acf-8912-fcd1379bf38d-kube-api-access-78hln\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:25:42.238436 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.238402    2568 generic.go:356] "Generic (PLEG): container finished" podID="9375f3f1-c4b3-4acf-8912-fcd1379bf38d" containerID="54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac" exitCode=0
Sep 10 21:25:42.238579 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.238457    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"
Sep 10 21:25:42.238579 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.238479    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb" event={"ID":"9375f3f1-c4b3-4acf-8912-fcd1379bf38d","Type":"ContainerDied","Data":"54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac"}
Sep 10 21:25:42.238579 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.238521    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb" event={"ID":"9375f3f1-c4b3-4acf-8912-fcd1379bf38d","Type":"ContainerDied","Data":"756e19e5dff393618bd87dcf87551609f55b1ffa17abc793f47c43eaa0bf9c6d"}
Sep 10 21:25:42.238579 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.238547    2568 scope.go:117] "RemoveContainer" containerID="54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac"
Sep 10 21:25:42.249975 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.249952    2568 scope.go:117] "RemoveContainer" containerID="54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac"
Sep 10 21:25:42.250357 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:25:42.250286    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac\": container with ID starting with 54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac not found: ID does not exist" containerID="54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac"
Sep 10 21:25:42.250357 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.250322    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac"} err="failed to get container status \"54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac\": rpc error: code = NotFound desc = could not find container \"54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac\": container with ID starting with 54235cf8b9b1e9e3b08829b958d69019f8b985714fc516f65ab54e3df60093ac not found: ID does not exist"
Sep 10 21:25:42.269385 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.269359    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"]
Sep 10 21:25:42.274194 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.274171    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ztdpb"]
Sep 10 21:25:42.940065 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.940020    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:42.940533 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.940087    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:42.945026 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:42.945002    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:43.245871 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:43.245749    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr" event={"ID":"65ee96ae-2b1b-4538-828a-7498b50fe26d","Type":"ContainerStarted","Data":"3b4b68e93339b1ac6c56ed1e7072d798180e704f73b32d2a16a0ff5f7838be6f"}
Sep 10 21:25:43.246020 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:43.245948    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"
Sep 10 21:25:43.252395 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:43.252367    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-577756c9bf-t94ds"
Sep 10 21:25:43.285300 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:43.285247    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr" podStartSLOduration=2.045215983 podStartE2EDuration="4.285227671s" totalImagesPullingTime="2.240011688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:25:43.284960844 +0000 UTC m=+393.487291416" watchObservedRunningTime="2026-09-10 21:25:43.285227671 +0000 UTC m=+393.487558247"
Sep 10 21:25:43.398119 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:43.398088    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d86c4478-rks2n"]
Sep 10 21:25:44.197297 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:44.197262    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9375f3f1-c4b3-4acf-8912-fcd1379bf38d" path="/var/lib/kubelet/pods/9375f3f1-c4b3-4acf-8912-fcd1379bf38d/volumes"
Sep 10 21:25:44.254937 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:44.254902    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj" event={"ID":"8a061114-c7aa-4b66-a83e-61a2d16fba8b","Type":"ContainerStarted","Data":"720755ef84c0a0ac7536e71d7bc49c53a2b3e451291bdfa909d2fa5109536d27"}
Sep 10 21:25:44.278861 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:44.278807    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj" podStartSLOduration=2.238833821 podStartE2EDuration="5.278793435s" totalImagesPullingTime="3.039959614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:25:44.278318646 +0000 UTC m=+394.480649219" watchObservedRunningTime="2026-09-10 21:25:44.278793435 +0000 UTC m=+394.481124021"
Sep 10 21:25:45.259749 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:25:45.259722    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"
Sep 10 21:26:08.421891 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.421847    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69d86c4478-rks2n" podUID="dbb205fc-a352-4ded-8ef2-034f13e0ec27" containerName="console" containerID="cri-o://49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55" gracePeriod=15
Sep 10 21:26:08.671560 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.671538    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:26:08.785969 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.785902    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-config\") pod \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") "
Sep 10 21:26:08.785969 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.785966    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-service-ca\") pod \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") "
Sep 10 21:26:08.786159 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786091    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-oauth-serving-cert\") pod \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") "
Sep 10 21:26:08.786251 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786158    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvzhg\" (UniqueName: \"kubernetes.io/projected/dbb205fc-a352-4ded-8ef2-034f13e0ec27-kube-api-access-xvzhg\") pod \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") "
Sep 10 21:26:08.786251 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786225    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-oauth-config\") pod \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") "
Sep 10 21:26:08.786368 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786263    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-trusted-ca-bundle\") pod \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") "
Sep 10 21:26:08.786368 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786290    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-config" (OuterVolumeSpecName: "console-config") pod "dbb205fc-a352-4ded-8ef2-034f13e0ec27" (UID: "dbb205fc-a352-4ded-8ef2-034f13e0ec27"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:08.786368 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786335    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-service-ca" (OuterVolumeSpecName: "service-ca") pod "dbb205fc-a352-4ded-8ef2-034f13e0ec27" (UID: "dbb205fc-a352-4ded-8ef2-034f13e0ec27"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:08.786526 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786294    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-serving-cert\") pod \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\" (UID: \"dbb205fc-a352-4ded-8ef2-034f13e0ec27\") "
Sep 10 21:26:08.786526 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786457    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dbb205fc-a352-4ded-8ef2-034f13e0ec27" (UID: "dbb205fc-a352-4ded-8ef2-034f13e0ec27"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:08.786724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786706    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-config\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:08.786797 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786726    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:08.786797 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786734    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-oauth-serving-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:08.786797 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.786753    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dbb205fc-a352-4ded-8ef2-034f13e0ec27" (UID: "dbb205fc-a352-4ded-8ef2-034f13e0ec27"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:08.788398 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.788371    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dbb205fc-a352-4ded-8ef2-034f13e0ec27" (UID: "dbb205fc-a352-4ded-8ef2-034f13e0ec27"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:26:08.788513 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.788437    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb205fc-a352-4ded-8ef2-034f13e0ec27-kube-api-access-xvzhg" (OuterVolumeSpecName: "kube-api-access-xvzhg") pod "dbb205fc-a352-4ded-8ef2-034f13e0ec27" (UID: "dbb205fc-a352-4ded-8ef2-034f13e0ec27"). InnerVolumeSpecName "kube-api-access-xvzhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:08.788513 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.788476    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dbb205fc-a352-4ded-8ef2-034f13e0ec27" (UID: "dbb205fc-a352-4ded-8ef2-034f13e0ec27"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:26:08.887666 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.887643    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvzhg\" (UniqueName: \"kubernetes.io/projected/dbb205fc-a352-4ded-8ef2-034f13e0ec27-kube-api-access-xvzhg\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:08.887666 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.887663    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-oauth-config\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:08.887806 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.887673    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbb205fc-a352-4ded-8ef2-034f13e0ec27-trusted-ca-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:08.887806 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:08.887684    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbb205fc-a352-4ded-8ef2-034f13e0ec27-console-serving-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:09.381680 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:09.381645    2568 generic.go:356] "Generic (PLEG): container finished" podID="dbb205fc-a352-4ded-8ef2-034f13e0ec27" containerID="49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55" exitCode=0
Sep 10 21:26:09.381845 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:09.381687    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d86c4478-rks2n"
Sep 10 21:26:09.381845 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:09.381733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d86c4478-rks2n" event={"ID":"dbb205fc-a352-4ded-8ef2-034f13e0ec27","Type":"ContainerDied","Data":"49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55"}
Sep 10 21:26:09.381845 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:09.381782    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d86c4478-rks2n" event={"ID":"dbb205fc-a352-4ded-8ef2-034f13e0ec27","Type":"ContainerDied","Data":"f359c0cddac5f17a702815d758cbc9bf72c7cad01f2d2f55b4972e54ef4ae634"}
Sep 10 21:26:09.381845 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:09.381803    2568 scope.go:117] "RemoveContainer" containerID="49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55"
Sep 10 21:26:09.392057 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:09.392040    2568 scope.go:117] "RemoveContainer" containerID="49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55"
Sep 10 21:26:09.392352 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:26:09.392333    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55\": container with ID starting with 49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55 not found: ID does not exist" containerID="49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55"
Sep 10 21:26:09.392431 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:09.392359    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55"} err="failed to get container status \"49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55\": rpc error: code = NotFound desc = could not find container \"49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55\": container with ID starting with 49f522b53cb7caf1f2bb54d5c830fb7667bfc7c989f18c61f7fa9a2f6e5c1a55 not found: ID does not exist"
Sep 10 21:26:09.404186 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:09.404159    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d86c4478-rks2n"]
Sep 10 21:26:09.406087 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:09.406065    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69d86c4478-rks2n"]
Sep 10 21:26:10.196618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:10.196596    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb205fc-a352-4ded-8ef2-034f13e0ec27" path="/var/lib/kubelet/pods/dbb205fc-a352-4ded-8ef2-034f13e0ec27/volumes"
Sep 10 21:26:14.260469 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:14.260440    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2c2gr"
Sep 10 21:26:16.266898 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:16.266867    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hpfhj"
Sep 10 21:26:34.441063 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.440985    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"]
Sep 10 21:26:34.441507 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.441390    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9375f3f1-c4b3-4acf-8912-fcd1379bf38d" containerName="discovery"
Sep 10 21:26:34.441507 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.441405    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9375f3f1-c4b3-4acf-8912-fcd1379bf38d" containerName="discovery"
Sep 10 21:26:34.441507 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.441436    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb205fc-a352-4ded-8ef2-034f13e0ec27" containerName="console"
Sep 10 21:26:34.441507 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.441442    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb205fc-a352-4ded-8ef2-034f13e0ec27" containerName="console"
Sep 10 21:26:34.441638 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.441514    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9375f3f1-c4b3-4acf-8912-fcd1379bf38d" containerName="discovery"
Sep 10 21:26:34.441638 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.441526    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb205fc-a352-4ded-8ef2-034f13e0ec27" containerName="console"
Sep 10 21:26:34.444472 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.444455    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:34.446742 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.446720    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:26:34.446870 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.446826    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:26:34.447586 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.447564    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zt45\""
Sep 10 21:26:34.453921 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.453899    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"]
Sep 10 21:26:34.472739 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.472717    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:34.472836 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.472781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls7dw\" (UniqueName: \"kubernetes.io/projected/ef43cf75-663b-4442-acb2-fcfce69e57e1-kube-api-access-ls7dw\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:34.472836 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.472806    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:34.535581 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.535556    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"]
Sep 10 21:26:34.538956 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.538940    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:34.547812 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.547791    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"]
Sep 10 21:26:34.573670 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.573644    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:34.573759 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.573705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls7dw\" (UniqueName: \"kubernetes.io/projected/ef43cf75-663b-4442-acb2-fcfce69e57e1-kube-api-access-ls7dw\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:34.573759 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.573741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:34.573852 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.573760    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:34.573852 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.573784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6c99\" (UniqueName: \"kubernetes.io/projected/3e98c0f1-41c8-4284-811f-3b388fc66c7a-kube-api-access-s6c99\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:34.573852 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.573803    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:34.574046 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.574024    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:34.574083 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.574042    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:34.582046 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.582021    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls7dw\" (UniqueName: \"kubernetes.io/projected/ef43cf75-663b-4442-acb2-fcfce69e57e1-kube-api-access-ls7dw\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:34.643115 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.643092    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"]
Sep 10 21:26:34.646723 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.646707    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:34.654844 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.654824    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"]
Sep 10 21:26:34.674970 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.674946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6c99\" (UniqueName: \"kubernetes.io/projected/3e98c0f1-41c8-4284-811f-3b388fc66c7a-kube-api-access-s6c99\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:34.675055 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.674972    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:34.675055 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.675001    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:34.675055 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.675022    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c54g4\" (UniqueName: \"kubernetes.io/projected/68641058-ea5b-4918-bb86-197ef58533a2-kube-api-access-c54g4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:34.675164 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.675146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:34.675233 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.675219    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:34.675374 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.675360    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:34.675414 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.675405    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:34.682789 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.682768    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6c99\" (UniqueName: \"kubernetes.io/projected/3e98c0f1-41c8-4284-811f-3b388fc66c7a-kube-api-access-s6c99\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:34.737767 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.737707    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"]
Sep 10 21:26:34.741378 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.741360    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:34.756895 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.756591    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"]
Sep 10 21:26:34.756895 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.756699    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:34.775785 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.775756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:34.775884 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.775797    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:34.775884 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.775831    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z77ks\" (UniqueName: \"kubernetes.io/projected/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-kube-api-access-z77ks\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:34.775884 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.775865    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:34.776048 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.775896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c54g4\" (UniqueName: \"kubernetes.io/projected/68641058-ea5b-4918-bb86-197ef58533a2-kube-api-access-c54g4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:34.776048 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.775961    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:34.776163 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.776130    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:34.776248 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.776230    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:34.784065 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.784039    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c54g4\" (UniqueName: \"kubernetes.io/projected/68641058-ea5b-4918-bb86-197ef58533a2-kube-api-access-c54g4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:34.848626 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.848576    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:34.877293 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.877249    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:34.877417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.877308    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z77ks\" (UniqueName: \"kubernetes.io/projected/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-kube-api-access-z77ks\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:34.877417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.877399    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:34.877848 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.877816    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:34.877961 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.877852    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:34.887631 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.887605    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z77ks\" (UniqueName: \"kubernetes.io/projected/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-kube-api-access-z77ks\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:34.956211 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:34.956174    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:35.027650 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.027625    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"]
Sep 10 21:26:35.035781 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:26:35.033632    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef43cf75_663b_4442_acb2_fcfce69e57e1.slice/crio-18f0086a59c8932e5ec551611d1ef5b52614bd5f1b7bf09e067847297c8312c3 WatchSource:0}: Error finding container 18f0086a59c8932e5ec551611d1ef5b52614bd5f1b7bf09e067847297c8312c3: Status 404 returned error can't find the container with id 18f0086a59c8932e5ec551611d1ef5b52614bd5f1b7bf09e067847297c8312c3
Sep 10 21:26:35.058032 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.058012    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:35.121917 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.121887    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"]
Sep 10 21:26:35.125738 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:26:35.125711    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e98c0f1_41c8_4284_811f_3b388fc66c7a.slice/crio-da0cd3b67b17d7121c489852f2699cf456e38df657c502673056102e8891ddc3 WatchSource:0}: Error finding container da0cd3b67b17d7121c489852f2699cf456e38df657c502673056102e8891ddc3: Status 404 returned error can't find the container with id da0cd3b67b17d7121c489852f2699cf456e38df657c502673056102e8891ddc3
Sep 10 21:26:35.225282 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.225259    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"]
Sep 10 21:26:35.227437 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:26:35.227410    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68641058_ea5b_4918_bb86_197ef58533a2.slice/crio-1f3ecb69479d9b46eb9144f15abced1316bc1d22db04d024fa7097bfb62d039b WatchSource:0}: Error finding container 1f3ecb69479d9b46eb9144f15abced1316bc1d22db04d024fa7097bfb62d039b: Status 404 returned error can't find the container with id 1f3ecb69479d9b46eb9144f15abced1316bc1d22db04d024fa7097bfb62d039b
Sep 10 21:26:35.330401 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.330371    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"]
Sep 10 21:26:35.334717 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:26:35.334691    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71b127b_63cb_4e43_8c31_8cd29d9b32d6.slice/crio-00c017e1c800eb6cff7df25701c932fadd7be43337833789d491c8f3815676ce WatchSource:0}: Error finding container 00c017e1c800eb6cff7df25701c932fadd7be43337833789d491c8f3815676ce: Status 404 returned error can't find the container with id 00c017e1c800eb6cff7df25701c932fadd7be43337833789d491c8f3815676ce
Sep 10 21:26:35.509886 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.509859    2568 generic.go:356] "Generic (PLEG): container finished" podID="c71b127b-63cb-4e43-8c31-8cd29d9b32d6" containerID="cc7a8a170b413538d7558e75901dd6e34667a25c2aa4829591966c4ebeef01d6" exitCode=0
Sep 10 21:26:35.510247 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.509941    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs" event={"ID":"c71b127b-63cb-4e43-8c31-8cd29d9b32d6","Type":"ContainerDied","Data":"cc7a8a170b413538d7558e75901dd6e34667a25c2aa4829591966c4ebeef01d6"}
Sep 10 21:26:35.510247 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.509987    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs" event={"ID":"c71b127b-63cb-4e43-8c31-8cd29d9b32d6","Type":"ContainerStarted","Data":"00c017e1c800eb6cff7df25701c932fadd7be43337833789d491c8f3815676ce"}
Sep 10 21:26:35.511588 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.511565    2568 generic.go:356] "Generic (PLEG): container finished" podID="3e98c0f1-41c8-4284-811f-3b388fc66c7a" containerID="d950c987e248259f0ea50abce434a9c83c1a9c348c69f86ce3c8a0441e0f9d3a" exitCode=0
Sep 10 21:26:35.511677 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.511615    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm" event={"ID":"3e98c0f1-41c8-4284-811f-3b388fc66c7a","Type":"ContainerDied","Data":"d950c987e248259f0ea50abce434a9c83c1a9c348c69f86ce3c8a0441e0f9d3a"}
Sep 10 21:26:35.511677 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.511662    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm" event={"ID":"3e98c0f1-41c8-4284-811f-3b388fc66c7a","Type":"ContainerStarted","Data":"da0cd3b67b17d7121c489852f2699cf456e38df657c502673056102e8891ddc3"}
Sep 10 21:26:35.513220 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.513181    2568 generic.go:356] "Generic (PLEG): container finished" podID="ef43cf75-663b-4442-acb2-fcfce69e57e1" containerID="bbdb9382310579a69f13f5107342413b3040d8deb8048bf7f4f2bd021de8d8c7" exitCode=0
Sep 10 21:26:35.513321 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.513240    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg" event={"ID":"ef43cf75-663b-4442-acb2-fcfce69e57e1","Type":"ContainerDied","Data":"bbdb9382310579a69f13f5107342413b3040d8deb8048bf7f4f2bd021de8d8c7"}
Sep 10 21:26:35.513321 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.513283    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg" event={"ID":"ef43cf75-663b-4442-acb2-fcfce69e57e1","Type":"ContainerStarted","Data":"18f0086a59c8932e5ec551611d1ef5b52614bd5f1b7bf09e067847297c8312c3"}
Sep 10 21:26:35.515170 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.515148    2568 generic.go:356] "Generic (PLEG): container finished" podID="68641058-ea5b-4918-bb86-197ef58533a2" containerID="f3ae30dff0403187516377c05a2c1a1bbb6e0546f0b16487cdf12e41756215cf" exitCode=0
Sep 10 21:26:35.515282 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.515234    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt" event={"ID":"68641058-ea5b-4918-bb86-197ef58533a2","Type":"ContainerDied","Data":"f3ae30dff0403187516377c05a2c1a1bbb6e0546f0b16487cdf12e41756215cf"}
Sep 10 21:26:35.515282 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:35.515279    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt" event={"ID":"68641058-ea5b-4918-bb86-197ef58533a2","Type":"ContainerStarted","Data":"1f3ecb69479d9b46eb9144f15abced1316bc1d22db04d024fa7097bfb62d039b"}
Sep 10 21:26:37.527130 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:37.527091    2568 generic.go:356] "Generic (PLEG): container finished" podID="3e98c0f1-41c8-4284-811f-3b388fc66c7a" containerID="6bdd0bbf212ae2df6fa88b55822ae03546fa7b3307466867cca6091c36a596ff" exitCode=0
Sep 10 21:26:37.527577 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:37.527173    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm" event={"ID":"3e98c0f1-41c8-4284-811f-3b388fc66c7a","Type":"ContainerDied","Data":"6bdd0bbf212ae2df6fa88b55822ae03546fa7b3307466867cca6091c36a596ff"}
Sep 10 21:26:37.529194 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:37.529174    2568 generic.go:356] "Generic (PLEG): container finished" podID="ef43cf75-663b-4442-acb2-fcfce69e57e1" containerID="7b42c4f75e22ecbdbc9d5c8ffbbb9bde84482d8cb8b110cd90b352414e7891dc" exitCode=0
Sep 10 21:26:37.529326 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:37.529234    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg" event={"ID":"ef43cf75-663b-4442-acb2-fcfce69e57e1","Type":"ContainerDied","Data":"7b42c4f75e22ecbdbc9d5c8ffbbb9bde84482d8cb8b110cd90b352414e7891dc"}
Sep 10 21:26:37.531321 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:37.531299    2568 generic.go:356] "Generic (PLEG): container finished" podID="68641058-ea5b-4918-bb86-197ef58533a2" containerID="d751024e0aa15e2b51148308e32cc45561ebdfef0b2d9c9dfc147ffd6f29a7e6" exitCode=0
Sep 10 21:26:37.531421 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:37.531329    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt" event={"ID":"68641058-ea5b-4918-bb86-197ef58533a2","Type":"ContainerDied","Data":"d751024e0aa15e2b51148308e32cc45561ebdfef0b2d9c9dfc147ffd6f29a7e6"}
Sep 10 21:26:37.533467 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:37.533447    2568 generic.go:356] "Generic (PLEG): container finished" podID="c71b127b-63cb-4e43-8c31-8cd29d9b32d6" containerID="1da5f562655d1a0d17bd676c9af91a90a907e46e2e0eddfff2cd7c40d079869d" exitCode=0
Sep 10 21:26:37.533562 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:37.533491    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs" event={"ID":"c71b127b-63cb-4e43-8c31-8cd29d9b32d6","Type":"ContainerDied","Data":"1da5f562655d1a0d17bd676c9af91a90a907e46e2e0eddfff2cd7c40d079869d"}
Sep 10 21:26:38.541716 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:38.541681    2568 generic.go:356] "Generic (PLEG): container finished" podID="68641058-ea5b-4918-bb86-197ef58533a2" containerID="c344a8e617057f9c124bd6d42d16d8eb50c4c40f650fe53a51de8c3dc196e60e" exitCode=0
Sep 10 21:26:38.542120 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:38.541770    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt" event={"ID":"68641058-ea5b-4918-bb86-197ef58533a2","Type":"ContainerDied","Data":"c344a8e617057f9c124bd6d42d16d8eb50c4c40f650fe53a51de8c3dc196e60e"}
Sep 10 21:26:38.543963 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:38.543942    2568 generic.go:356] "Generic (PLEG): container finished" podID="c71b127b-63cb-4e43-8c31-8cd29d9b32d6" containerID="916ca0e51a59af1dea2d88e372b64b2e97e6f1c1f44b9b4a00ba5f778f205c9e" exitCode=0
Sep 10 21:26:38.544101 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:38.544020    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs" event={"ID":"c71b127b-63cb-4e43-8c31-8cd29d9b32d6","Type":"ContainerDied","Data":"916ca0e51a59af1dea2d88e372b64b2e97e6f1c1f44b9b4a00ba5f778f205c9e"}
Sep 10 21:26:38.546018 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:38.545993    2568 generic.go:356] "Generic (PLEG): container finished" podID="3e98c0f1-41c8-4284-811f-3b388fc66c7a" containerID="e5f9124b29c6d7f363d42eefbe7b32eb73567be3251b5721d4a1be8cbc9b7ad9" exitCode=0
Sep 10 21:26:38.546117 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:38.546023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm" event={"ID":"3e98c0f1-41c8-4284-811f-3b388fc66c7a","Type":"ContainerDied","Data":"e5f9124b29c6d7f363d42eefbe7b32eb73567be3251b5721d4a1be8cbc9b7ad9"}
Sep 10 21:26:38.548390 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:38.548372    2568 generic.go:356] "Generic (PLEG): container finished" podID="ef43cf75-663b-4442-acb2-fcfce69e57e1" containerID="59db13d0b97f385d9254f1a3a643b3114c9e341f5f001b7517e416c9da745608" exitCode=0
Sep 10 21:26:38.548485 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:38.548423    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg" event={"ID":"ef43cf75-663b-4442-acb2-fcfce69e57e1","Type":"ContainerDied","Data":"59db13d0b97f385d9254f1a3a643b3114c9e341f5f001b7517e416c9da745608"}
Sep 10 21:26:39.698572 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.698542    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:39.750150 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.750129    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:39.753369 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.753345    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:39.772990 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.772971    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:39.816834 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.816767    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-bundle\") pod \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") "
Sep 10 21:26:39.816834 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.816804    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-bundle\") pod \"68641058-ea5b-4918-bb86-197ef58533a2\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") "
Sep 10 21:26:39.817005 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.816834    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z77ks\" (UniqueName: \"kubernetes.io/projected/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-kube-api-access-z77ks\") pod \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") "
Sep 10 21:26:39.817005 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.816870    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-util\") pod \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") "
Sep 10 21:26:39.817005 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.816901    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6c99\" (UniqueName: \"kubernetes.io/projected/3e98c0f1-41c8-4284-811f-3b388fc66c7a-kube-api-access-s6c99\") pod \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") "
Sep 10 21:26:39.817005 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.816942    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-util\") pod \"68641058-ea5b-4918-bb86-197ef58533a2\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") "
Sep 10 21:26:39.817259 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.817236    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-bundle\") pod \"ef43cf75-663b-4442-acb2-fcfce69e57e1\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") "
Sep 10 21:26:39.817332 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.817301    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-bundle\") pod \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\" (UID: \"c71b127b-63cb-4e43-8c31-8cd29d9b32d6\") "
Sep 10 21:26:39.817383 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.817319    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-bundle" (OuterVolumeSpecName: "bundle") pod "68641058-ea5b-4918-bb86-197ef58533a2" (UID: "68641058-ea5b-4918-bb86-197ef58533a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:39.817383 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.817350    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-util\") pod \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\" (UID: \"3e98c0f1-41c8-4284-811f-3b388fc66c7a\") "
Sep 10 21:26:39.817487 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.817386    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-util\") pod \"ef43cf75-663b-4442-acb2-fcfce69e57e1\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") "
Sep 10 21:26:39.817487 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.817428    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c54g4\" (UniqueName: \"kubernetes.io/projected/68641058-ea5b-4918-bb86-197ef58533a2-kube-api-access-c54g4\") pod \"68641058-ea5b-4918-bb86-197ef58533a2\" (UID: \"68641058-ea5b-4918-bb86-197ef58533a2\") "
Sep 10 21:26:39.817487 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.817467    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls7dw\" (UniqueName: \"kubernetes.io/projected/ef43cf75-663b-4442-acb2-fcfce69e57e1-kube-api-access-ls7dw\") pod \"ef43cf75-663b-4442-acb2-fcfce69e57e1\" (UID: \"ef43cf75-663b-4442-acb2-fcfce69e57e1\") "
Sep 10 21:26:39.817743 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.817719    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-bundle" (OuterVolumeSpecName: "bundle") pod "ef43cf75-663b-4442-acb2-fcfce69e57e1" (UID: "ef43cf75-663b-4442-acb2-fcfce69e57e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:39.817799 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.817740    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:39.818751 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.818713    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-bundle" (OuterVolumeSpecName: "bundle") pod "c71b127b-63cb-4e43-8c31-8cd29d9b32d6" (UID: "c71b127b-63cb-4e43-8c31-8cd29d9b32d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:39.819766 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.819734    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-bundle" (OuterVolumeSpecName: "bundle") pod "3e98c0f1-41c8-4284-811f-3b388fc66c7a" (UID: "3e98c0f1-41c8-4284-811f-3b388fc66c7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:39.820775 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.820737    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68641058-ea5b-4918-bb86-197ef58533a2-kube-api-access-c54g4" (OuterVolumeSpecName: "kube-api-access-c54g4") pod "68641058-ea5b-4918-bb86-197ef58533a2" (UID: "68641058-ea5b-4918-bb86-197ef58533a2"). InnerVolumeSpecName "kube-api-access-c54g4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:39.821335 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.821310    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-kube-api-access-z77ks" (OuterVolumeSpecName: "kube-api-access-z77ks") pod "c71b127b-63cb-4e43-8c31-8cd29d9b32d6" (UID: "c71b127b-63cb-4e43-8c31-8cd29d9b32d6"). InnerVolumeSpecName "kube-api-access-z77ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:39.821522 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.821494    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef43cf75-663b-4442-acb2-fcfce69e57e1-kube-api-access-ls7dw" (OuterVolumeSpecName: "kube-api-access-ls7dw") pod "ef43cf75-663b-4442-acb2-fcfce69e57e1" (UID: "ef43cf75-663b-4442-acb2-fcfce69e57e1"). InnerVolumeSpecName "kube-api-access-ls7dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:39.822822 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.822792    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e98c0f1-41c8-4284-811f-3b388fc66c7a-kube-api-access-s6c99" (OuterVolumeSpecName: "kube-api-access-s6c99") pod "3e98c0f1-41c8-4284-811f-3b388fc66c7a" (UID: "3e98c0f1-41c8-4284-811f-3b388fc66c7a"). InnerVolumeSpecName "kube-api-access-s6c99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:39.824523 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.824503    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-util" (OuterVolumeSpecName: "util") pod "68641058-ea5b-4918-bb86-197ef58533a2" (UID: "68641058-ea5b-4918-bb86-197ef58533a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:39.825611 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.825576    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-util" (OuterVolumeSpecName: "util") pod "c71b127b-63cb-4e43-8c31-8cd29d9b32d6" (UID: "c71b127b-63cb-4e43-8c31-8cd29d9b32d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:39.826367 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.826330    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-util" (OuterVolumeSpecName: "util") pod "3e98c0f1-41c8-4284-811f-3b388fc66c7a" (UID: "3e98c0f1-41c8-4284-811f-3b388fc66c7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:39.827345 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.827327    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-util" (OuterVolumeSpecName: "util") pod "ef43cf75-663b-4442-acb2-fcfce69e57e1" (UID: "ef43cf75-663b-4442-acb2-fcfce69e57e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:39.918613 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.918578    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68641058-ea5b-4918-bb86-197ef58533a2-util\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:39.918613 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.918601    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:39.918613 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.918618    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:39.918793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.918625    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-util\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:39.918793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.918633    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef43cf75-663b-4442-acb2-fcfce69e57e1-util\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:39.918793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.918641    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c54g4\" (UniqueName: \"kubernetes.io/projected/68641058-ea5b-4918-bb86-197ef58533a2-kube-api-access-c54g4\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:39.918793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.918651    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls7dw\" (UniqueName: \"kubernetes.io/projected/ef43cf75-663b-4442-acb2-fcfce69e57e1-kube-api-access-ls7dw\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:39.918793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.918660    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e98c0f1-41c8-4284-811f-3b388fc66c7a-bundle\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:39.918793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.918668    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z77ks\" (UniqueName: \"kubernetes.io/projected/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-kube-api-access-z77ks\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:39.918793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.918677    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c71b127b-63cb-4e43-8c31-8cd29d9b32d6-util\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:39.918793 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:39.918687    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6c99\" (UniqueName: \"kubernetes.io/projected/3e98c0f1-41c8-4284-811f-3b388fc66c7a-kube-api-access-s6c99\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:26:40.560355 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.560326    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt"
Sep 10 21:26:40.560489 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.560350    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mkfgt" event={"ID":"68641058-ea5b-4918-bb86-197ef58533a2","Type":"ContainerDied","Data":"1f3ecb69479d9b46eb9144f15abced1316bc1d22db04d024fa7097bfb62d039b"}
Sep 10 21:26:40.560489 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.560426    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f3ecb69479d9b46eb9144f15abced1316bc1d22db04d024fa7097bfb62d039b"
Sep 10 21:26:40.562539 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.562510    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs" event={"ID":"c71b127b-63cb-4e43-8c31-8cd29d9b32d6","Type":"ContainerDied","Data":"00c017e1c800eb6cff7df25701c932fadd7be43337833789d491c8f3815676ce"}
Sep 10 21:26:40.562683 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.562556    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00c017e1c800eb6cff7df25701c932fadd7be43337833789d491c8f3815676ce"
Sep 10 21:26:40.562683 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.562521    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apg2rs"
Sep 10 21:26:40.564816 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.564786    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm" event={"ID":"3e98c0f1-41c8-4284-811f-3b388fc66c7a","Type":"ContainerDied","Data":"da0cd3b67b17d7121c489852f2699cf456e38df657c502673056102e8891ddc3"}
Sep 10 21:26:40.564929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.564821    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da0cd3b67b17d7121c489852f2699cf456e38df657c502673056102e8891ddc3"
Sep 10 21:26:40.564929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.564881    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4crdjvm"
Sep 10 21:26:40.566982 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.566960    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg" event={"ID":"ef43cf75-663b-4442-acb2-fcfce69e57e1","Type":"ContainerDied","Data":"18f0086a59c8932e5ec551611d1ef5b52614bd5f1b7bf09e067847297c8312c3"}
Sep 10 21:26:40.567077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.566995    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bjqcg"
Sep 10 21:26:40.567137 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:40.566998    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18f0086a59c8932e5ec551611d1ef5b52614bd5f1b7bf09e067847297c8312c3"
Sep 10 21:26:46.236506 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236476    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7"]
Sep 10 21:26:46.236881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236816    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c71b127b-63cb-4e43-8c31-8cd29d9b32d6" containerName="pull"
Sep 10 21:26:46.236881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236827    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c71b127b-63cb-4e43-8c31-8cd29d9b32d6" containerName="pull"
Sep 10 21:26:46.236881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236838    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68641058-ea5b-4918-bb86-197ef58533a2" containerName="util"
Sep 10 21:26:46.236881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236843    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68641058-ea5b-4918-bb86-197ef58533a2" containerName="util"
Sep 10 21:26:46.236881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236853    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c71b127b-63cb-4e43-8c31-8cd29d9b32d6" containerName="extract"
Sep 10 21:26:46.236881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236858    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c71b127b-63cb-4e43-8c31-8cd29d9b32d6" containerName="extract"
Sep 10 21:26:46.236881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236871    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e98c0f1-41c8-4284-811f-3b388fc66c7a" containerName="pull"
Sep 10 21:26:46.236881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236876    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e98c0f1-41c8-4284-811f-3b388fc66c7a" containerName="pull"
Sep 10 21:26:46.236881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236884    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef43cf75-663b-4442-acb2-fcfce69e57e1" containerName="extract"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236890    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef43cf75-663b-4442-acb2-fcfce69e57e1" containerName="extract"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236897    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef43cf75-663b-4442-acb2-fcfce69e57e1" containerName="pull"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236901    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef43cf75-663b-4442-acb2-fcfce69e57e1" containerName="pull"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236908    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e98c0f1-41c8-4284-811f-3b388fc66c7a" containerName="extract"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236913    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e98c0f1-41c8-4284-811f-3b388fc66c7a" containerName="extract"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236919    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68641058-ea5b-4918-bb86-197ef58533a2" containerName="extract"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236924    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68641058-ea5b-4918-bb86-197ef58533a2" containerName="extract"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236930    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef43cf75-663b-4442-acb2-fcfce69e57e1" containerName="util"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236934    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef43cf75-663b-4442-acb2-fcfce69e57e1" containerName="util"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236942    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c71b127b-63cb-4e43-8c31-8cd29d9b32d6" containerName="util"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236946    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c71b127b-63cb-4e43-8c31-8cd29d9b32d6" containerName="util"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236951    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68641058-ea5b-4918-bb86-197ef58533a2" containerName="pull"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236956    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68641058-ea5b-4918-bb86-197ef58533a2" containerName="pull"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236961    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e98c0f1-41c8-4284-811f-3b388fc66c7a" containerName="util"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.236965    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e98c0f1-41c8-4284-811f-3b388fc66c7a" containerName="util"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.237013    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="68641058-ea5b-4918-bb86-197ef58533a2" containerName="extract"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.237022    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c71b127b-63cb-4e43-8c31-8cd29d9b32d6" containerName="extract"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.237029    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e98c0f1-41c8-4284-811f-3b388fc66c7a" containerName="extract"
Sep 10 21:26:46.237160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.237036    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef43cf75-663b-4442-acb2-fcfce69e57e1" containerName="extract"
Sep 10 21:26:46.240805 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.240788    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7"
Sep 10 21:26:46.244313 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.243863    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 21:26:46.244313 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.243935    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8v5gq\""
Sep 10 21:26:46.244313 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.244097    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 21:26:46.244313 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.244234    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 21:26:46.254509 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.254487    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7"]
Sep 10 21:26:46.366813 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.366785    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgdnt\" (UniqueName: \"kubernetes.io/projected/c3af005f-f2e1-4a5a-9729-2a7b55288079-kube-api-access-hgdnt\") pod \"dns-operator-controller-manager-7b84cd7c9c-rh2z7\" (UID: \"c3af005f-f2e1-4a5a-9729-2a7b55288079\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7"
Sep 10 21:26:46.467260 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.467217    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgdnt\" (UniqueName: \"kubernetes.io/projected/c3af005f-f2e1-4a5a-9729-2a7b55288079-kube-api-access-hgdnt\") pod \"dns-operator-controller-manager-7b84cd7c9c-rh2z7\" (UID: \"c3af005f-f2e1-4a5a-9729-2a7b55288079\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7"
Sep 10 21:26:46.478684 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.478664    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgdnt\" (UniqueName: \"kubernetes.io/projected/c3af005f-f2e1-4a5a-9729-2a7b55288079-kube-api-access-hgdnt\") pod \"dns-operator-controller-manager-7b84cd7c9c-rh2z7\" (UID: \"c3af005f-f2e1-4a5a-9729-2a7b55288079\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7"
Sep 10 21:26:46.555361 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.555336    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7"
Sep 10 21:26:46.900815 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:46.900792    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7"]
Sep 10 21:26:46.902784 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:26:46.902755    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3af005f_f2e1_4a5a_9729_2a7b55288079.slice/crio-615461bee6176a7c53b062cfe652fd7dfd2c8150cedaa42128023fa0867632fc WatchSource:0}: Error finding container 615461bee6176a7c53b062cfe652fd7dfd2c8150cedaa42128023fa0867632fc: Status 404 returned error can't find the container with id 615461bee6176a7c53b062cfe652fd7dfd2c8150cedaa42128023fa0867632fc
Sep 10 21:26:47.610983 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:47.610951    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7" event={"ID":"c3af005f-f2e1-4a5a-9729-2a7b55288079","Type":"ContainerStarted","Data":"615461bee6176a7c53b062cfe652fd7dfd2c8150cedaa42128023fa0867632fc"}
Sep 10 21:26:48.142927 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:48.142894    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"]
Sep 10 21:26:48.146540 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:48.146519    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:26:48.150828 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:48.150806    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tgj2c\""
Sep 10 21:26:48.168792 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:48.168767    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"]
Sep 10 21:26:48.181992 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:48.181966    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zmrb\" (UniqueName: \"kubernetes.io/projected/f6388af6-d7c8-4670-b3b7-c56e1c4925bb-kube-api-access-8zmrb\") pod \"limitador-operator-controller-manager-74495c69f8-q94l5\" (UID: \"f6388af6-d7c8-4670-b3b7-c56e1c4925bb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:26:48.283497 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:48.283436    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmrb\" (UniqueName: \"kubernetes.io/projected/f6388af6-d7c8-4670-b3b7-c56e1c4925bb-kube-api-access-8zmrb\") pod \"limitador-operator-controller-manager-74495c69f8-q94l5\" (UID: \"f6388af6-d7c8-4670-b3b7-c56e1c4925bb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:26:48.316034 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:48.316002    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zmrb\" (UniqueName: \"kubernetes.io/projected/f6388af6-d7c8-4670-b3b7-c56e1c4925bb-kube-api-access-8zmrb\") pod \"limitador-operator-controller-manager-74495c69f8-q94l5\" (UID: \"f6388af6-d7c8-4670-b3b7-c56e1c4925bb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:26:48.459812 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:48.459731    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:26:49.591353 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:49.591321    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"]
Sep 10 21:26:49.591696 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:26:49.591656    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6388af6_d7c8_4670_b3b7_c56e1c4925bb.slice/crio-08c35f79ed4d01e970523356efcf35aa2e8f61c16231a3b56733ade67e5c4611 WatchSource:0}: Error finding container 08c35f79ed4d01e970523356efcf35aa2e8f61c16231a3b56733ade67e5c4611: Status 404 returned error can't find the container with id 08c35f79ed4d01e970523356efcf35aa2e8f61c16231a3b56733ade67e5c4611
Sep 10 21:26:49.625246 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:49.625221    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7" event={"ID":"c3af005f-f2e1-4a5a-9729-2a7b55288079","Type":"ContainerStarted","Data":"6ed7d6188ceb259fffaad5634373fe5a91f1132c2f7040cb0f2d6c07bbc7277b"}
Sep 10 21:26:49.625415 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:49.625390    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7"
Sep 10 21:26:49.626515 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:49.626494    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5" event={"ID":"f6388af6-d7c8-4670-b3b7-c56e1c4925bb","Type":"ContainerStarted","Data":"08c35f79ed4d01e970523356efcf35aa2e8f61c16231a3b56733ade67e5c4611"}
Sep 10 21:26:49.657892 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:49.657852    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7" podStartSLOduration=1.209639087 podStartE2EDuration="3.657838527s" totalImagesPullingTime="2.44819944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:26:49.656516337 +0000 UTC m=+459.858846909" watchObservedRunningTime="2026-09-10 21:26:49.657838527 +0000 UTC m=+459.860169095"
Sep 10 21:26:51.639390 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:51.639356    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5" event={"ID":"f6388af6-d7c8-4670-b3b7-c56e1c4925bb","Type":"ContainerStarted","Data":"b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3"}
Sep 10 21:26:51.639747 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:51.639440    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:26:51.664487 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:51.664444    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5" podStartSLOduration=1.705396176 podStartE2EDuration="3.664430411s" totalImagesPullingTime="1.959034235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:26:51.663980808 +0000 UTC m=+461.866311397" watchObservedRunningTime="2026-09-10 21:26:51.664430411 +0000 UTC m=+461.866760982"
Sep 10 21:26:52.773498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:52.773466    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"]
Sep 10 21:26:52.777591 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:52.777574    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:26:52.780592 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:52.780570    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-99snq\""
Sep 10 21:26:52.801078 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:52.801056    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"]
Sep 10 21:26:52.820122 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:52.820102    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/482df038-1023-4f8d-843c-e18779249fa4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" (UID: \"482df038-1023-4f8d-843c-e18779249fa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:26:52.820238 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:52.820133    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d28qx\" (UniqueName: \"kubernetes.io/projected/482df038-1023-4f8d-843c-e18779249fa4-kube-api-access-d28qx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" (UID: \"482df038-1023-4f8d-843c-e18779249fa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:26:52.920891 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:52.920863    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/482df038-1023-4f8d-843c-e18779249fa4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" (UID: \"482df038-1023-4f8d-843c-e18779249fa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:26:52.921008 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:52.920905    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d28qx\" (UniqueName: \"kubernetes.io/projected/482df038-1023-4f8d-843c-e18779249fa4-kube-api-access-d28qx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" (UID: \"482df038-1023-4f8d-843c-e18779249fa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:26:52.921270 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:52.921247    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/482df038-1023-4f8d-843c-e18779249fa4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" (UID: \"482df038-1023-4f8d-843c-e18779249fa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:26:52.929753 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:52.929733    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d28qx\" (UniqueName: \"kubernetes.io/projected/482df038-1023-4f8d-843c-e18779249fa4-kube-api-access-d28qx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" (UID: \"482df038-1023-4f8d-843c-e18779249fa4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:26:53.087675 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:53.087647    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:26:53.384429 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:53.384405    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"]
Sep 10 21:26:53.386185 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:26:53.386160    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482df038_1023_4f8d_843c_e18779249fa4.slice/crio-214870a448a5411828c81f7282e8864e54a0372000a213b42af4011f952f8f92 WatchSource:0}: Error finding container 214870a448a5411828c81f7282e8864e54a0372000a213b42af4011f952f8f92: Status 404 returned error can't find the container with id 214870a448a5411828c81f7282e8864e54a0372000a213b42af4011f952f8f92
Sep 10 21:26:53.651471 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:53.651401    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c" event={"ID":"482df038-1023-4f8d-843c-e18779249fa4","Type":"ContainerStarted","Data":"214870a448a5411828c81f7282e8864e54a0372000a213b42af4011f952f8f92"}
Sep 10 21:26:55.617768 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:55.617728    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-9rkp5"]
Sep 10 21:26:55.621538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:55.621515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-9rkp5"
Sep 10 21:26:55.625104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:55.625078    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lgpwc\""
Sep 10 21:26:55.638438 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:55.638417    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-9rkp5"]
Sep 10 21:26:55.745132 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:55.745101    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwdsm\" (UniqueName: \"kubernetes.io/projected/f6201949-8563-464f-98ae-7184ed9419c7-kube-api-access-wwdsm\") pod \"authorino-operator-76b478bd78-9rkp5\" (UID: \"f6201949-8563-464f-98ae-7184ed9419c7\") " pod="kuadrant-system/authorino-operator-76b478bd78-9rkp5"
Sep 10 21:26:55.846124 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:55.846086    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdsm\" (UniqueName: \"kubernetes.io/projected/f6201949-8563-464f-98ae-7184ed9419c7-kube-api-access-wwdsm\") pod \"authorino-operator-76b478bd78-9rkp5\" (UID: \"f6201949-8563-464f-98ae-7184ed9419c7\") " pod="kuadrant-system/authorino-operator-76b478bd78-9rkp5"
Sep 10 21:26:55.858239 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:55.858194    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwdsm\" (UniqueName: \"kubernetes.io/projected/f6201949-8563-464f-98ae-7184ed9419c7-kube-api-access-wwdsm\") pod \"authorino-operator-76b478bd78-9rkp5\" (UID: \"f6201949-8563-464f-98ae-7184ed9419c7\") " pod="kuadrant-system/authorino-operator-76b478bd78-9rkp5"
Sep 10 21:26:55.934820 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:55.934753    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-9rkp5"
Sep 10 21:26:57.162562 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:57.162534    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-9rkp5"]
Sep 10 21:26:57.163505 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:26:57.163476    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6201949_8563_464f_98ae_7184ed9419c7.slice/crio-6e1b3395dead0acb20dd90a38c1a2e0cad432081acbaafb549a465eb6b2cfce5 WatchSource:0}: Error finding container 6e1b3395dead0acb20dd90a38c1a2e0cad432081acbaafb549a465eb6b2cfce5: Status 404 returned error can't find the container with id 6e1b3395dead0acb20dd90a38c1a2e0cad432081acbaafb549a465eb6b2cfce5
Sep 10 21:26:57.676881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:57.676847    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-9rkp5" event={"ID":"f6201949-8563-464f-98ae-7184ed9419c7","Type":"ContainerStarted","Data":"6e1b3395dead0acb20dd90a38c1a2e0cad432081acbaafb549a465eb6b2cfce5"}
Sep 10 21:26:57.678638 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:57.678600    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c" event={"ID":"482df038-1023-4f8d-843c-e18779249fa4","Type":"ContainerStarted","Data":"e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca"}
Sep 10 21:26:57.678777 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:57.678670    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:26:57.700860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:57.700802    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c" podStartSLOduration=2.113808447 podStartE2EDuration="5.700786204s" totalImagesPullingTime="3.586977757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:26:57.699015766 +0000 UTC m=+467.901346339" watchObservedRunningTime="2026-09-10 21:26:57.700786204 +0000 UTC m=+467.903116776"
Sep 10 21:26:59.692390 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.692355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-9rkp5" event={"ID":"f6201949-8563-464f-98ae-7184ed9419c7","Type":"ContainerStarted","Data":"988a545bb3321a1c2c82bef42c599d4fcf139b1f6d0a1558406c0f9d543299a9"}
Sep 10 21:26:59.692739 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.692414    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-9rkp5"
Sep 10 21:26:59.711453 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.711405    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-9rkp5" podStartSLOduration=3.218382176 podStartE2EDuration="4.711390691s" totalImagesPullingTime="1.493008515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:26:59.71036357 +0000 UTC m=+469.912694143" watchObservedRunningTime="2026-09-10 21:26:59.711390691 +0000 UTC m=+469.913721264"
Sep 10 21:26:59.793404 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.793368    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"]
Sep 10 21:26:59.797071 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.797050    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"
Sep 10 21:26:59.799525 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.799501    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 21:26:59.799616 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.799571    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7kgdq\""
Sep 10 21:26:59.799813 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.799797    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 21:26:59.805425 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.805398    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"]
Sep 10 21:26:59.879112 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.879080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fcd363-7068-46ae-b849-4cea4cbd3900-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4p5wb\" (UID: \"b9fcd363-7068-46ae-b849-4cea4cbd3900\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"
Sep 10 21:26:59.879267 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.879179    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m87h\" (UniqueName: \"kubernetes.io/projected/b9fcd363-7068-46ae-b849-4cea4cbd3900-kube-api-access-7m87h\") pod \"kuadrant-console-plugin-fbdd4f445-4p5wb\" (UID: \"b9fcd363-7068-46ae-b849-4cea4cbd3900\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"
Sep 10 21:26:59.879267 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.879243    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9fcd363-7068-46ae-b849-4cea4cbd3900-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4p5wb\" (UID: \"b9fcd363-7068-46ae-b849-4cea4cbd3900\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"
Sep 10 21:26:59.980549 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.980480    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m87h\" (UniqueName: \"kubernetes.io/projected/b9fcd363-7068-46ae-b849-4cea4cbd3900-kube-api-access-7m87h\") pod \"kuadrant-console-plugin-fbdd4f445-4p5wb\" (UID: \"b9fcd363-7068-46ae-b849-4cea4cbd3900\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"
Sep 10 21:26:59.980549 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.980511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9fcd363-7068-46ae-b849-4cea4cbd3900-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4p5wb\" (UID: \"b9fcd363-7068-46ae-b849-4cea4cbd3900\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"
Sep 10 21:26:59.980690 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.980571    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fcd363-7068-46ae-b849-4cea4cbd3900-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4p5wb\" (UID: \"b9fcd363-7068-46ae-b849-4cea4cbd3900\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"
Sep 10 21:26:59.981256 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.981195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9fcd363-7068-46ae-b849-4cea4cbd3900-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4p5wb\" (UID: \"b9fcd363-7068-46ae-b849-4cea4cbd3900\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"
Sep 10 21:26:59.983038 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.983018    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fcd363-7068-46ae-b849-4cea4cbd3900-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4p5wb\" (UID: \"b9fcd363-7068-46ae-b849-4cea4cbd3900\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"
Sep 10 21:26:59.989017 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:26:59.988994    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m87h\" (UniqueName: \"kubernetes.io/projected/b9fcd363-7068-46ae-b849-4cea4cbd3900-kube-api-access-7m87h\") pod \"kuadrant-console-plugin-fbdd4f445-4p5wb\" (UID: \"b9fcd363-7068-46ae-b849-4cea4cbd3900\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"
Sep 10 21:27:00.107079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:00.107051    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"
Sep 10 21:27:00.385415 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:00.385385    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb"]
Sep 10 21:27:00.386802 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:27:00.386776    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9fcd363_7068_46ae_b849_4cea4cbd3900.slice/crio-0edcdeb18ba16fc502dbc065c5ed24233dac15c3ec83096fdd8b1c5798bdc967 WatchSource:0}: Error finding container 0edcdeb18ba16fc502dbc065c5ed24233dac15c3ec83096fdd8b1c5798bdc967: Status 404 returned error can't find the container with id 0edcdeb18ba16fc502dbc065c5ed24233dac15c3ec83096fdd8b1c5798bdc967
Sep 10 21:27:00.635144 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:00.635079    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rh2z7"
Sep 10 21:27:00.699611 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:00.699578    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb" event={"ID":"b9fcd363-7068-46ae-b849-4cea4cbd3900","Type":"ContainerStarted","Data":"0edcdeb18ba16fc502dbc065c5ed24233dac15c3ec83096fdd8b1c5798bdc967"}
Sep 10 21:27:02.647601 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:02.647558    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:27:05.740568 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:05.740533    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb" event={"ID":"b9fcd363-7068-46ae-b849-4cea4cbd3900","Type":"ContainerStarted","Data":"24ff2a12709a0aaf39b426ec83f58482b4f515338b5ef6e807b9c0a901c16574"}
Sep 10 21:27:05.757163 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:05.757113    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5wb" podStartSLOduration=2.355632908 podStartE2EDuration="6.757097856s" totalImagesPullingTime="4.401464948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:27:05.754984319 +0000 UTC m=+475.957314891" watchObservedRunningTime="2026-09-10 21:27:05.757097856 +0000 UTC m=+475.959428428"
Sep 10 21:27:08.687069 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:08.687039    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:10.702313 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:10.702285    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-9rkp5"
Sep 10 21:27:10.964887 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:10.964807    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"]
Sep 10 21:27:10.965039 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:10.965014    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c" podUID="482df038-1023-4f8d-843c-e18779249fa4" containerName="manager" containerID="cri-o://e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca" gracePeriod=2
Sep 10 21:27:10.978480 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:10.978453    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"]
Sep 10 21:27:10.985865 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:10.985836    2568 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"482df038-1023-4f8d-843c-e18779249fa4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\": pods \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.030777 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.030744    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"]
Sep 10 21:27:11.030980 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.030957    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" containerName="manager" containerID="cri-o://b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3" gracePeriod=2
Sep 10 21:27:11.043415 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.043386    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="482df038-1023-4f8d-843c-e18779249fa4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.047668 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.047626    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"]
Sep 10 21:27:11.048237 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.048216    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="482df038-1023-4f8d-843c-e18779249fa4" containerName="manager"
Sep 10 21:27:11.048237 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.048238    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="482df038-1023-4f8d-843c-e18779249fa4" containerName="manager"
Sep 10 21:27:11.048398 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.048342    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="482df038-1023-4f8d-843c-e18779249fa4" containerName="manager"
Sep 10 21:27:11.051820 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.051803    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"]
Sep 10 21:27:11.051912 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.051881    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:11.054184 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.054161    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="482df038-1023-4f8d-843c-e18779249fa4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.056109 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.056081    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q94l5\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:27:11.098573 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.098537    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"]
Sep 10 21:27:11.099081 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.099059    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" containerName="manager"
Sep 10 21:27:11.099172 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.099084    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" containerName="manager"
Sep 10 21:27:11.099246 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.099225    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" containerName="manager"
Sep 10 21:27:11.102304 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.102284    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"]
Sep 10 21:27:11.102414 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.102384    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"
Sep 10 21:27:11.126434 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.126410    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"]
Sep 10 21:27:11.140899 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.140873    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"]
Sep 10 21:27:11.144491 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.144471    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:27:11.157490 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.157464    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"]
Sep 10 21:27:11.157746 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.157725    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-5g8jb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj" podUID="a839c2c9-ebaa-4868-b070-71d9c3a494f1"
Sep 10 21:27:11.178348 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.178312    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"]
Sep 10 21:27:11.182049 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.182016    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dzls\" (UniqueName: \"kubernetes.io/projected/c45709f3-ef56-47da-9c5b-a1b326ffe65c-kube-api-access-5dzls\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ksvt7\" (UID: \"c45709f3-ef56-47da-9c5b-a1b326ffe65c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:11.182165 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.182058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c45709f3-ef56-47da-9c5b-a1b326ffe65c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ksvt7\" (UID: \"c45709f3-ef56-47da-9c5b-a1b326ffe65c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:11.182165 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.182161    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g8jb\" (UniqueName: \"kubernetes.io/projected/a839c2c9-ebaa-4868-b070-71d9c3a494f1-kube-api-access-5g8jb\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pqnbj\" (UID: \"a839c2c9-ebaa-4868-b070-71d9c3a494f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"
Sep 10 21:27:11.182313 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.182184    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a839c2c9-ebaa-4868-b070-71d9c3a494f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pqnbj\" (UID: \"a839c2c9-ebaa-4868-b070-71d9c3a494f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"
Sep 10 21:27:11.197062 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.197028    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q94l5\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:27:11.199091 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.199065    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="482df038-1023-4f8d-843c-e18779249fa4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.201873 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.201719    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q94l5\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:27:11.204102 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.203916    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="482df038-1023-4f8d-843c-e18779249fa4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.279626 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.279597    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.282131 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.282101    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q94l5\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:27:11.283554 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.283529    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dzls\" (UniqueName: \"kubernetes.io/projected/c45709f3-ef56-47da-9c5b-a1b326ffe65c-kube-api-access-5dzls\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ksvt7\" (UID: \"c45709f3-ef56-47da-9c5b-a1b326ffe65c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:11.283661 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.283637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c45709f3-ef56-47da-9c5b-a1b326ffe65c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ksvt7\" (UID: \"c45709f3-ef56-47da-9c5b-a1b326ffe65c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:11.283733 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.283682    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc890ab7-b699-46d5-b6c2-f52108484609-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n7vxw\" (UID: \"dc890ab7-b699-46d5-b6c2-f52108484609\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:27:11.283886 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.283868    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8jb\" (UniqueName: \"kubernetes.io/projected/a839c2c9-ebaa-4868-b070-71d9c3a494f1-kube-api-access-5g8jb\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pqnbj\" (UID: \"a839c2c9-ebaa-4868-b070-71d9c3a494f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"
Sep 10 21:27:11.283973 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.283948    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a839c2c9-ebaa-4868-b070-71d9c3a494f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pqnbj\" (UID: \"a839c2c9-ebaa-4868-b070-71d9c3a494f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"
Sep 10 21:27:11.284089 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.284069    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hppbf\" (UniqueName: \"kubernetes.io/projected/dc890ab7-b699-46d5-b6c2-f52108484609-kube-api-access-hppbf\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n7vxw\" (UID: \"dc890ab7-b699-46d5-b6c2-f52108484609\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:27:11.284175 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.284096    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c45709f3-ef56-47da-9c5b-a1b326ffe65c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ksvt7\" (UID: \"c45709f3-ef56-47da-9c5b-a1b326ffe65c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:11.284495 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.284453    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a839c2c9-ebaa-4868-b070-71d9c3a494f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pqnbj\" (UID: \"a839c2c9-ebaa-4868-b070-71d9c3a494f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"
Sep 10 21:27:11.285194 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.285168    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="482df038-1023-4f8d-843c-e18779249fa4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.299363 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.299345    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:27:11.301493 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.301465    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q94l5\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:27:11.302363 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.302347    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dzls\" (UniqueName: \"kubernetes.io/projected/c45709f3-ef56-47da-9c5b-a1b326ffe65c-kube-api-access-5dzls\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ksvt7\" (UID: \"c45709f3-ef56-47da-9c5b-a1b326ffe65c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:11.304317 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.304294    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="482df038-1023-4f8d-843c-e18779249fa4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.305423 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.305407    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g8jb\" (UniqueName: \"kubernetes.io/projected/a839c2c9-ebaa-4868-b070-71d9c3a494f1-kube-api-access-5g8jb\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-pqnbj\" (UID: \"a839c2c9-ebaa-4868-b070-71d9c3a494f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"
Sep 10 21:27:11.385101 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.385077    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/482df038-1023-4f8d-843c-e18779249fa4-extensions-socket-volume\") pod \"482df038-1023-4f8d-843c-e18779249fa4\" (UID: \"482df038-1023-4f8d-843c-e18779249fa4\") "
Sep 10 21:27:11.385234 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.385118    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zmrb\" (UniqueName: \"kubernetes.io/projected/f6388af6-d7c8-4670-b3b7-c56e1c4925bb-kube-api-access-8zmrb\") pod \"f6388af6-d7c8-4670-b3b7-c56e1c4925bb\" (UID: \"f6388af6-d7c8-4670-b3b7-c56e1c4925bb\") "
Sep 10 21:27:11.385234 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.385181    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d28qx\" (UniqueName: \"kubernetes.io/projected/482df038-1023-4f8d-843c-e18779249fa4-kube-api-access-d28qx\") pod \"482df038-1023-4f8d-843c-e18779249fa4\" (UID: \"482df038-1023-4f8d-843c-e18779249fa4\") "
Sep 10 21:27:11.385360 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.385275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hppbf\" (UniqueName: \"kubernetes.io/projected/dc890ab7-b699-46d5-b6c2-f52108484609-kube-api-access-hppbf\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n7vxw\" (UID: \"dc890ab7-b699-46d5-b6c2-f52108484609\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:27:11.385360 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.385324    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc890ab7-b699-46d5-b6c2-f52108484609-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n7vxw\" (UID: \"dc890ab7-b699-46d5-b6c2-f52108484609\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:27:11.385522 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.385499    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/482df038-1023-4f8d-843c-e18779249fa4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "482df038-1023-4f8d-843c-e18779249fa4" (UID: "482df038-1023-4f8d-843c-e18779249fa4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:11.385645 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.385629    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc890ab7-b699-46d5-b6c2-f52108484609-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n7vxw\" (UID: \"dc890ab7-b699-46d5-b6c2-f52108484609\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:27:11.387128 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.387099    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6388af6-d7c8-4670-b3b7-c56e1c4925bb-kube-api-access-8zmrb" (OuterVolumeSpecName: "kube-api-access-8zmrb") pod "f6388af6-d7c8-4670-b3b7-c56e1c4925bb" (UID: "f6388af6-d7c8-4670-b3b7-c56e1c4925bb"). InnerVolumeSpecName "kube-api-access-8zmrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:11.387265 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.387167    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/482df038-1023-4f8d-843c-e18779249fa4-kube-api-access-d28qx" (OuterVolumeSpecName: "kube-api-access-d28qx") pod "482df038-1023-4f8d-843c-e18779249fa4" (UID: "482df038-1023-4f8d-843c-e18779249fa4"). InnerVolumeSpecName "kube-api-access-d28qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:11.394649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.394630    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hppbf\" (UniqueName: \"kubernetes.io/projected/dc890ab7-b699-46d5-b6c2-f52108484609-kube-api-access-hppbf\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n7vxw\" (UID: \"dc890ab7-b699-46d5-b6c2-f52108484609\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:27:11.408602 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.408582    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:11.456832 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.456601    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:27:11.486220 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.486168    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d28qx\" (UniqueName: \"kubernetes.io/projected/482df038-1023-4f8d-843c-e18779249fa4-kube-api-access-d28qx\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:27:11.486346 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.486235    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/482df038-1023-4f8d-843c-e18779249fa4-extensions-socket-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:27:11.486346 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.486253    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zmrb\" (UniqueName: \"kubernetes.io/projected/f6388af6-d7c8-4670-b3b7-c56e1c4925bb-kube-api-access-8zmrb\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:27:11.690163 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.690138    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"]
Sep 10 21:27:11.692289 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:27:11.692259    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45709f3_ef56_47da_9c5b_a1b326ffe65c.slice/crio-d36582e03b6a86205565bffe42d47b53573eb8ffa88ea19d34b10d6fbe2699d6 WatchSource:0}: Error finding container d36582e03b6a86205565bffe42d47b53573eb8ffa88ea19d34b10d6fbe2699d6: Status 404 returned error can't find the container with id d36582e03b6a86205565bffe42d47b53573eb8ffa88ea19d34b10d6fbe2699d6
Sep 10 21:27:11.749991 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.749968    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"]
Sep 10 21:27:11.751882 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:27:11.751851    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc890ab7_b699_46d5_b6c2_f52108484609.slice/crio-126cc77740c1c3c3bbd53f350cbb1c1174f0209d0dfa6d13a513cd4146f4e54c WatchSource:0}: Error finding container 126cc77740c1c3c3bbd53f350cbb1c1174f0209d0dfa6d13a513cd4146f4e54c: Status 404 returned error can't find the container with id 126cc77740c1c3c3bbd53f350cbb1c1174f0209d0dfa6d13a513cd4146f4e54c
Sep 10 21:27:11.777247 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.777218    2568 generic.go:356] "Generic (PLEG): container finished" podID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" containerID="b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3" exitCode=0
Sep 10 21:27:11.777361 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.777266    2568 scope.go:117] "RemoveContainer" containerID="b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3"
Sep 10 21:27:11.777427 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.777271    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:27:11.779491 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.779466    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q94l5\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:27:11.779653 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.779627    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7" event={"ID":"c45709f3-ef56-47da-9c5b-a1b326ffe65c","Type":"ContainerStarted","Data":"5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22"}
Sep 10 21:27:11.779772 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.779695    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:11.779772 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.779720    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7" event={"ID":"c45709f3-ef56-47da-9c5b-a1b326ffe65c","Type":"ContainerStarted","Data":"d36582e03b6a86205565bffe42d47b53573eb8ffa88ea19d34b10d6fbe2699d6"}
Sep 10 21:27:11.781257 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.781235    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw" event={"ID":"dc890ab7-b699-46d5-b6c2-f52108484609","Type":"ContainerStarted","Data":"126cc77740c1c3c3bbd53f350cbb1c1174f0209d0dfa6d13a513cd4146f4e54c"}
Sep 10 21:27:11.781349 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.781257    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="482df038-1023-4f8d-843c-e18779249fa4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.782725 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.782703    2568 generic.go:356] "Generic (PLEG): container finished" podID="482df038-1023-4f8d-843c-e18779249fa4" containerID="e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca" exitCode=0
Sep 10 21:27:11.782825 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.782734    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.782977 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.782952    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="482df038-1023-4f8d-843c-e18779249fa4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.783052 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.782963    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"
Sep 10 21:27:11.792269 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.792255    2568 scope.go:117] "RemoveContainer" containerID="b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3"
Sep 10 21:27:11.792503 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.792487    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3\": container with ID starting with b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3 not found: ID does not exist" containerID="b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3"
Sep 10 21:27:11.792552 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.792510    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3"} err="failed to get container status \"b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3\": rpc error: code = NotFound desc = could not find container \"b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3\": container with ID starting with b3a3913ae8268be9497f2b049967350a8d479073ad6c6f80f1e1cd8ad0ad70c3 not found: ID does not exist"
Sep 10 21:27:11.792552 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.792526    2568 scope.go:117] "RemoveContainer" containerID="e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca"
Sep 10 21:27:11.797023 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.797005    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"
Sep 10 21:27:11.806557 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.806500    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7" podStartSLOduration=1.8064826470000002 podStartE2EDuration="1.806482647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:27:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:27:11.805006564 +0000 UTC m=+482.007337137" watchObservedRunningTime="2026-09-10 21:27:11.806482647 +0000 UTC m=+482.008813220"
Sep 10 21:27:11.809349 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.809326    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q94l5\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:27:11.811451 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.811431    2568 scope.go:117] "RemoveContainer" containerID="e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca"
Sep 10 21:27:11.811727 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.811706    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca\": container with ID starting with e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca not found: ID does not exist" containerID="e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca"
Sep 10 21:27:11.811821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.811732    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca"} err="failed to get container status \"e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca\": rpc error: code = NotFound desc = could not find container \"e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca\": container with ID starting with e1acc79d3ec536dc299247c7b17287264048d1f18dfe9197fd043222e8b6a9ca not found: ID does not exist"
Sep 10 21:27:11.837463 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.837436    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-q94l5\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-q94l5"
Sep 10 21:27:11.841798 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:11.841776    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hxc8c\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="482df038-1023-4f8d-843c-e18779249fa4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hxc8c"
Sep 10 21:27:11.891871 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.891845    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a839c2c9-ebaa-4868-b070-71d9c3a494f1-extensions-socket-volume\") pod \"a839c2c9-ebaa-4868-b070-71d9c3a494f1\" (UID: \"a839c2c9-ebaa-4868-b070-71d9c3a494f1\") "
Sep 10 21:27:11.891988 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.891960    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g8jb\" (UniqueName: \"kubernetes.io/projected/a839c2c9-ebaa-4868-b070-71d9c3a494f1-kube-api-access-5g8jb\") pod \"a839c2c9-ebaa-4868-b070-71d9c3a494f1\" (UID: \"a839c2c9-ebaa-4868-b070-71d9c3a494f1\") "
Sep 10 21:27:11.892128 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.892105    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a839c2c9-ebaa-4868-b070-71d9c3a494f1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a839c2c9-ebaa-4868-b070-71d9c3a494f1" (UID: "a839c2c9-ebaa-4868-b070-71d9c3a494f1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:11.893835 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.893811    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a839c2c9-ebaa-4868-b070-71d9c3a494f1-kube-api-access-5g8jb" (OuterVolumeSpecName: "kube-api-access-5g8jb") pod "a839c2c9-ebaa-4868-b070-71d9c3a494f1" (UID: "a839c2c9-ebaa-4868-b070-71d9c3a494f1"). InnerVolumeSpecName "kube-api-access-5g8jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:11.993425 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.993404    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g8jb\" (UniqueName: \"kubernetes.io/projected/a839c2c9-ebaa-4868-b070-71d9c3a494f1-kube-api-access-5g8jb\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:27:11.993518 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:11.993426    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a839c2c9-ebaa-4868-b070-71d9c3a494f1-extensions-socket-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:27:12.198189 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:12.198157    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="482df038-1023-4f8d-843c-e18779249fa4" path="/var/lib/kubelet/pods/482df038-1023-4f8d-843c-e18779249fa4/volumes"
Sep 10 21:27:12.198526 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:12.198509    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6388af6-d7c8-4670-b3b7-c56e1c4925bb" path="/var/lib/kubelet/pods/f6388af6-d7c8-4670-b3b7-c56e1c4925bb/volumes"
Sep 10 21:27:12.791069 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:12.791029    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw" event={"ID":"dc890ab7-b699-46d5-b6c2-f52108484609","Type":"ContainerStarted","Data":"6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a"}
Sep 10 21:27:12.791536 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:12.791220    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:27:12.793126 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:12.793109    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"
Sep 10 21:27:12.813839 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:12.813797    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw" podStartSLOduration=1.813784067 podStartE2EDuration="1.813784067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:27:12.81183208 +0000 UTC m=+483.014162653" watchObservedRunningTime="2026-09-10 21:27:12.813784067 +0000 UTC m=+483.016114702"
Sep 10 21:27:12.851777 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:12.851746    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"]
Sep 10 21:27:12.857732 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:12.857707    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-pqnbj"]
Sep 10 21:27:14.196419 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:14.196381    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a839c2c9-ebaa-4868-b070-71d9c3a494f1" path="/var/lib/kubelet/pods/a839c2c9-ebaa-4868-b070-71d9c3a494f1/volumes"
Sep 10 21:27:22.795064 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:22.795030    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:23.801326 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:23.801299    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:27:23.887832 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:23.887801    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"]
Sep 10 21:27:23.888014 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:23.887989    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7" podUID="c45709f3-ef56-47da-9c5b-a1b326ffe65c" containerName="manager" containerID="cri-o://5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22" gracePeriod=10
Sep 10 21:27:24.133704 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.133679    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:24.187970 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.187948    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c45709f3-ef56-47da-9c5b-a1b326ffe65c-extensions-socket-volume\") pod \"c45709f3-ef56-47da-9c5b-a1b326ffe65c\" (UID: \"c45709f3-ef56-47da-9c5b-a1b326ffe65c\") "
Sep 10 21:27:24.188091 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.187986    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dzls\" (UniqueName: \"kubernetes.io/projected/c45709f3-ef56-47da-9c5b-a1b326ffe65c-kube-api-access-5dzls\") pod \"c45709f3-ef56-47da-9c5b-a1b326ffe65c\" (UID: \"c45709f3-ef56-47da-9c5b-a1b326ffe65c\") "
Sep 10 21:27:24.188321 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.188297    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45709f3-ef56-47da-9c5b-a1b326ffe65c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c45709f3-ef56-47da-9c5b-a1b326ffe65c" (UID: "c45709f3-ef56-47da-9c5b-a1b326ffe65c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:24.189957 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.189936    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45709f3-ef56-47da-9c5b-a1b326ffe65c-kube-api-access-5dzls" (OuterVolumeSpecName: "kube-api-access-5dzls") pod "c45709f3-ef56-47da-9c5b-a1b326ffe65c" (UID: "c45709f3-ef56-47da-9c5b-a1b326ffe65c"). InnerVolumeSpecName "kube-api-access-5dzls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:24.288760 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.288734    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c45709f3-ef56-47da-9c5b-a1b326ffe65c-extensions-socket-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:27:24.288760 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.288756    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dzls\" (UniqueName: \"kubernetes.io/projected/c45709f3-ef56-47da-9c5b-a1b326ffe65c-kube-api-access-5dzls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:27:24.862312 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.862279    2568 generic.go:356] "Generic (PLEG): container finished" podID="c45709f3-ef56-47da-9c5b-a1b326ffe65c" containerID="5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22" exitCode=0
Sep 10 21:27:24.862718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.862325    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"
Sep 10 21:27:24.862718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.862372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7" event={"ID":"c45709f3-ef56-47da-9c5b-a1b326ffe65c","Type":"ContainerDied","Data":"5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22"}
Sep 10 21:27:24.862718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.862423    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7" event={"ID":"c45709f3-ef56-47da-9c5b-a1b326ffe65c","Type":"ContainerDied","Data":"d36582e03b6a86205565bffe42d47b53573eb8ffa88ea19d34b10d6fbe2699d6"}
Sep 10 21:27:24.862718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.862447    2568 scope.go:117] "RemoveContainer" containerID="5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22"
Sep 10 21:27:24.871663 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.871642    2568 scope.go:117] "RemoveContainer" containerID="5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22"
Sep 10 21:27:24.871913 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:24.871894    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22\": container with ID starting with 5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22 not found: ID does not exist" containerID="5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22"
Sep 10 21:27:24.871965 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.871921    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22"} err="failed to get container status \"5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22\": rpc error: code = NotFound desc = could not find container \"5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22\": container with ID starting with 5718adb4469c29c31dbf0b802e0d7a2d3ab43ca8d9e8543fe57dcadddecd3a22 not found: ID does not exist"
Sep 10 21:27:24.886966 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.886944    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"]
Sep 10 21:27:24.897009 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:24.896989    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ksvt7"]
Sep 10 21:27:26.196363 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:26.196327    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c45709f3-ef56-47da-9c5b-a1b326ffe65c" path="/var/lib/kubelet/pods/c45709f3-ef56-47da-9c5b-a1b326ffe65c/volumes"
Sep 10 21:27:40.297032 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.297000    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"]
Sep 10 21:27:40.297524 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.297447    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45709f3-ef56-47da-9c5b-a1b326ffe65c" containerName="manager"
Sep 10 21:27:40.297524 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.297460    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45709f3-ef56-47da-9c5b-a1b326ffe65c" containerName="manager"
Sep 10 21:27:40.297524 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.297517    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45709f3-ef56-47da-9c5b-a1b326ffe65c" containerName="manager"
Sep 10 21:27:40.316610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.316583    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.316758 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.316656    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"]
Sep 10 21:27:40.319739 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.319712    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8f7q5\""
Sep 10 21:27:40.319903 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.319885    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 21:27:40.412787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.412759    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.412787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.412789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs8sb\" (UniqueName: \"kubernetes.io/projected/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-kube-api-access-fs8sb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.412952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.412810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.412952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.412865    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.412952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.412885    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.412952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.412904    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.412952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.412924    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.412952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.412944    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.413148 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.412959    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.513768 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.513740    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs8sb\" (UniqueName: \"kubernetes.io/projected/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-kube-api-access-fs8sb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.513901 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.513774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.513901 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.513803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.513986 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.513917    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.513986 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.513960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.514093 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.514001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.514093 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.514032    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.514093 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.514064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.514295 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.514134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.514295 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.514166    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.514295 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.514266    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.514453 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.514394    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.514500 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.514467    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.514894 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.514872    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.516367 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.516342    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.516713 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.516695    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.522811 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.522791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.525389 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.525363    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs8sb\" (UniqueName: \"kubernetes.io/projected/bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e-kube-api-access-fs8sb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-st2bc\" (UID: \"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.630182 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.630160    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:40.906211 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.906170    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"]
Sep 10 21:27:40.907422 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:27:40.907394    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd36f04_c9cc_4b3e_8644_1a7ec4f1072e.slice/crio-2090d994e8af40af26dc370356ee499fc3d56cc0c6771a4087827a74a525fc9f WatchSource:0}: Error finding container 2090d994e8af40af26dc370356ee499fc3d56cc0c6771a4087827a74a525fc9f: Status 404 returned error can't find the container with id 2090d994e8af40af26dc370356ee499fc3d56cc0c6771a4087827a74a525fc9f
Sep 10 21:27:40.957700 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:40.957671    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc" event={"ID":"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e","Type":"ContainerStarted","Data":"2090d994e8af40af26dc370356ee499fc3d56cc0c6771a4087827a74a525fc9f"}
Sep 10 21:27:43.535806 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:43.535758    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:27:43.536093 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:43.535845    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:27:43.536093 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:43.535874    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:27:43.980181 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:43.980145    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc" event={"ID":"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e","Type":"ContainerStarted","Data":"5c289a875d56726120e891d934c8ed306fceddf6de0bbc649b938e2a82b98d07"}
Sep 10 21:27:44.001632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:44.001586    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc" podStartSLOduration=1.375612604 podStartE2EDuration="4.001572521s" totalImagesPullingTime="2.625959917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:27:43.999594561 +0000 UTC m=+514.201925145" watchObservedRunningTime="2026-09-10 21:27:44.001572521 +0000 UTC m=+514.203903092"
Sep 10 21:27:44.630905 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:44.630872    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:44.635859 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:44.635827    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:44.986396 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:44.986315    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:44.987417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:44.987391    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:27:45.003503 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.003470    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fq9gl"]
Sep 10 21:27:45.007169 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.007149    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:27:45.009672 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.009648    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 21:27:45.018717 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.018693    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fq9gl"]
Sep 10 21:27:45.054325 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.054293    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-config-file\") pod \"limitador-limitador-8588749977-fq9gl\" (UID: \"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60\") " pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:27:45.054499 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.054468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svv4v\" (UniqueName: \"kubernetes.io/projected/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-kube-api-access-svv4v\") pod \"limitador-limitador-8588749977-fq9gl\" (UID: \"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60\") " pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:27:45.104915 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.104883    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fq9gl"]
Sep 10 21:27:45.155550 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.155519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svv4v\" (UniqueName: \"kubernetes.io/projected/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-kube-api-access-svv4v\") pod \"limitador-limitador-8588749977-fq9gl\" (UID: \"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60\") " pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:27:45.155709 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.155679    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-config-file\") pod \"limitador-limitador-8588749977-fq9gl\" (UID: \"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60\") " pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:27:45.156345 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.156327    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-config-file\") pod \"limitador-limitador-8588749977-fq9gl\" (UID: \"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60\") " pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:27:45.163811 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.163791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svv4v\" (UniqueName: \"kubernetes.io/projected/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-kube-api-access-svv4v\") pod \"limitador-limitador-8588749977-fq9gl\" (UID: \"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60\") " pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:27:45.318281 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.318252    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:27:45.589738 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.589711    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fq9gl"]
Sep 10 21:27:45.591371 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:27:45.591344    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806995e7_ec4f_4d54_a3bf_9fdbdbb68a60.slice/crio-48c16c60ace4c48c799d701ba0682ab566718793fe3bb59553f0d60e80c2834f WatchSource:0}: Error finding container 48c16c60ace4c48c799d701ba0682ab566718793fe3bb59553f0d60e80c2834f: Status 404 returned error can't find the container with id 48c16c60ace4c48c799d701ba0682ab566718793fe3bb59553f0d60e80c2834f
Sep 10 21:27:45.798576 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.798549    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z82tc"]
Sep 10 21:27:45.803805 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.803785    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc"
Sep 10 21:27:45.806393 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.806369    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j8k9d\""
Sep 10 21:27:45.808890 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.808866    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z82tc"]
Sep 10 21:27:45.861395 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.861325    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnbqh\" (UniqueName: \"kubernetes.io/projected/4cf09ffa-b3ed-4185-91ce-e635d21257d0-kube-api-access-wnbqh\") pod \"authorino-7bcfd8f9cd-z82tc\" (UID: \"4cf09ffa-b3ed-4185-91ce-e635d21257d0\") " pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc"
Sep 10 21:27:45.904089 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.904062    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-sd4zl"]
Sep 10 21:27:45.907959 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.907939    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-sd4zl"
Sep 10 21:27:45.916646 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.916628    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-sd4zl"]
Sep 10 21:27:45.961921 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.961897    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnbqh\" (UniqueName: \"kubernetes.io/projected/4cf09ffa-b3ed-4185-91ce-e635d21257d0-kube-api-access-wnbqh\") pod \"authorino-7bcfd8f9cd-z82tc\" (UID: \"4cf09ffa-b3ed-4185-91ce-e635d21257d0\") " pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc"
Sep 10 21:27:45.962051 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.961951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8v9f\" (UniqueName: \"kubernetes.io/projected/0a65e140-8b1a-44db-aea8-046bc25ba5d6-kube-api-access-g8v9f\") pod \"authorino-59c974bd48-sd4zl\" (UID: \"0a65e140-8b1a-44db-aea8-046bc25ba5d6\") " pod="kuadrant-system/authorino-59c974bd48-sd4zl"
Sep 10 21:27:45.969839 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.969814    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnbqh\" (UniqueName: \"kubernetes.io/projected/4cf09ffa-b3ed-4185-91ce-e635d21257d0-kube-api-access-wnbqh\") pod \"authorino-7bcfd8f9cd-z82tc\" (UID: \"4cf09ffa-b3ed-4185-91ce-e635d21257d0\") " pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc"
Sep 10 21:27:45.993836 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:45.993813    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl" event={"ID":"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60","Type":"ContainerStarted","Data":"48c16c60ace4c48c799d701ba0682ab566718793fe3bb59553f0d60e80c2834f"}
Sep 10 21:27:46.062515 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:46.062486    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8v9f\" (UniqueName: \"kubernetes.io/projected/0a65e140-8b1a-44db-aea8-046bc25ba5d6-kube-api-access-g8v9f\") pod \"authorino-59c974bd48-sd4zl\" (UID: \"0a65e140-8b1a-44db-aea8-046bc25ba5d6\") " pod="kuadrant-system/authorino-59c974bd48-sd4zl"
Sep 10 21:27:46.072426 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:46.072406    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8v9f\" (UniqueName: \"kubernetes.io/projected/0a65e140-8b1a-44db-aea8-046bc25ba5d6-kube-api-access-g8v9f\") pod \"authorino-59c974bd48-sd4zl\" (UID: \"0a65e140-8b1a-44db-aea8-046bc25ba5d6\") " pod="kuadrant-system/authorino-59c974bd48-sd4zl"
Sep 10 21:27:46.115342 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:46.115290    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc"
Sep 10 21:27:46.217664 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:46.217639    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-sd4zl"
Sep 10 21:27:46.384397 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:46.384366    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z82tc"]
Sep 10 21:27:46.385405 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:27:46.385381    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cf09ffa_b3ed_4185_91ce_e635d21257d0.slice/crio-7685fe4cb8b920d05745d00e87b80e61fb5c5ac780c5d1cbe83aa50625e94c15 WatchSource:0}: Error finding container 7685fe4cb8b920d05745d00e87b80e61fb5c5ac780c5d1cbe83aa50625e94c15: Status 404 returned error can't find the container with id 7685fe4cb8b920d05745d00e87b80e61fb5c5ac780c5d1cbe83aa50625e94c15
Sep 10 21:27:46.489012 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:46.488986    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-sd4zl"]
Sep 10 21:27:46.489924 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:27:46.489901    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a65e140_8b1a_44db_aea8_046bc25ba5d6.slice/crio-4dcb85002f6d509198cdf30953eee346e5777a0e8f1f25b52dad417fc1780daf WatchSource:0}: Error finding container 4dcb85002f6d509198cdf30953eee346e5777a0e8f1f25b52dad417fc1780daf: Status 404 returned error can't find the container with id 4dcb85002f6d509198cdf30953eee346e5777a0e8f1f25b52dad417fc1780daf
Sep 10 21:27:47.001387 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:47.001355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-sd4zl" event={"ID":"0a65e140-8b1a-44db-aea8-046bc25ba5d6","Type":"ContainerStarted","Data":"4dcb85002f6d509198cdf30953eee346e5777a0e8f1f25b52dad417fc1780daf"}
Sep 10 21:27:47.002472 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:47.002447    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc" event={"ID":"4cf09ffa-b3ed-4185-91ce-e635d21257d0","Type":"ContainerStarted","Data":"7685fe4cb8b920d05745d00e87b80e61fb5c5ac780c5d1cbe83aa50625e94c15"}
Sep 10 21:27:48.009797 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:48.009757    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl" event={"ID":"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60","Type":"ContainerStarted","Data":"91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0"}
Sep 10 21:27:48.010178 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:48.009826    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:27:48.071013 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:48.070966    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl" podStartSLOduration=2.699216608 podStartE2EDuration="4.070950737s" totalImagesPullingTime="1.371734129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:27:48.069386804 +0000 UTC m=+518.271717376" watchObservedRunningTime="2026-09-10 21:27:48.070950737 +0000 UTC m=+518.273281308"
Sep 10 21:27:49.017430 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:49.017392    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc" event={"ID":"4cf09ffa-b3ed-4185-91ce-e635d21257d0","Type":"ContainerStarted","Data":"b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e"}
Sep 10 21:27:49.018995 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:49.018966    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-sd4zl" event={"ID":"0a65e140-8b1a-44db-aea8-046bc25ba5d6","Type":"ContainerStarted","Data":"c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb"}
Sep 10 21:27:49.053487 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:49.053432    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc" podStartSLOduration=2.35353492 podStartE2EDuration="4.053410577s" totalImagesPullingTime="1.699875657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:27:49.036481218 +0000 UTC m=+519.238811789" watchObservedRunningTime="2026-09-10 21:27:49.053410577 +0000 UTC m=+519.255741153"
Sep 10 21:27:49.055227 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:49.055161    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-sd4zl" podStartSLOduration=2.455504961 podStartE2EDuration="4.05514332s" totalImagesPullingTime="1.599638359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:27:49.050378341 +0000 UTC m=+519.252708917" watchObservedRunningTime="2026-09-10 21:27:49.05514332 +0000 UTC m=+519.257473893"
Sep 10 21:27:49.083268 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:49.083231    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z82tc"]
Sep 10 21:27:51.030362 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:51.030326    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc" podUID="4cf09ffa-b3ed-4185-91ce-e635d21257d0" containerName="authorino" containerID="cri-o://b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e" gracePeriod=30
Sep 10 21:27:51.276426 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:51.276404    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc"
Sep 10 21:27:51.419989 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:51.419958    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnbqh\" (UniqueName: \"kubernetes.io/projected/4cf09ffa-b3ed-4185-91ce-e635d21257d0-kube-api-access-wnbqh\") pod \"4cf09ffa-b3ed-4185-91ce-e635d21257d0\" (UID: \"4cf09ffa-b3ed-4185-91ce-e635d21257d0\") "
Sep 10 21:27:51.421938 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:51.421906    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cf09ffa-b3ed-4185-91ce-e635d21257d0-kube-api-access-wnbqh" (OuterVolumeSpecName: "kube-api-access-wnbqh") pod "4cf09ffa-b3ed-4185-91ce-e635d21257d0" (UID: "4cf09ffa-b3ed-4185-91ce-e635d21257d0"). InnerVolumeSpecName "kube-api-access-wnbqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:51.521355 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:51.521328    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnbqh\" (UniqueName: \"kubernetes.io/projected/4cf09ffa-b3ed-4185-91ce-e635d21257d0-kube-api-access-wnbqh\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:27:52.036993 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:52.036958    2568 generic.go:356] "Generic (PLEG): container finished" podID="4cf09ffa-b3ed-4185-91ce-e635d21257d0" containerID="b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e" exitCode=0
Sep 10 21:27:52.037442 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:52.037004    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc"
Sep 10 21:27:52.037442 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:52.037040    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc" event={"ID":"4cf09ffa-b3ed-4185-91ce-e635d21257d0","Type":"ContainerDied","Data":"b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e"}
Sep 10 21:27:52.037442 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:52.037089    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-z82tc" event={"ID":"4cf09ffa-b3ed-4185-91ce-e635d21257d0","Type":"ContainerDied","Data":"7685fe4cb8b920d05745d00e87b80e61fb5c5ac780c5d1cbe83aa50625e94c15"}
Sep 10 21:27:52.037442 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:52.037112    2568 scope.go:117] "RemoveContainer" containerID="b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e"
Sep 10 21:27:52.046409 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:52.046393    2568 scope.go:117] "RemoveContainer" containerID="b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e"
Sep 10 21:27:52.046678 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:27:52.046659    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e\": container with ID starting with b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e not found: ID does not exist" containerID="b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e"
Sep 10 21:27:52.046752 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:52.046684    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e"} err="failed to get container status \"b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e\": rpc error: code = NotFound desc = could not find container \"b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e\": container with ID starting with b886a0d5aaec7bc6a4c4b500866379c14b262a0fbc53a6739e3f19c715a7386e not found: ID does not exist"
Sep 10 21:27:52.059456 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:52.059431    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z82tc"]
Sep 10 21:27:52.063585 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:52.063561    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-z82tc"]
Sep 10 21:27:52.196956 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:52.196931    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cf09ffa-b3ed-4185-91ce-e635d21257d0" path="/var/lib/kubelet/pods/4cf09ffa-b3ed-4185-91ce-e635d21257d0/volumes"
Sep 10 21:27:59.019792 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:59.019757    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:27:59.108230 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:59.108185    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fq9gl"]
Sep 10 21:27:59.108469 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:59.108417    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl" podUID="806995e7-ec4f-4d54-a3bf-9fdbdbb68a60" containerName="limitador" containerID="cri-o://91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0" gracePeriod=30
Sep 10 21:27:59.660280 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:59.660258    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:27:59.786983 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:59.786914    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svv4v\" (UniqueName: \"kubernetes.io/projected/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-kube-api-access-svv4v\") pod \"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60\" (UID: \"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60\") "
Sep 10 21:27:59.786983 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:59.786950    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-config-file\") pod \"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60\" (UID: \"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60\") "
Sep 10 21:27:59.787370 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:59.787347    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-config-file" (OuterVolumeSpecName: "config-file") pod "806995e7-ec4f-4d54-a3bf-9fdbdbb68a60" (UID: "806995e7-ec4f-4d54-a3bf-9fdbdbb68a60"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:27:59.788969 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:59.788946    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-kube-api-access-svv4v" (OuterVolumeSpecName: "kube-api-access-svv4v") pod "806995e7-ec4f-4d54-a3bf-9fdbdbb68a60" (UID: "806995e7-ec4f-4d54-a3bf-9fdbdbb68a60"). InnerVolumeSpecName "kube-api-access-svv4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:59.888397 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:59.888369    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svv4v\" (UniqueName: \"kubernetes.io/projected/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-kube-api-access-svv4v\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:27:59.888397 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:27:59.888393    2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60-config-file\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:28:00.087686 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:00.087654    2568 generic.go:356] "Generic (PLEG): container finished" podID="806995e7-ec4f-4d54-a3bf-9fdbdbb68a60" containerID="91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0" exitCode=0
Sep 10 21:28:00.088133 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:00.087711    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl"
Sep 10 21:28:00.088133 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:00.087742    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl" event={"ID":"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60","Type":"ContainerDied","Data":"91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0"}
Sep 10 21:28:00.088133 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:00.087795    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-fq9gl" event={"ID":"806995e7-ec4f-4d54-a3bf-9fdbdbb68a60","Type":"ContainerDied","Data":"48c16c60ace4c48c799d701ba0682ab566718793fe3bb59553f0d60e80c2834f"}
Sep 10 21:28:00.088133 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:00.087818    2568 scope.go:117] "RemoveContainer" containerID="91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0"
Sep 10 21:28:00.097939 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:00.097922    2568 scope.go:117] "RemoveContainer" containerID="91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0"
Sep 10 21:28:00.098315 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:28:00.098180    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0\": container with ID starting with 91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0 not found: ID does not exist" containerID="91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0"
Sep 10 21:28:00.098315 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:00.098294    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0"} err="failed to get container status \"91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0\": rpc error: code = NotFound desc = could not find container \"91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0\": container with ID starting with 91ea74effc6d82971a9b5949ef77a25a3b3650ae1f7c9a91ecd73338aa2859f0 not found: ID does not exist"
Sep 10 21:28:00.111946 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:00.111916    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fq9gl"]
Sep 10 21:28:00.117699 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:00.117679    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-fq9gl"]
Sep 10 21:28:00.195753 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:00.195723    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="806995e7-ec4f-4d54-a3bf-9fdbdbb68a60" path="/var/lib/kubelet/pods/806995e7-ec4f-4d54-a3bf-9fdbdbb68a60/volumes"
Sep 10 21:28:01.610377 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.610345    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"]
Sep 10 21:28:01.610927 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.610902    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cf09ffa-b3ed-4185-91ce-e635d21257d0" containerName="authorino"
Sep 10 21:28:01.611022 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.610931    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cf09ffa-b3ed-4185-91ce-e635d21257d0" containerName="authorino"
Sep 10 21:28:01.611022 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.610946    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="806995e7-ec4f-4d54-a3bf-9fdbdbb68a60" containerName="limitador"
Sep 10 21:28:01.611022 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.610955    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="806995e7-ec4f-4d54-a3bf-9fdbdbb68a60" containerName="limitador"
Sep 10 21:28:01.611133 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.611075    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cf09ffa-b3ed-4185-91ce-e635d21257d0" containerName="authorino"
Sep 10 21:28:01.611133 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.611087    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="806995e7-ec4f-4d54-a3bf-9fdbdbb68a60" containerName="limitador"
Sep 10 21:28:01.615380 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.615358    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"
Sep 10 21:28:01.618666 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.618475    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 21:28:01.619637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.619613    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:28:01.619753 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.619712    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 21:28:01.619907 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.619878    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wg466\""
Sep 10 21:28:01.622506 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.622481    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"]
Sep 10 21:28:01.701575 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.701550    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9dnk\" (UniqueName: \"kubernetes.io/projected/eecf4422-9c68-4b2e-81d0-afdf40372332-kube-api-access-w9dnk\") pod \"postgres-69fb4594cf-hf44c\" (UID: \"eecf4422-9c68-4b2e-81d0-afdf40372332\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"
Sep 10 21:28:01.701698 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.701593    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eecf4422-9c68-4b2e-81d0-afdf40372332-data\") pod \"postgres-69fb4594cf-hf44c\" (UID: \"eecf4422-9c68-4b2e-81d0-afdf40372332\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"
Sep 10 21:28:01.802354 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.802317    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9dnk\" (UniqueName: \"kubernetes.io/projected/eecf4422-9c68-4b2e-81d0-afdf40372332-kube-api-access-w9dnk\") pod \"postgres-69fb4594cf-hf44c\" (UID: \"eecf4422-9c68-4b2e-81d0-afdf40372332\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"
Sep 10 21:28:01.802476 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.802371    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eecf4422-9c68-4b2e-81d0-afdf40372332-data\") pod \"postgres-69fb4594cf-hf44c\" (UID: \"eecf4422-9c68-4b2e-81d0-afdf40372332\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"
Sep 10 21:28:01.802684 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.802669    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eecf4422-9c68-4b2e-81d0-afdf40372332-data\") pod \"postgres-69fb4594cf-hf44c\" (UID: \"eecf4422-9c68-4b2e-81d0-afdf40372332\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"
Sep 10 21:28:01.822296 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.822273    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9dnk\" (UniqueName: \"kubernetes.io/projected/eecf4422-9c68-4b2e-81d0-afdf40372332-kube-api-access-w9dnk\") pod \"postgres-69fb4594cf-hf44c\" (UID: \"eecf4422-9c68-4b2e-81d0-afdf40372332\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"
Sep 10 21:28:01.929921 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:01.929841    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"
Sep 10 21:28:02.209076 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:02.209052    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"]
Sep 10 21:28:02.210555 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:28:02.210524    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeecf4422_9c68_4b2e_81d0_afdf40372332.slice/crio-21b82c05f1a277b5ca23477d4e5cc3ccd815772d2f6e2a2346bb95e494782b0a WatchSource:0}: Error finding container 21b82c05f1a277b5ca23477d4e5cc3ccd815772d2f6e2a2346bb95e494782b0a: Status 404 returned error can't find the container with id 21b82c05f1a277b5ca23477d4e5cc3ccd815772d2f6e2a2346bb95e494782b0a
Sep 10 21:28:03.109332 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:03.109258    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c" event={"ID":"eecf4422-9c68-4b2e-81d0-afdf40372332","Type":"ContainerStarted","Data":"21b82c05f1a277b5ca23477d4e5cc3ccd815772d2f6e2a2346bb95e494782b0a"}
Sep 10 21:28:05.123260 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:05.123222    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c" event={"ID":"eecf4422-9c68-4b2e-81d0-afdf40372332","Type":"ContainerStarted","Data":"074837019e8b3372a12b4a811d68f0de8435544ca31d681c9ec73ccfdda68326"}
Sep 10 21:28:05.123604 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:05.123361    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"
Sep 10 21:28:05.139969 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:05.139926    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c" podStartSLOduration=1.759977534 podStartE2EDuration="4.139912122s" totalImagesPullingTime="2.379934588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:28:05.138237944 +0000 UTC m=+535.340568536" watchObservedRunningTime="2026-09-10 21:28:05.139912122 +0000 UTC m=+535.342242694"
Sep 10 21:28:11.158513 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:11.158484    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hf44c"
Sep 10 21:28:11.757055 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:11.757023    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-jjcjv"]
Sep 10 21:28:11.762336 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:11.762311    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jjcjv"
Sep 10 21:28:11.767745 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:11.767722    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-jjcjv"]
Sep 10 21:28:11.881649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:11.881621    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvrg9\" (UniqueName: \"kubernetes.io/projected/d00bd868-33e3-4fcf-85d6-6be5cf92badb-kube-api-access-mvrg9\") pod \"authorino-557f876f69-jjcjv\" (UID: \"d00bd868-33e3-4fcf-85d6-6be5cf92badb\") " pod="kuadrant-system/authorino-557f876f69-jjcjv"
Sep 10 21:28:11.982947 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:11.982920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvrg9\" (UniqueName: \"kubernetes.io/projected/d00bd868-33e3-4fcf-85d6-6be5cf92badb-kube-api-access-mvrg9\") pod \"authorino-557f876f69-jjcjv\" (UID: \"d00bd868-33e3-4fcf-85d6-6be5cf92badb\") " pod="kuadrant-system/authorino-557f876f69-jjcjv"
Sep 10 21:28:11.991991 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:11.991966    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvrg9\" (UniqueName: \"kubernetes.io/projected/d00bd868-33e3-4fcf-85d6-6be5cf92badb-kube-api-access-mvrg9\") pod \"authorino-557f876f69-jjcjv\" (UID: \"d00bd868-33e3-4fcf-85d6-6be5cf92badb\") " pod="kuadrant-system/authorino-557f876f69-jjcjv"
Sep 10 21:28:12.014995 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:12.014938    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-jjcjv"]
Sep 10 21:28:12.015179 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:12.015167    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jjcjv"
Sep 10 21:28:12.046680 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:12.046626    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64f9b67b59-p4qqf"]
Sep 10 21:28:12.051361 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:12.051340    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f9b67b59-p4qqf"
Sep 10 21:28:12.057224 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:12.057180    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64f9b67b59-p4qqf"]
Sep 10 21:28:12.185140 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:12.185111    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q275x\" (UniqueName: \"kubernetes.io/projected/69338c21-2fe1-4c26-b21a-ececb887ba04-kube-api-access-q275x\") pod \"authorino-64f9b67b59-p4qqf\" (UID: \"69338c21-2fe1-4c26-b21a-ececb887ba04\") " pod="kuadrant-system/authorino-64f9b67b59-p4qqf"
Sep 10 21:28:12.285673 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:12.285604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q275x\" (UniqueName: \"kubernetes.io/projected/69338c21-2fe1-4c26-b21a-ececb887ba04-kube-api-access-q275x\") pod \"authorino-64f9b67b59-p4qqf\" (UID: \"69338c21-2fe1-4c26-b21a-ececb887ba04\") " pod="kuadrant-system/authorino-64f9b67b59-p4qqf"
Sep 10 21:28:12.291272 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:12.291252    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-jjcjv"]
Sep 10 21:28:12.293477 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:28:12.293440    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd00bd868_33e3_4fcf_85d6_6be5cf92badb.slice/crio-d324b83f55bf4494ca88cada70fae94772c6c2c240a0e42338431a10edf9c056 WatchSource:0}: Error finding container d324b83f55bf4494ca88cada70fae94772c6c2c240a0e42338431a10edf9c056: Status 404 returned error can't find the container with id d324b83f55bf4494ca88cada70fae94772c6c2c240a0e42338431a10edf9c056
Sep 10 21:28:12.296060 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:12.296038    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q275x\" (UniqueName: \"kubernetes.io/projected/69338c21-2fe1-4c26-b21a-ececb887ba04-kube-api-access-q275x\") pod \"authorino-64f9b67b59-p4qqf\" (UID: \"69338c21-2fe1-4c26-b21a-ececb887ba04\") " pod="kuadrant-system/authorino-64f9b67b59-p4qqf"
Sep 10 21:28:12.363078 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:12.363059    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f9b67b59-p4qqf"
Sep 10 21:28:12.634135 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:12.634109    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64f9b67b59-p4qqf"]
Sep 10 21:28:12.634664 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:28:12.634634    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69338c21_2fe1_4c26_b21a_ececb887ba04.slice/crio-34be444e401e3ce45adc110d1863828fac58c88cb0a69d5ad181e91e9d775398 WatchSource:0}: Error finding container 34be444e401e3ce45adc110d1863828fac58c88cb0a69d5ad181e91e9d775398: Status 404 returned error can't find the container with id 34be444e401e3ce45adc110d1863828fac58c88cb0a69d5ad181e91e9d775398
Sep 10 21:28:13.172214 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.172161    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-jjcjv" event={"ID":"d00bd868-33e3-4fcf-85d6-6be5cf92badb","Type":"ContainerStarted","Data":"255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a"}
Sep 10 21:28:13.172365 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.172237    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-jjcjv" event={"ID":"d00bd868-33e3-4fcf-85d6-6be5cf92badb","Type":"ContainerStarted","Data":"d324b83f55bf4494ca88cada70fae94772c6c2c240a0e42338431a10edf9c056"}
Sep 10 21:28:13.172365 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.172173    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-jjcjv" podUID="d00bd868-33e3-4fcf-85d6-6be5cf92badb" containerName="authorino" containerID="cri-o://255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a" gracePeriod=30
Sep 10 21:28:13.174465 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.174433    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f9b67b59-p4qqf" event={"ID":"69338c21-2fe1-4c26-b21a-ececb887ba04","Type":"ContainerStarted","Data":"9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10"}
Sep 10 21:28:13.174583 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.174484    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f9b67b59-p4qqf" event={"ID":"69338c21-2fe1-4c26-b21a-ececb887ba04","Type":"ContainerStarted","Data":"34be444e401e3ce45adc110d1863828fac58c88cb0a69d5ad181e91e9d775398"}
Sep 10 21:28:13.190867 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.190829    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-jjcjv" podStartSLOduration=1.8134280600000001 podStartE2EDuration="2.190814575s" totalImagesPullingTime="377.386515ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:28:13.189318975 +0000 UTC m=+543.391649547" watchObservedRunningTime="2026-09-10 21:28:13.190814575 +0000 UTC m=+543.393145147"
Sep 10 21:28:13.216067 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.216022    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64f9b67b59-p4qqf" podStartSLOduration=0.806994929 podStartE2EDuration="1.216007432s" totalImagesPullingTime="409.012503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:28:13.214062847 +0000 UTC m=+543.416393420" watchObservedRunningTime="2026-09-10 21:28:13.216007432 +0000 UTC m=+543.418338042"
Sep 10 21:28:13.251034 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.251005    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-sd4zl"]
Sep 10 21:28:13.251230 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.251192    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-sd4zl" podUID="0a65e140-8b1a-44db-aea8-046bc25ba5d6" containerName="authorino" containerID="cri-o://c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb" gracePeriod=30
Sep 10 21:28:13.515953 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.515931    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jjcjv"
Sep 10 21:28:13.518832 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.518812    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-sd4zl"
Sep 10 21:28:13.597081 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.597049    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvrg9\" (UniqueName: \"kubernetes.io/projected/d00bd868-33e3-4fcf-85d6-6be5cf92badb-kube-api-access-mvrg9\") pod \"d00bd868-33e3-4fcf-85d6-6be5cf92badb\" (UID: \"d00bd868-33e3-4fcf-85d6-6be5cf92badb\") "
Sep 10 21:28:13.597252 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.597095    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8v9f\" (UniqueName: \"kubernetes.io/projected/0a65e140-8b1a-44db-aea8-046bc25ba5d6-kube-api-access-g8v9f\") pod \"0a65e140-8b1a-44db-aea8-046bc25ba5d6\" (UID: \"0a65e140-8b1a-44db-aea8-046bc25ba5d6\") "
Sep 10 21:28:13.599225 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.599172    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a65e140-8b1a-44db-aea8-046bc25ba5d6-kube-api-access-g8v9f" (OuterVolumeSpecName: "kube-api-access-g8v9f") pod "0a65e140-8b1a-44db-aea8-046bc25ba5d6" (UID: "0a65e140-8b1a-44db-aea8-046bc25ba5d6"). InnerVolumeSpecName "kube-api-access-g8v9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:28:13.599225 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.599189    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d00bd868-33e3-4fcf-85d6-6be5cf92badb-kube-api-access-mvrg9" (OuterVolumeSpecName: "kube-api-access-mvrg9") pod "d00bd868-33e3-4fcf-85d6-6be5cf92badb" (UID: "d00bd868-33e3-4fcf-85d6-6be5cf92badb"). InnerVolumeSpecName "kube-api-access-mvrg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:28:13.698487 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.698425    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvrg9\" (UniqueName: \"kubernetes.io/projected/d00bd868-33e3-4fcf-85d6-6be5cf92badb-kube-api-access-mvrg9\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:28:13.698487 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:13.698447    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8v9f\" (UniqueName: \"kubernetes.io/projected/0a65e140-8b1a-44db-aea8-046bc25ba5d6-kube-api-access-g8v9f\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:28:14.181651 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.181620    2568 generic.go:356] "Generic (PLEG): container finished" podID="d00bd868-33e3-4fcf-85d6-6be5cf92badb" containerID="255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a" exitCode=0
Sep 10 21:28:14.181821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.181663    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jjcjv"
Sep 10 21:28:14.181821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.181710    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-jjcjv" event={"ID":"d00bd868-33e3-4fcf-85d6-6be5cf92badb","Type":"ContainerDied","Data":"255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a"}
Sep 10 21:28:14.181821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.181753    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-jjcjv" event={"ID":"d00bd868-33e3-4fcf-85d6-6be5cf92badb","Type":"ContainerDied","Data":"d324b83f55bf4494ca88cada70fae94772c6c2c240a0e42338431a10edf9c056"}
Sep 10 21:28:14.181821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.181779    2568 scope.go:117] "RemoveContainer" containerID="255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a"
Sep 10 21:28:14.183186 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.183073    2568 generic.go:356] "Generic (PLEG): container finished" podID="0a65e140-8b1a-44db-aea8-046bc25ba5d6" containerID="c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb" exitCode=0
Sep 10 21:28:14.183186 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.183108    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-sd4zl"
Sep 10 21:28:14.183186 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.183116    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-sd4zl" event={"ID":"0a65e140-8b1a-44db-aea8-046bc25ba5d6","Type":"ContainerDied","Data":"c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb"}
Sep 10 21:28:14.183186 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.183159    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-sd4zl" event={"ID":"0a65e140-8b1a-44db-aea8-046bc25ba5d6","Type":"ContainerDied","Data":"4dcb85002f6d509198cdf30953eee346e5777a0e8f1f25b52dad417fc1780daf"}
Sep 10 21:28:14.191534 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.191491    2568 scope.go:117] "RemoveContainer" containerID="255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a"
Sep 10 21:28:14.191848 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:28:14.191829    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a\": container with ID starting with 255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a not found: ID does not exist" containerID="255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a"
Sep 10 21:28:14.191898 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.191856    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a"} err="failed to get container status \"255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a\": rpc error: code = NotFound desc = could not find container \"255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a\": container with ID starting with 255e9f0504865a7657b50eda64442abeed30f14f257eca8ae405221d0fe3525a not found: ID does not exist"
Sep 10 21:28:14.191898 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.191873    2568 scope.go:117] "RemoveContainer" containerID="c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb"
Sep 10 21:28:14.200417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.200399    2568 scope.go:117] "RemoveContainer" containerID="c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb"
Sep 10 21:28:14.200726 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:28:14.200698    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb\": container with ID starting with c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb not found: ID does not exist" containerID="c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb"
Sep 10 21:28:14.200803 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.200730    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb"} err="failed to get container status \"c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb\": rpc error: code = NotFound desc = could not find container \"c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb\": container with ID starting with c761ace436461d1ed34f139fe8202bbafaa644d85eab1c0b6e99a3457d1f2fdb not found: ID does not exist"
Sep 10 21:28:14.206257 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.206231    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-jjcjv"]
Sep 10 21:28:14.209394 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.209374    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-jjcjv"]
Sep 10 21:28:14.219713 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.219688    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-sd4zl"]
Sep 10 21:28:14.223008 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:14.222987    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-sd4zl"]
Sep 10 21:28:16.196449 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:16.196418    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a65e140-8b1a-44db-aea8-046bc25ba5d6" path="/var/lib/kubelet/pods/0a65e140-8b1a-44db-aea8-046bc25ba5d6/volumes"
Sep 10 21:28:16.196799 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:16.196721    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d00bd868-33e3-4fcf-85d6-6be5cf92badb" path="/var/lib/kubelet/pods/d00bd868-33e3-4fcf-85d6-6be5cf92badb/volumes"
Sep 10 21:28:16.908408 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:16.908376    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64f9b67b59-p4qqf"]
Sep 10 21:28:16.908568 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:16.908528    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-64f9b67b59-p4qqf" podUID="69338c21-2fe1-4c26-b21a-ececb887ba04" containerName="authorino" containerID="cri-o://9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10" gracePeriod=30
Sep 10 21:28:17.169864 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.169811    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f9b67b59-p4qqf"
Sep 10 21:28:17.205685 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.205660    2568 generic.go:356] "Generic (PLEG): container finished" podID="69338c21-2fe1-4c26-b21a-ececb887ba04" containerID="9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10" exitCode=0
Sep 10 21:28:17.206083 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.205701    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f9b67b59-p4qqf"
Sep 10 21:28:17.206083 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.205720    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f9b67b59-p4qqf" event={"ID":"69338c21-2fe1-4c26-b21a-ececb887ba04","Type":"ContainerDied","Data":"9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10"}
Sep 10 21:28:17.206083 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.205746    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f9b67b59-p4qqf" event={"ID":"69338c21-2fe1-4c26-b21a-ececb887ba04","Type":"ContainerDied","Data":"34be444e401e3ce45adc110d1863828fac58c88cb0a69d5ad181e91e9d775398"}
Sep 10 21:28:17.206083 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.205763    2568 scope.go:117] "RemoveContainer" containerID="9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10"
Sep 10 21:28:17.215548 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.215516    2568 scope.go:117] "RemoveContainer" containerID="9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10"
Sep 10 21:28:17.215829 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:28:17.215808    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10\": container with ID starting with 9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10 not found: ID does not exist" containerID="9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10"
Sep 10 21:28:17.215884 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.215837    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10"} err="failed to get container status \"9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10\": rpc error: code = NotFound desc = could not find container \"9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10\": container with ID starting with 9ac1e3d4c7b7c300e8f1cfbafe26d461a312c6fbb5c835f623e7949e4c11ba10 not found: ID does not exist"
Sep 10 21:28:17.329051 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.329027    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q275x\" (UniqueName: \"kubernetes.io/projected/69338c21-2fe1-4c26-b21a-ececb887ba04-kube-api-access-q275x\") pod \"69338c21-2fe1-4c26-b21a-ececb887ba04\" (UID: \"69338c21-2fe1-4c26-b21a-ececb887ba04\") "
Sep 10 21:28:17.331655 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.331616    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69338c21-2fe1-4c26-b21a-ececb887ba04-kube-api-access-q275x" (OuterVolumeSpecName: "kube-api-access-q275x") pod "69338c21-2fe1-4c26-b21a-ececb887ba04" (UID: "69338c21-2fe1-4c26-b21a-ececb887ba04"). InnerVolumeSpecName "kube-api-access-q275x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:28:17.432090 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.432031    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q275x\" (UniqueName: \"kubernetes.io/projected/69338c21-2fe1-4c26-b21a-ececb887ba04-kube-api-access-q275x\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:28:17.527308 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.527283    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64f9b67b59-p4qqf"]
Sep 10 21:28:17.530946 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:17.530926    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64f9b67b59-p4qqf"]
Sep 10 21:28:18.131001 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.130968    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b457fdfbd-gspn6"]
Sep 10 21:28:18.131694 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.131667    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a65e140-8b1a-44db-aea8-046bc25ba5d6" containerName="authorino"
Sep 10 21:28:18.131694 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.131690    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a65e140-8b1a-44db-aea8-046bc25ba5d6" containerName="authorino"
Sep 10 21:28:18.131860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.131716    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d00bd868-33e3-4fcf-85d6-6be5cf92badb" containerName="authorino"
Sep 10 21:28:18.131860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.131722    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d00bd868-33e3-4fcf-85d6-6be5cf92badb" containerName="authorino"
Sep 10 21:28:18.131860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.131730    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69338c21-2fe1-4c26-b21a-ececb887ba04" containerName="authorino"
Sep 10 21:28:18.131860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.131737    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="69338c21-2fe1-4c26-b21a-ececb887ba04" containerName="authorino"
Sep 10 21:28:18.131860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.131804    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d00bd868-33e3-4fcf-85d6-6be5cf92badb" containerName="authorino"
Sep 10 21:28:18.131860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.131811    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a65e140-8b1a-44db-aea8-046bc25ba5d6" containerName="authorino"
Sep 10 21:28:18.131860 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.131819    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="69338c21-2fe1-4c26-b21a-ececb887ba04" containerName="authorino"
Sep 10 21:28:18.134459 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.134442    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:18.137003 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.136974    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 21:28:18.137109 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.137090    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 21:28:18.137269 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.137250    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wqmn5\""
Sep 10 21:28:18.137843 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.137826    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 21:28:18.146805 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.146782    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b457fdfbd-gspn6"]
Sep 10 21:28:18.196629 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.196604    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69338c21-2fe1-4c26-b21a-ececb887ba04" path="/var/lib/kubelet/pods/69338c21-2fe1-4c26-b21a-ececb887ba04/volumes"
Sep 10 21:28:18.238718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.238695    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-metrics-certs\") pod \"maas-controller-b457fdfbd-gspn6\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") " pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:18.239075 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.238745    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-webhook-cert\") pod \"maas-controller-b457fdfbd-gspn6\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") " pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:18.239075 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.238811    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd7dk\" (UniqueName: \"kubernetes.io/projected/8396ce4a-b75d-44c3-8916-b091baac233e-kube-api-access-pd7dk\") pod \"maas-controller-b457fdfbd-gspn6\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") " pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:18.311127 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.311102    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xqn7k"]
Sep 10 21:28:18.313479 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.313464    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:18.323985 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.323955    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xqn7k"]
Sep 10 21:28:18.339657 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.339630    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd7dk\" (UniqueName: \"kubernetes.io/projected/8396ce4a-b75d-44c3-8916-b091baac233e-kube-api-access-pd7dk\") pod \"maas-controller-b457fdfbd-gspn6\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") " pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:18.339787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.339770    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-metrics-certs\") pod \"maas-controller-b457fdfbd-gspn6\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") " pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:18.339904 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.339887    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-webhook-cert\") pod \"maas-controller-b457fdfbd-gspn6\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") " pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:18.342491 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.342464    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-webhook-cert\") pod \"maas-controller-b457fdfbd-gspn6\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") " pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:18.342577 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.342546    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-metrics-certs\") pod \"maas-controller-b457fdfbd-gspn6\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") " pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:18.348270 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.348247    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd7dk\" (UniqueName: \"kubernetes.io/projected/8396ce4a-b75d-44c3-8916-b091baac233e-kube-api-access-pd7dk\") pod \"maas-controller-b457fdfbd-gspn6\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") " pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:18.441155 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.441092    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mcrm\" (UniqueName: \"kubernetes.io/projected/00575fdf-7fba-413c-9f6f-5567d2a1139e-kube-api-access-8mcrm\") pod \"maas-controller-6b484dfdf9-xqn7k\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") " pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:18.441289 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.441165    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-metrics-certs\") pod \"maas-controller-6b484dfdf9-xqn7k\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") " pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:18.441289 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.441225    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-webhook-cert\") pod \"maas-controller-6b484dfdf9-xqn7k\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") " pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:18.446081 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.446063    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:18.542378 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.542351    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-metrics-certs\") pod \"maas-controller-6b484dfdf9-xqn7k\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") " pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:18.542526 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.542395    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-webhook-cert\") pod \"maas-controller-6b484dfdf9-xqn7k\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") " pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:18.542526 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.542431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mcrm\" (UniqueName: \"kubernetes.io/projected/00575fdf-7fba-413c-9f6f-5567d2a1139e-kube-api-access-8mcrm\") pod \"maas-controller-6b484dfdf9-xqn7k\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") " pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:18.544651 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.544627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-metrics-certs\") pod \"maas-controller-6b484dfdf9-xqn7k\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") " pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:18.544745 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.544711    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-webhook-cert\") pod \"maas-controller-6b484dfdf9-xqn7k\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") " pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:18.550580 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.550562    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mcrm\" (UniqueName: \"kubernetes.io/projected/00575fdf-7fba-413c-9f6f-5567d2a1139e-kube-api-access-8mcrm\") pod \"maas-controller-6b484dfdf9-xqn7k\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") " pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:18.625718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.625694    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:18.716910 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.716882    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b457fdfbd-gspn6"]
Sep 10 21:28:18.719172 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:28:18.719145    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8396ce4a_b75d_44c3_8916_b091baac233e.slice/crio-772a5c3aaaef5cd73e142cf376d0499f9a8bd17f208f82023c5d7b91c189fa62 WatchSource:0}: Error finding container 772a5c3aaaef5cd73e142cf376d0499f9a8bd17f208f82023c5d7b91c189fa62: Status 404 returned error can't find the container with id 772a5c3aaaef5cd73e142cf376d0499f9a8bd17f208f82023c5d7b91c189fa62
Sep 10 21:28:18.899600 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:18.899579    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xqn7k"]
Sep 10 21:28:18.900881 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:28:18.900846    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00575fdf_7fba_413c_9f6f_5567d2a1139e.slice/crio-fdfc6f1c6ffc33b5fb6ad5100d0e88ae439f29675b7d169a36b5ddd69c48a269 WatchSource:0}: Error finding container fdfc6f1c6ffc33b5fb6ad5100d0e88ae439f29675b7d169a36b5ddd69c48a269: Status 404 returned error can't find the container with id fdfc6f1c6ffc33b5fb6ad5100d0e88ae439f29675b7d169a36b5ddd69c48a269
Sep 10 21:28:19.218733 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:19.218699    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b457fdfbd-gspn6" event={"ID":"8396ce4a-b75d-44c3-8916-b091baac233e","Type":"ContainerStarted","Data":"772a5c3aaaef5cd73e142cf376d0499f9a8bd17f208f82023c5d7b91c189fa62"}
Sep 10 21:28:19.219885 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:19.219864    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k" event={"ID":"00575fdf-7fba-413c-9f6f-5567d2a1139e","Type":"ContainerStarted","Data":"fdfc6f1c6ffc33b5fb6ad5100d0e88ae439f29675b7d169a36b5ddd69c48a269"}
Sep 10 21:28:22.242194 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:22.242160    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b457fdfbd-gspn6" event={"ID":"8396ce4a-b75d-44c3-8916-b091baac233e","Type":"ContainerStarted","Data":"de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551"}
Sep 10 21:28:22.242684 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:22.242356    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:22.243810 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:22.243781    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k" event={"ID":"00575fdf-7fba-413c-9f6f-5567d2a1139e","Type":"ContainerStarted","Data":"8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5"}
Sep 10 21:28:22.243946 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:22.243848    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:22.264039 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:22.263985    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b457fdfbd-gspn6" podStartSLOduration=1.566391239 podStartE2EDuration="4.263964914s" totalImagesPullingTime="2.697573675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:28:22.260891017 +0000 UTC m=+552.463221589" watchObservedRunningTime="2026-09-10 21:28:22.263964914 +0000 UTC m=+552.466295490"
Sep 10 21:28:22.280681 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:22.280638    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k" podStartSLOduration=1.760003734 podStartE2EDuration="4.280623974s" totalImagesPullingTime="2.52062024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:28:22.280047584 +0000 UTC m=+552.482378156" watchObservedRunningTime="2026-09-10 21:28:22.280623974 +0000 UTC m=+552.482954545"
Sep 10 21:28:33.252876 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.252841    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:33.253332 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.253071    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:28:33.324295 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.324257    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b457fdfbd-gspn6"]
Sep 10 21:28:33.324509 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.324485    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b457fdfbd-gspn6" podUID="8396ce4a-b75d-44c3-8916-b091baac233e" containerName="manager" containerID="cri-o://de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551" gracePeriod=30
Sep 10 21:28:33.574987 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.574961    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:33.667283 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.667255    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd7dk\" (UniqueName: \"kubernetes.io/projected/8396ce4a-b75d-44c3-8916-b091baac233e-kube-api-access-pd7dk\") pod \"8396ce4a-b75d-44c3-8916-b091baac233e\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") "
Sep 10 21:28:33.667424 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.667339    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-metrics-certs\") pod \"8396ce4a-b75d-44c3-8916-b091baac233e\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") "
Sep 10 21:28:33.667424 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.667399    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-webhook-cert\") pod \"8396ce4a-b75d-44c3-8916-b091baac233e\" (UID: \"8396ce4a-b75d-44c3-8916-b091baac233e\") "
Sep 10 21:28:33.669555 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.669524    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8396ce4a-b75d-44c3-8916-b091baac233e-kube-api-access-pd7dk" (OuterVolumeSpecName: "kube-api-access-pd7dk") pod "8396ce4a-b75d-44c3-8916-b091baac233e" (UID: "8396ce4a-b75d-44c3-8916-b091baac233e"). InnerVolumeSpecName "kube-api-access-pd7dk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:28:33.669555 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.669538    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8396ce4a-b75d-44c3-8916-b091baac233e" (UID: "8396ce4a-b75d-44c3-8916-b091baac233e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:28:33.669696 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.669575    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8396ce4a-b75d-44c3-8916-b091baac233e" (UID: "8396ce4a-b75d-44c3-8916-b091baac233e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:28:33.768319 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.768289    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-webhook-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:28:33.768319 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.768314    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd7dk\" (UniqueName: \"kubernetes.io/projected/8396ce4a-b75d-44c3-8916-b091baac233e-kube-api-access-pd7dk\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:28:33.768319 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:33.768324    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8396ce4a-b75d-44c3-8916-b091baac233e-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:28:34.323927 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:34.323895    2568 generic.go:356] "Generic (PLEG): container finished" podID="8396ce4a-b75d-44c3-8916-b091baac233e" containerID="de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551" exitCode=0
Sep 10 21:28:34.324345 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:34.323933    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b457fdfbd-gspn6"
Sep 10 21:28:34.324345 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:34.323981    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b457fdfbd-gspn6" event={"ID":"8396ce4a-b75d-44c3-8916-b091baac233e","Type":"ContainerDied","Data":"de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551"}
Sep 10 21:28:34.324345 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:34.324039    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b457fdfbd-gspn6" event={"ID":"8396ce4a-b75d-44c3-8916-b091baac233e","Type":"ContainerDied","Data":"772a5c3aaaef5cd73e142cf376d0499f9a8bd17f208f82023c5d7b91c189fa62"}
Sep 10 21:28:34.324345 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:34.324071    2568 scope.go:117] "RemoveContainer" containerID="de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551"
Sep 10 21:28:34.333368 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:34.333350    2568 scope.go:117] "RemoveContainer" containerID="de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551"
Sep 10 21:28:34.333630 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:28:34.333613    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551\": container with ID starting with de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551 not found: ID does not exist" containerID="de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551"
Sep 10 21:28:34.333686 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:34.333641    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551"} err="failed to get container status \"de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551\": rpc error: code = NotFound desc = could not find container \"de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551\": container with ID starting with de6b0796be6071af3c9437825ebbadb52620b47131ffafd0fe5c24f48c507551 not found: ID does not exist"
Sep 10 21:28:34.340897 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:34.340876    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b457fdfbd-gspn6"]
Sep 10 21:28:34.347081 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:34.347060    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b457fdfbd-gspn6"]
Sep 10 21:28:36.196317 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:36.196288    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8396ce4a-b75d-44c3-8916-b091baac233e" path="/var/lib/kubelet/pods/8396ce4a-b75d-44c3-8916-b091baac233e/volumes"
Sep 10 21:28:53.635594 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.635556    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-586c445589-k4p28"]
Sep 10 21:28:53.636049 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.636033    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8396ce4a-b75d-44c3-8916-b091baac233e" containerName="manager"
Sep 10 21:28:53.636097 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.636051    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8396ce4a-b75d-44c3-8916-b091baac233e" containerName="manager"
Sep 10 21:28:53.636136 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.636129    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8396ce4a-b75d-44c3-8916-b091baac233e" containerName="manager"
Sep 10 21:28:53.640500 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.640481    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:53.642863 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.642842    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 21:28:53.642984 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.642923    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nmksg\""
Sep 10 21:28:53.642984 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.642842    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 21:28:53.650700 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.650678    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-586c445589-k4p28"]
Sep 10 21:28:53.731472 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.731437    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-metrics-certs\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:53.731623 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.731493    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbmnx\" (UniqueName: \"kubernetes.io/projected/0596231a-9700-4156-afe4-86ba4376986d-kube-api-access-vbmnx\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:53.731623 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.731564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0596231a-9700-4156-afe4-86ba4376986d-openshift-service-ca\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:53.731623 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.731609    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-maas-api-tls\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:53.832752 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.832722    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-metrics-certs\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:53.832903 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.832761    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbmnx\" (UniqueName: \"kubernetes.io/projected/0596231a-9700-4156-afe4-86ba4376986d-kube-api-access-vbmnx\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:53.832903 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.832800    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0596231a-9700-4156-afe4-86ba4376986d-openshift-service-ca\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:53.832903 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.832827    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-maas-api-tls\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:53.833013 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:28:53.832931    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 10 21:28:53.833013 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:28:53.833001    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-maas-api-tls podName:0596231a-9700-4156-afe4-86ba4376986d nodeName:}" failed. No retries permitted until 2026-09-10 21:28:54.33298023 +0000 UTC m=+584.535310782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-maas-api-tls") pod "maas-api-586c445589-k4p28" (UID: "0596231a-9700-4156-afe4-86ba4376986d") : secret "maas-api-serving-cert" not found
Sep 10 21:28:53.833568 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.833546    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0596231a-9700-4156-afe4-86ba4376986d-openshift-service-ca\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:53.835221 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.835165    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-metrics-certs\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:53.843569 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:53.843549    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbmnx\" (UniqueName: \"kubernetes.io/projected/0596231a-9700-4156-afe4-86ba4376986d-kube-api-access-vbmnx\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:54.045982 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.045896    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"]
Sep 10 21:28:54.048594 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.048573    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"
Sep 10 21:28:54.050973 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.050949    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 21:28:54.051066 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.051029    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-q9r5s\""
Sep 10 21:28:54.061056 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.061033    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"]
Sep 10 21:28:54.069049 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.069027    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"]
Sep 10 21:28:54.071482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.071462    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"
Sep 10 21:28:54.082400 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.082377    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"]
Sep 10 21:28:54.135628 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.135606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v8w5\" (UniqueName: \"kubernetes.io/projected/d480b1a9-66d6-4634-891e-5d1985983820-kube-api-access-5v8w5\") pod \"payload-pre-processing-59fbc47bf8-rnbls\" (UID: \"d480b1a9-66d6-4634-891e-5d1985983820\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"
Sep 10 21:28:54.135748 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.135663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d480b1a9-66d6-4634-891e-5d1985983820-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-rnbls\" (UID: \"d480b1a9-66d6-4634-891e-5d1985983820\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"
Sep 10 21:28:54.135748 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.135697    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52436fcb-20bc-42ea-9b32-f232cf2ead71-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-cpf6d\" (UID: \"52436fcb-20bc-42ea-9b32-f232cf2ead71\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"
Sep 10 21:28:54.135748 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.135731    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2jk8\" (UniqueName: \"kubernetes.io/projected/52436fcb-20bc-42ea-9b32-f232cf2ead71-kube-api-access-d2jk8\") pod \"payload-processing-5b54b7fbb7-cpf6d\" (UID: \"52436fcb-20bc-42ea-9b32-f232cf2ead71\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"
Sep 10 21:28:54.236842 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.236810    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v8w5\" (UniqueName: \"kubernetes.io/projected/d480b1a9-66d6-4634-891e-5d1985983820-kube-api-access-5v8w5\") pod \"payload-pre-processing-59fbc47bf8-rnbls\" (UID: \"d480b1a9-66d6-4634-891e-5d1985983820\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"
Sep 10 21:28:54.237024 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.236881    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d480b1a9-66d6-4634-891e-5d1985983820-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-rnbls\" (UID: \"d480b1a9-66d6-4634-891e-5d1985983820\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"
Sep 10 21:28:54.237024 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.236910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52436fcb-20bc-42ea-9b32-f232cf2ead71-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-cpf6d\" (UID: \"52436fcb-20bc-42ea-9b32-f232cf2ead71\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"
Sep 10 21:28:54.237164 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.237047    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jk8\" (UniqueName: \"kubernetes.io/projected/52436fcb-20bc-42ea-9b32-f232cf2ead71-kube-api-access-d2jk8\") pod \"payload-processing-5b54b7fbb7-cpf6d\" (UID: \"52436fcb-20bc-42ea-9b32-f232cf2ead71\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"
Sep 10 21:28:54.237666 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.237643    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52436fcb-20bc-42ea-9b32-f232cf2ead71-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-cpf6d\" (UID: \"52436fcb-20bc-42ea-9b32-f232cf2ead71\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"
Sep 10 21:28:54.237761 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.237700    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d480b1a9-66d6-4634-891e-5d1985983820-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-rnbls\" (UID: \"d480b1a9-66d6-4634-891e-5d1985983820\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"
Sep 10 21:28:54.247471 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.247448    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v8w5\" (UniqueName: \"kubernetes.io/projected/d480b1a9-66d6-4634-891e-5d1985983820-kube-api-access-5v8w5\") pod \"payload-pre-processing-59fbc47bf8-rnbls\" (UID: \"d480b1a9-66d6-4634-891e-5d1985983820\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"
Sep 10 21:28:54.253940 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.253915    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2jk8\" (UniqueName: \"kubernetes.io/projected/52436fcb-20bc-42ea-9b32-f232cf2ead71-kube-api-access-d2jk8\") pod \"payload-processing-5b54b7fbb7-cpf6d\" (UID: \"52436fcb-20bc-42ea-9b32-f232cf2ead71\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"
Sep 10 21:28:54.337581 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.337552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-maas-api-tls\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:54.339909 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.339884    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-maas-api-tls\") pod \"maas-api-586c445589-k4p28\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") " pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:54.359665 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.359641    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"
Sep 10 21:28:54.384870 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.384848    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"
Sep 10 21:28:54.551861 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.551826    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:54.646369 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:28:54.646328    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd480b1a9_66d6_4634_891e_5d1985983820.slice/crio-684adabd4e5888a387c9a18afbd781f41c658bebc942f6e2f58776012ab6e0c6 WatchSource:0}: Error finding container 684adabd4e5888a387c9a18afbd781f41c658bebc942f6e2f58776012ab6e0c6: Status 404 returned error can't find the container with id 684adabd4e5888a387c9a18afbd781f41c658bebc942f6e2f58776012ab6e0c6
Sep 10 21:28:54.646801 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.646631    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"]
Sep 10 21:28:54.696652 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.696626    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"]
Sep 10 21:28:54.698129 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:28:54.698097    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52436fcb_20bc_42ea_9b32_f232cf2ead71.slice/crio-5feb8ab2fb40f0f914b49e793d1387a85bbacdbbf99feb8e33ed8de753651b89 WatchSource:0}: Error finding container 5feb8ab2fb40f0f914b49e793d1387a85bbacdbbf99feb8e33ed8de753651b89: Status 404 returned error can't find the container with id 5feb8ab2fb40f0f914b49e793d1387a85bbacdbbf99feb8e33ed8de753651b89
Sep 10 21:28:54.832929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:54.832893    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-586c445589-k4p28"]
Sep 10 21:28:54.834800 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:28:54.834775    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0596231a_9700_4156_afe4_86ba4376986d.slice/crio-383dffad9a9a7d33a15525fa93cf99f889c8fd0c8a79238c64f06b19d66bc6f9 WatchSource:0}: Error finding container 383dffad9a9a7d33a15525fa93cf99f889c8fd0c8a79238c64f06b19d66bc6f9: Status 404 returned error can't find the container with id 383dffad9a9a7d33a15525fa93cf99f889c8fd0c8a79238c64f06b19d66bc6f9
Sep 10 21:28:55.489418 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:55.489337    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d" event={"ID":"52436fcb-20bc-42ea-9b32-f232cf2ead71","Type":"ContainerStarted","Data":"5feb8ab2fb40f0f914b49e793d1387a85bbacdbbf99feb8e33ed8de753651b89"}
Sep 10 21:28:55.492490 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:55.492401    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28" event={"ID":"0596231a-9700-4156-afe4-86ba4376986d","Type":"ContainerStarted","Data":"383dffad9a9a7d33a15525fa93cf99f889c8fd0c8a79238c64f06b19d66bc6f9"}
Sep 10 21:28:55.496805 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:55.496725    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls" event={"ID":"d480b1a9-66d6-4634-891e-5d1985983820","Type":"ContainerStarted","Data":"684adabd4e5888a387c9a18afbd781f41c658bebc942f6e2f58776012ab6e0c6"}
Sep 10 21:28:58.517939 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:58.517904    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28" event={"ID":"0596231a-9700-4156-afe4-86ba4376986d","Type":"ContainerStarted","Data":"b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603"}
Sep 10 21:28:58.518408 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:58.518021    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:28:58.519724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:58.519699    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls" event={"ID":"d480b1a9-66d6-4634-891e-5d1985983820","Type":"ContainerStarted","Data":"dfedc1b4f33439a17ba3694bbcff4794f1fe10f346007b12518b33f1ac500fe4"}
Sep 10 21:28:58.519853 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:58.519771    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"
Sep 10 21:28:58.521120 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:58.521101    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d" event={"ID":"52436fcb-20bc-42ea-9b32-f232cf2ead71","Type":"ContainerStarted","Data":"4d872a9484e5b673d27cec87817403195fb6ddb177614abb341961288cdafa70"}
Sep 10 21:28:58.521217 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:58.521158    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"
Sep 10 21:28:58.554435 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:58.554385    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28" podStartSLOduration=2.787786468 podStartE2EDuration="5.554347434s" totalImagesPullingTime="2.766560966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:28:58.552079743 +0000 UTC m=+588.754410316" watchObservedRunningTime="2026-09-10 21:28:58.554347434 +0000 UTC m=+588.756678007"
Sep 10 21:28:58.579709 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:58.579652    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d" podStartSLOduration=1.669876446 podStartE2EDuration="4.579633522s" totalImagesPullingTime="2.909757076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:28:58.578370328 +0000 UTC m=+588.780700901" watchObservedRunningTime="2026-09-10 21:28:58.579633522 +0000 UTC m=+588.781964095"
Sep 10 21:28:58.601997 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:28:58.601953    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls" podStartSLOduration=1.651055535 podStartE2EDuration="4.601940075s" totalImagesPullingTime="2.95088454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:28:58.599991975 +0000 UTC m=+588.802322547" watchObservedRunningTime="2026-09-10 21:28:58.601940075 +0000 UTC m=+588.804270687"
Sep 10 21:29:03.553471 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:03.553434    2568 generic.go:356] "Generic (PLEG): container finished" podID="bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e" containerID="5c289a875d56726120e891d934c8ed306fceddf6de0bbc649b938e2a82b98d07" exitCode=0
Sep 10 21:29:03.553898 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:03.553501    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc" event={"ID":"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e","Type":"ContainerDied","Data":"5c289a875d56726120e891d934c8ed306fceddf6de0bbc649b938e2a82b98d07"}
Sep 10 21:29:03.553898 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:03.553842    2568 scope.go:117] "RemoveContainer" containerID="5c289a875d56726120e891d934c8ed306fceddf6de0bbc649b938e2a82b98d07"
Sep 10 21:29:03.554813 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:03.554782    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:29:03.554908 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:03.554853    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:29:03.554908 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:03.554884    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:29:04.533259 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:04.533231    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:29:04.566623 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:04.566572    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc" event={"ID":"bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e","Type":"ContainerStarted","Data":"3e0472353df7901f25ba80d1800d0c73044faf9e5446e3718a19919d60437db0"}
Sep 10 21:29:04.630592 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:04.630555    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:29:04.630783 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:04.630762    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-st2bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:29:04.630837 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:04.630807    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc" podUID="bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:29:05.631016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:05.630983    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-st2bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:29:05.631438 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:05.631040    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc" podUID="bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:29:06.630908 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:06.630875    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-st2bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:29:06.631096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:06.630930    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc" podUID="bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:29:07.631049 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:07.631014    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-st2bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:29:07.631254 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:07.631068    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc" podUID="bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:29:08.630891 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:08.630854    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-st2bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:29:08.631060 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:08.630913    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc" podUID="bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 21:29:09.529381 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:09.529351    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rnbls"
Sep 10 21:29:09.529775 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:09.529531    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-cpf6d"
Sep 10 21:29:09.634276 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:09.634247    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:29:09.634543 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:09.634520    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:29:09.635137 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:09.635120    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-st2bc"
Sep 10 21:29:10.187472 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:10.187448    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:29:10.187649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:10.187448    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:29:12.213371 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.213342    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"]
Sep 10 21:29:12.218325 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.218299    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.221016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.220987    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 21:29:12.221237 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.220986    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 21:29:12.221357 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.221005    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dxtxk\""
Sep 10 21:29:12.221424 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.221116    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 21:29:12.223947 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.223921    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"]
Sep 10 21:29:12.334934 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.334903    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.334934 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.334934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec922c0c-33a9-4ed4-87b5-9596c9620f91-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.335166 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.334972    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.335166 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.335014    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.335166 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.335035    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs4j8\" (UniqueName: \"kubernetes.io/projected/ec922c0c-33a9-4ed4-87b5-9596c9620f91-kube-api-access-rs4j8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.335377 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.335195    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.436606 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.436564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.436775 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.436623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.436775 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.436653    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs4j8\" (UniqueName: \"kubernetes.io/projected/ec922c0c-33a9-4ed4-87b5-9596c9620f91-kube-api-access-rs4j8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.436775 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.436709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.436950 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.436795    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.436950 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.436823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec922c0c-33a9-4ed4-87b5-9596c9620f91-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.437058 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.437018    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.437115 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.437065    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.437168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.437125    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.438992 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.438961    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec922c0c-33a9-4ed4-87b5-9596c9620f91-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.439230 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.439195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec922c0c-33a9-4ed4-87b5-9596c9620f91-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.444170 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.444152    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs4j8\" (UniqueName: \"kubernetes.io/projected/ec922c0c-33a9-4ed4-87b5-9596c9620f91-kube-api-access-rs4j8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv\" (UID: \"ec922c0c-33a9-4ed4-87b5-9596c9620f91\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.533073 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.533009    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:12.806406 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:12.806375    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"]
Sep 10 21:29:12.807364 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:29:12.807336    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec922c0c_33a9_4ed4_87b5_9596c9620f91.slice/crio-46c98ed07498a3e23a2a62f1b5927bc6720df49fac67c2482b943edb268ae3db WatchSource:0}: Error finding container 46c98ed07498a3e23a2a62f1b5927bc6720df49fac67c2482b943edb268ae3db: Status 404 returned error can't find the container with id 46c98ed07498a3e23a2a62f1b5927bc6720df49fac67c2482b943edb268ae3db
Sep 10 21:29:13.629723 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:13.629688    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv" event={"ID":"ec922c0c-33a9-4ed4-87b5-9596c9620f91","Type":"ContainerStarted","Data":"46c98ed07498a3e23a2a62f1b5927bc6720df49fac67c2482b943edb268ae3db"}
Sep 10 21:29:14.637500 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:14.637469    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv" event={"ID":"ec922c0c-33a9-4ed4-87b5-9596c9620f91","Type":"ContainerStarted","Data":"3b55a4b8b93c6cff95f5b385ae6154f32c71fba48fc1e0a4647a81f41453f6a3"}
Sep 10 21:29:14.654960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:14.654908    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv" podStartSLOduration=1.501294758 podStartE2EDuration="2.65489292s" totalImagesPullingTime="1.153598162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:29:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:29:14.652798223 +0000 UTC m=+604.855128796" watchObservedRunningTime="2026-09-10 21:29:14.65489292 +0000 UTC m=+604.857223492"
Sep 10 21:29:22.533723 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:22.533692    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:22.534183 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:22.533768    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:22.546116 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:22.546094    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:29:22.701352 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:29:22.701328    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv"
Sep 10 21:30:02.294778 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.294745    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"]
Sep 10 21:30:02.300558 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.300533    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.303075 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.303040    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 21:30:02.311445 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.311414    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"]
Sep 10 21:30:02.365009 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.364973    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.365160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.365028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.365160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.365123    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.365263 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.365171    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.365300 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.365272    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.365335 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.365305    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46vmz\" (UniqueName: \"kubernetes.io/projected/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-kube-api-access-46vmz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.466636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.466600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.466636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.466640    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46vmz\" (UniqueName: \"kubernetes.io/projected/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-kube-api-access-46vmz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.466827 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.466674    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.466827 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.466700    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.466827 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.466741    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.466827 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.466769    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.467074 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.467050    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.467287 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.467263    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.467287 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.467278    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.468901 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.468872    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.469464 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.469449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.477675 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.477657    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46vmz\" (UniqueName: \"kubernetes.io/projected/a4d6e430-b04a-4027-a8d5-9bb84c93a85c-kube-api-access-46vmz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2\" (UID: \"a4d6e430-b04a-4027-a8d5-9bb84c93a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.613821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.613795    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:02.892704 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.892671    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"]
Sep 10 21:30:02.894024 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:30:02.893990    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d6e430_b04a_4027_a8d5_9bb84c93a85c.slice/crio-142fc9a432f76aee62f718d54ffcb63d4a9dace792c2b02218ba3add9dcb331e WatchSource:0}: Error finding container 142fc9a432f76aee62f718d54ffcb63d4a9dace792c2b02218ba3add9dcb331e: Status 404 returned error can't find the container with id 142fc9a432f76aee62f718d54ffcb63d4a9dace792c2b02218ba3add9dcb331e
Sep 10 21:30:02.895455 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.895435    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:30:02.933387 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:02.933357    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2" event={"ID":"a4d6e430-b04a-4027-a8d5-9bb84c93a85c","Type":"ContainerStarted","Data":"142fc9a432f76aee62f718d54ffcb63d4a9dace792c2b02218ba3add9dcb331e"}
Sep 10 21:30:03.944176 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:03.944140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2" event={"ID":"a4d6e430-b04a-4027-a8d5-9bb84c93a85c","Type":"ContainerStarted","Data":"c5bca32238d181a22b220067ddb85b66c40804f88e99ffde92a77316ca919fff"}
Sep 10 21:30:03.963840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:03.963794    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2" podStartSLOduration=1.743269178 podStartE2EDuration="1.963780098s" totalImagesPullingTime="220.51092ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:30:03.962274997 +0000 UTC m=+654.164605565" watchObservedRunningTime="2026-09-10 21:30:03.963780098 +0000 UTC m=+654.166110670"
Sep 10 21:30:12.614495 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:12.614462    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:12.614970 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:12.614516    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:12.626899 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:12.626871    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:30:13.014384 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:30:13.014304    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2"
Sep 10 21:32:00.933111 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:00.933078    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"]
Sep 10 21:32:00.937248 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:00.937225    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:00.940764 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:00.940742    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-3984e6-serving-cert\""
Sep 10 21:32:00.956241 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:00.956160    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"]
Sep 10 21:32:01.012677 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.012649    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm6nk\" (UniqueName: \"kubernetes.io/projected/d363d177-eef2-4240-b64f-9849cc1b8a50-kube-api-access-rm6nk\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.012818 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.012688    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-metrics-certs\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.012818 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.012791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-maas-api-tls\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.012898 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.012831    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d363d177-eef2-4240-b64f-9849cc1b8a50-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.114258 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.114221    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d363d177-eef2-4240-b64f-9849cc1b8a50-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.114446 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.114300    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm6nk\" (UniqueName: \"kubernetes.io/projected/d363d177-eef2-4240-b64f-9849cc1b8a50-kube-api-access-rm6nk\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.114446 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.114325    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-metrics-certs\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.114446 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.114414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-maas-api-tls\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.114630 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:32:01.114504    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-serving-cert: secret "maas-api-e2e-inf-a-3984e6-serving-cert" not found
Sep 10 21:32:01.114630 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:32:01.114571    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-maas-api-tls podName:d363d177-eef2-4240-b64f-9849cc1b8a50 nodeName:}" failed. No retries permitted until 2026-09-10 21:32:01.614553093 +0000 UTC m=+771.816883662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-maas-api-tls") pod "maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd" (UID: "d363d177-eef2-4240-b64f-9849cc1b8a50") : secret "maas-api-e2e-inf-a-3984e6-serving-cert" not found
Sep 10 21:32:01.114988 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.114964    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d363d177-eef2-4240-b64f-9849cc1b8a50-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.116958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.116931    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-metrics-certs\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.122539 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.122513    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm6nk\" (UniqueName: \"kubernetes.io/projected/d363d177-eef2-4240-b64f-9849cc1b8a50-kube-api-access-rm6nk\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.618884 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.618849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-maas-api-tls\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.621423 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.621396    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-maas-api-tls\") pod \"maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.848492 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.848456    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:01.874148 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.874079    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"]
Sep 10 21:32:01.879160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.879123    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:32:01.882128 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.881982    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-3984e6\""
Sep 10 21:32:01.882279 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.882232    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-3984e6-dockercfg-x2xw9\""
Sep 10 21:32:01.893293 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:01.893269    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"]
Sep 10 21:32:02.030936 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.030902    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr756\" (UniqueName: \"kubernetes.io/projected/5a549fdd-661b-4687-b198-ccafdaac3d9f-kube-api-access-fr756\") pod \"payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt\" (UID: \"5a549fdd-661b-4687-b198-ccafdaac3d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:32:02.031479 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.031022    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a549fdd-661b-4687-b198-ccafdaac3d9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt\" (UID: \"5a549fdd-661b-4687-b198-ccafdaac3d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:32:02.134103 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.134010    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr756\" (UniqueName: \"kubernetes.io/projected/5a549fdd-661b-4687-b198-ccafdaac3d9f-kube-api-access-fr756\") pod \"payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt\" (UID: \"5a549fdd-661b-4687-b198-ccafdaac3d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:32:02.134103 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.134074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a549fdd-661b-4687-b198-ccafdaac3d9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt\" (UID: \"5a549fdd-661b-4687-b198-ccafdaac3d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:32:02.134800 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.134776    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a549fdd-661b-4687-b198-ccafdaac3d9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt\" (UID: \"5a549fdd-661b-4687-b198-ccafdaac3d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:32:02.142398 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.142374    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr756\" (UniqueName: \"kubernetes.io/projected/5a549fdd-661b-4687-b198-ccafdaac3d9f-kube-api-access-fr756\") pod \"payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt\" (UID: \"5a549fdd-661b-4687-b198-ccafdaac3d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:32:02.159320 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.159289    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"]
Sep 10 21:32:02.166742 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:32:02.166700    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd363d177_eef2_4240_b64f_9849cc1b8a50.slice/crio-8e31de4398056b106d0c9f520f7a3ca903dc2f4cfa3b861f06ed3b69ca9969c6 WatchSource:0}: Error finding container 8e31de4398056b106d0c9f520f7a3ca903dc2f4cfa3b861f06ed3b69ca9969c6: Status 404 returned error can't find the container with id 8e31de4398056b106d0c9f520f7a3ca903dc2f4cfa3b861f06ed3b69ca9969c6
Sep 10 21:32:02.209425 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.209393    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:32:02.499959 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.499927    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"]
Sep 10 21:32:02.501177 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:32:02.501146    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a549fdd_661b_4687_b198_ccafdaac3d9f.slice/crio-de1470201ad16a40b703fb7ed3dcc09bcfe3f72112738071162d002ab9b86ca3 WatchSource:0}: Error finding container de1470201ad16a40b703fb7ed3dcc09bcfe3f72112738071162d002ab9b86ca3: Status 404 returned error can't find the container with id de1470201ad16a40b703fb7ed3dcc09bcfe3f72112738071162d002ab9b86ca3
Sep 10 21:32:02.671458 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.671421    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt" event={"ID":"5a549fdd-661b-4687-b198-ccafdaac3d9f","Type":"ContainerStarted","Data":"5dcaecae4af4477603a780bb50b35edb29817138fd5a737e74cf5a1ed0e5197f"}
Sep 10 21:32:02.671632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.671478    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt" event={"ID":"5a549fdd-661b-4687-b198-ccafdaac3d9f","Type":"ContainerStarted","Data":"de1470201ad16a40b703fb7ed3dcc09bcfe3f72112738071162d002ab9b86ca3"}
Sep 10 21:32:02.671632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.671510    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:32:02.673006 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.672967    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd" event={"ID":"d363d177-eef2-4240-b64f-9849cc1b8a50","Type":"ContainerStarted","Data":"8e31de4398056b106d0c9f520f7a3ca903dc2f4cfa3b861f06ed3b69ca9969c6"}
Sep 10 21:32:02.689518 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:02.689476    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt" podStartSLOduration=1.689462728 podStartE2EDuration="1.689462728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:32:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:32:02.686497558 +0000 UTC m=+772.888828132" watchObservedRunningTime="2026-09-10 21:32:02.689462728 +0000 UTC m=+772.891793299"
Sep 10 21:32:03.680946 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:03.680913    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd" event={"ID":"d363d177-eef2-4240-b64f-9849cc1b8a50","Type":"ContainerStarted","Data":"aa93da30b7709d140b5563e7679d3b8017f3fecee27f10c4c4e2f83d41a69b7e"}
Sep 10 21:32:03.681425 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:03.681092    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:03.699918 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:03.699872    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd" podStartSLOduration=2.9481493800000003 podStartE2EDuration="3.699856959s" totalImagesPullingTime="751.707579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:32:03.69652736 +0000 UTC m=+773.898857931" watchObservedRunningTime="2026-09-10 21:32:03.699856959 +0000 UTC m=+773.902187531"
Sep 10 21:32:08.552363 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.552328    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"]
Sep 10 21:32:08.556867 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.556847    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.559545 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.559523    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e39a0476-serving-cert\""
Sep 10 21:32:08.584642 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.584612    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"]
Sep 10 21:32:08.696638 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.696605    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-maas-api-tls\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.696785 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.696684    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-metrics-certs\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.696785 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.696757    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqqj6\" (UniqueName: \"kubernetes.io/projected/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-kube-api-access-fqqj6\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.696861 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.696792    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-openshift-service-ca\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.797788 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.797755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-metrics-certs\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.797965 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.797820    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqqj6\" (UniqueName: \"kubernetes.io/projected/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-kube-api-access-fqqj6\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.797965 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.797841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-openshift-service-ca\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.797965 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.797863    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-maas-api-tls\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.798618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.798587    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-openshift-service-ca\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.800227 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.800189    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-metrics-certs\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.800348 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.800331    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-maas-api-tls\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.806869 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.806818    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqqj6\" (UniqueName: \"kubernetes.io/projected/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-kube-api-access-fqqj6\") pod \"maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:08.868920 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:08.868890    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:09.161132 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.156612    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"]
Sep 10 21:32:09.161132 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:32:09.159668    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6e8724_f7dd_4aca_ae76_fa8c9a0dd320.slice/crio-454f6a5ba32c449955a88318d2515f6bb9e84079633503343dc04a9b20c8709a WatchSource:0}: Error finding container 454f6a5ba32c449955a88318d2515f6bb9e84079633503343dc04a9b20c8709a: Status 404 returned error can't find the container with id 454f6a5ba32c449955a88318d2515f6bb9e84079633503343dc04a9b20c8709a
Sep 10 21:32:09.247161 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.247133    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"]
Sep 10 21:32:09.253938 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.253605    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:09.262222 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.259026    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e39a0476-dockercfg-hc77z\""
Sep 10 21:32:09.262222 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.259144    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e39a0476\""
Sep 10 21:32:09.267452 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.267423    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"]
Sep 10 21:32:09.271986 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.271962    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"]
Sep 10 21:32:09.276354 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.276333    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:09.291256 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.291231    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"]
Sep 10 21:32:09.404607 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.404526    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d3305b3-fd20-44a5-b22f-0a6880f7d642-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9\" (UID: \"9d3305b3-fd20-44a5-b22f-0a6880f7d642\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:09.404766 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.404621    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f6c84a0-277c-4539-8942-8b619ed56ed4-plugins-config-volume\") pod \"payload-processing-e2e-ait-e39a0476-67665f4469-txxch\" (UID: \"0f6c84a0-277c-4539-8942-8b619ed56ed4\") " pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:09.404819 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.404778    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg9kc\" (UniqueName: \"kubernetes.io/projected/0f6c84a0-277c-4539-8942-8b619ed56ed4-kube-api-access-kg9kc\") pod \"payload-processing-e2e-ait-e39a0476-67665f4469-txxch\" (UID: \"0f6c84a0-277c-4539-8942-8b619ed56ed4\") " pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:09.404873 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.404852    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmf6v\" (UniqueName: \"kubernetes.io/projected/9d3305b3-fd20-44a5-b22f-0a6880f7d642-kube-api-access-xmf6v\") pod \"payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9\" (UID: \"9d3305b3-fd20-44a5-b22f-0a6880f7d642\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:09.505748 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.505718    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg9kc\" (UniqueName: \"kubernetes.io/projected/0f6c84a0-277c-4539-8942-8b619ed56ed4-kube-api-access-kg9kc\") pod \"payload-processing-e2e-ait-e39a0476-67665f4469-txxch\" (UID: \"0f6c84a0-277c-4539-8942-8b619ed56ed4\") " pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:09.505872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.505775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmf6v\" (UniqueName: \"kubernetes.io/projected/9d3305b3-fd20-44a5-b22f-0a6880f7d642-kube-api-access-xmf6v\") pod \"payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9\" (UID: \"9d3305b3-fd20-44a5-b22f-0a6880f7d642\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:09.505872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.505840    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d3305b3-fd20-44a5-b22f-0a6880f7d642-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9\" (UID: \"9d3305b3-fd20-44a5-b22f-0a6880f7d642\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:09.505872 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.505863    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f6c84a0-277c-4539-8942-8b619ed56ed4-plugins-config-volume\") pod \"payload-processing-e2e-ait-e39a0476-67665f4469-txxch\" (UID: \"0f6c84a0-277c-4539-8942-8b619ed56ed4\") " pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:09.506786 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.506759    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d3305b3-fd20-44a5-b22f-0a6880f7d642-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9\" (UID: \"9d3305b3-fd20-44a5-b22f-0a6880f7d642\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:09.506882 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.506759    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f6c84a0-277c-4539-8942-8b619ed56ed4-plugins-config-volume\") pod \"payload-processing-e2e-ait-e39a0476-67665f4469-txxch\" (UID: \"0f6c84a0-277c-4539-8942-8b619ed56ed4\") " pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:09.514709 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.514681    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmf6v\" (UniqueName: \"kubernetes.io/projected/9d3305b3-fd20-44a5-b22f-0a6880f7d642-kube-api-access-xmf6v\") pod \"payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9\" (UID: \"9d3305b3-fd20-44a5-b22f-0a6880f7d642\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:09.514808 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.514780    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg9kc\" (UniqueName: \"kubernetes.io/projected/0f6c84a0-277c-4539-8942-8b619ed56ed4-kube-api-access-kg9kc\") pod \"payload-processing-e2e-ait-e39a0476-67665f4469-txxch\" (UID: \"0f6c84a0-277c-4539-8942-8b619ed56ed4\") " pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:09.573835 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.573796    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:09.597605 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.597574    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:09.700712 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.700021    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:32:09.723244 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.722692    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt" event={"ID":"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320","Type":"ContainerStarted","Data":"19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2"}
Sep 10 21:32:09.723244 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.722753    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt" event={"ID":"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320","Type":"ContainerStarted","Data":"454f6a5ba32c449955a88318d2515f6bb9e84079633503343dc04a9b20c8709a"}
Sep 10 21:32:09.723244 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.723023    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:09.748011 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.747960    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt" podStartSLOduration=1.443648818 podStartE2EDuration="1.747942321s" totalImagesPullingTime="304.293503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:32:09.745709359 +0000 UTC m=+779.948039943" watchObservedRunningTime="2026-09-10 21:32:09.747942321 +0000 UTC m=+779.950272893"
Sep 10 21:32:09.856871 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.856835    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"]
Sep 10 21:32:09.858445 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:32:09.858416    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3305b3_fd20_44a5_b22f_0a6880f7d642.slice/crio-2e7300e2ef470548ee566b54c7b685686cc82c6164d0d9f354c8b9b14839ee5d WatchSource:0}: Error finding container 2e7300e2ef470548ee566b54c7b685686cc82c6164d0d9f354c8b9b14839ee5d: Status 404 returned error can't find the container with id 2e7300e2ef470548ee566b54c7b685686cc82c6164d0d9f354c8b9b14839ee5d
Sep 10 21:32:09.908563 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:09.908535    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"]
Sep 10 21:32:09.909940 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:32:09.909903    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6c84a0_277c_4539_8942_8b619ed56ed4.slice/crio-5339f7360a92b7b281bf2d795d14fa7f487c595ddd1b39675a2ffffb329be6a7 WatchSource:0}: Error finding container 5339f7360a92b7b281bf2d795d14fa7f487c595ddd1b39675a2ffffb329be6a7: Status 404 returned error can't find the container with id 5339f7360a92b7b281bf2d795d14fa7f487c595ddd1b39675a2ffffb329be6a7
Sep 10 21:32:10.733414 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:10.733377    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9" event={"ID":"9d3305b3-fd20-44a5-b22f-0a6880f7d642","Type":"ContainerStarted","Data":"9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800"}
Sep 10 21:32:10.733841 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:10.733429    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9" event={"ID":"9d3305b3-fd20-44a5-b22f-0a6880f7d642","Type":"ContainerStarted","Data":"2e7300e2ef470548ee566b54c7b685686cc82c6164d0d9f354c8b9b14839ee5d"}
Sep 10 21:32:10.733841 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:10.733555    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:10.735035 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:10.735011    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch" event={"ID":"0f6c84a0-277c-4539-8942-8b619ed56ed4","Type":"ContainerStarted","Data":"315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c"}
Sep 10 21:32:10.735191 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:10.735056    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch" event={"ID":"0f6c84a0-277c-4539-8942-8b619ed56ed4","Type":"ContainerStarted","Data":"5339f7360a92b7b281bf2d795d14fa7f487c595ddd1b39675a2ffffb329be6a7"}
Sep 10 21:32:10.735191 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:10.735160    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:10.765164 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:10.765120    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9" podStartSLOduration=1.765107701 podStartE2EDuration="1.765107701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:32:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:32:10.761967649 +0000 UTC m=+780.964298228" watchObservedRunningTime="2026-09-10 21:32:10.765107701 +0000 UTC m=+780.967438273"
Sep 10 21:32:10.782862 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:10.782820    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch" podStartSLOduration=1.7828073930000001 podStartE2EDuration="1.782807393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:32:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:32:10.780811194 +0000 UTC m=+780.983141767" watchObservedRunningTime="2026-09-10 21:32:10.782807393 +0000 UTC m=+780.985137965"
Sep 10 21:32:13.065226 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.065179    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"]
Sep 10 21:32:13.068634 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.068615    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:32:13.071181 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.071159    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-4b08e7-dockercfg-2nxs6\""
Sep 10 21:32:13.071289 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.071273    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-4b08e7\""
Sep 10 21:32:13.078832 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.078807    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"]
Sep 10 21:32:13.143390 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.143357    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-plugins-config-volume\") pod \"payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc\" (UID: \"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1\") " pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:32:13.143550 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.143409    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brcfm\" (UniqueName: \"kubernetes.io/projected/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-kube-api-access-brcfm\") pod \"payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc\" (UID: \"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1\") " pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:32:13.244499 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.244469    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-plugins-config-volume\") pod \"payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc\" (UID: \"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1\") " pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:32:13.244653 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.244515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcfm\" (UniqueName: \"kubernetes.io/projected/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-kube-api-access-brcfm\") pod \"payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc\" (UID: \"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1\") " pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:32:13.245161 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.245141    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-plugins-config-volume\") pod \"payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc\" (UID: \"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1\") " pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:32:13.254041 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.254016    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brcfm\" (UniqueName: \"kubernetes.io/projected/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-kube-api-access-brcfm\") pod \"payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc\" (UID: \"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1\") " pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:32:13.382669 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.382601    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:32:13.659565 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.659536    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"]
Sep 10 21:32:13.661603 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:32:13.661579    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71bb2b6d_7292_49c0_9e15_9f460a9bd7b1.slice/crio-500f6a09c4e121ea25b34d4a93887856c606839e9ebf141ce06de49edc8faa8b WatchSource:0}: Error finding container 500f6a09c4e121ea25b34d4a93887856c606839e9ebf141ce06de49edc8faa8b: Status 404 returned error can't find the container with id 500f6a09c4e121ea25b34d4a93887856c606839e9ebf141ce06de49edc8faa8b
Sep 10 21:32:13.682879 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.682855    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:32:13.756631 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.756599    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc" event={"ID":"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1","Type":"ContainerStarted","Data":"190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8"}
Sep 10 21:32:13.756774 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.756664    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc" event={"ID":"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1","Type":"ContainerStarted","Data":"500f6a09c4e121ea25b34d4a93887856c606839e9ebf141ce06de49edc8faa8b"}
Sep 10 21:32:13.756774 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.756703    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:32:13.776073 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:13.776021    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc" podStartSLOduration=0.776003574 podStartE2EDuration="776.003574ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:32:13.774841924 +0000 UTC m=+783.977172510" watchObservedRunningTime="2026-09-10 21:32:13.776003574 +0000 UTC m=+783.978334146"
Sep 10 21:32:15.740442 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:15.740409    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:21.743300 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:21.743271    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:21.743779 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:21.743335    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:24.765738 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:24.765705    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:32:49.223337 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.223237    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"]
Sep 10 21:32:49.223799 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.223480    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt" podUID="4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320" containerName="maas-api" containerID="cri-o://19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2" gracePeriod=30
Sep 10 21:32:49.284185 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.284153    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"]
Sep 10 21:32:49.284403 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.284369    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch" podUID="0f6c84a0-277c-4539-8942-8b619ed56ed4" containerName="payload-processing" containerID="cri-o://315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c" gracePeriod=30
Sep 10 21:32:49.291019 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.290991    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"]
Sep 10 21:32:49.295374 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.291213    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9" podUID="9d3305b3-fd20-44a5-b22f-0a6880f7d642" containerName="payload-pre-processing" containerID="cri-o://9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800" gracePeriod=30
Sep 10 21:32:49.610922 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.610895    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:49.614591 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.614559    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:49.618164 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.618142    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:49.697059 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.697032    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-openshift-service-ca\") pod \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") "
Sep 10 21:32:49.697282 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.697125    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-metrics-certs\") pod \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") "
Sep 10 21:32:49.697282 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.697179    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqqj6\" (UniqueName: \"kubernetes.io/projected/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-kube-api-access-fqqj6\") pod \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") "
Sep 10 21:32:49.697421 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.697282    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-maas-api-tls\") pod \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\" (UID: \"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320\") "
Sep 10 21:32:49.697421 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.697397    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320" (UID: "4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:32:49.697636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.697614    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:32:49.699368 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.699345    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320" (UID: "4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:32:49.699482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.699391    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320" (UID: "4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:32:49.699482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.699401    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-kube-api-access-fqqj6" (OuterVolumeSpecName: "kube-api-access-fqqj6") pod "4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320" (UID: "4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320"). InnerVolumeSpecName "kube-api-access-fqqj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:32:49.798181 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.798108    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f6c84a0-277c-4539-8942-8b619ed56ed4-plugins-config-volume\") pod \"0f6c84a0-277c-4539-8942-8b619ed56ed4\" (UID: \"0f6c84a0-277c-4539-8942-8b619ed56ed4\") "
Sep 10 21:32:49.798181 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.798149    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg9kc\" (UniqueName: \"kubernetes.io/projected/0f6c84a0-277c-4539-8942-8b619ed56ed4-kube-api-access-kg9kc\") pod \"0f6c84a0-277c-4539-8942-8b619ed56ed4\" (UID: \"0f6c84a0-277c-4539-8942-8b619ed56ed4\") "
Sep 10 21:32:49.798365 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.798193    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmf6v\" (UniqueName: \"kubernetes.io/projected/9d3305b3-fd20-44a5-b22f-0a6880f7d642-kube-api-access-xmf6v\") pod \"9d3305b3-fd20-44a5-b22f-0a6880f7d642\" (UID: \"9d3305b3-fd20-44a5-b22f-0a6880f7d642\") "
Sep 10 21:32:49.798365 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.798268    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d3305b3-fd20-44a5-b22f-0a6880f7d642-plugins-config-volume\") pod \"9d3305b3-fd20-44a5-b22f-0a6880f7d642\" (UID: \"9d3305b3-fd20-44a5-b22f-0a6880f7d642\") "
Sep 10 21:32:49.798489 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.798461    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f6c84a0-277c-4539-8942-8b619ed56ed4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0f6c84a0-277c-4539-8942-8b619ed56ed4" (UID: "0f6c84a0-277c-4539-8942-8b619ed56ed4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:32:49.798737 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.798715    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:32:49.798820 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.798727    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3305b3-fd20-44a5-b22f-0a6880f7d642-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9d3305b3-fd20-44a5-b22f-0a6880f7d642" (UID: "9d3305b3-fd20-44a5-b22f-0a6880f7d642"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:32:49.798820 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.798741    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqqj6\" (UniqueName: \"kubernetes.io/projected/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-kube-api-access-fqqj6\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:32:49.798820 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.798757    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:32:49.798820 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.798774    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f6c84a0-277c-4539-8942-8b619ed56ed4-plugins-config-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:32:49.800173 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.800154    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3305b3-fd20-44a5-b22f-0a6880f7d642-kube-api-access-xmf6v" (OuterVolumeSpecName: "kube-api-access-xmf6v") pod "9d3305b3-fd20-44a5-b22f-0a6880f7d642" (UID: "9d3305b3-fd20-44a5-b22f-0a6880f7d642"). InnerVolumeSpecName "kube-api-access-xmf6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:32:49.800285 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.800264    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f6c84a0-277c-4539-8942-8b619ed56ed4-kube-api-access-kg9kc" (OuterVolumeSpecName: "kube-api-access-kg9kc") pod "0f6c84a0-277c-4539-8942-8b619ed56ed4" (UID: "0f6c84a0-277c-4539-8942-8b619ed56ed4"). InnerVolumeSpecName "kube-api-access-kg9kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:32:49.899585 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.899553    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg9kc\" (UniqueName: \"kubernetes.io/projected/0f6c84a0-277c-4539-8942-8b619ed56ed4-kube-api-access-kg9kc\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:32:49.899585 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.899579    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmf6v\" (UniqueName: \"kubernetes.io/projected/9d3305b3-fd20-44a5-b22f-0a6880f7d642-kube-api-access-xmf6v\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:32:49.899585 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:49.899591    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d3305b3-fd20-44a5-b22f-0a6880f7d642-plugins-config-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:32:50.010997 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.010961    2568 generic.go:356] "Generic (PLEG): container finished" podID="4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320" containerID="19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2" exitCode=0
Sep 10 21:32:50.011148 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.011006    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"
Sep 10 21:32:50.011148 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.011046    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt" event={"ID":"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320","Type":"ContainerDied","Data":"19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2"}
Sep 10 21:32:50.011148 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.011103    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt" event={"ID":"4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320","Type":"ContainerDied","Data":"454f6a5ba32c449955a88318d2515f6bb9e84079633503343dc04a9b20c8709a"}
Sep 10 21:32:50.011148 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.011134    2568 scope.go:117] "RemoveContainer" containerID="19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2"
Sep 10 21:32:50.012452 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.012430    2568 generic.go:356] "Generic (PLEG): container finished" podID="9d3305b3-fd20-44a5-b22f-0a6880f7d642" containerID="9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800" exitCode=0
Sep 10 21:32:50.012575 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.012464    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"
Sep 10 21:32:50.012575 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.012499    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9" event={"ID":"9d3305b3-fd20-44a5-b22f-0a6880f7d642","Type":"ContainerDied","Data":"9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800"}
Sep 10 21:32:50.012575 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.012546    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9" event={"ID":"9d3305b3-fd20-44a5-b22f-0a6880f7d642","Type":"ContainerDied","Data":"2e7300e2ef470548ee566b54c7b685686cc82c6164d0d9f354c8b9b14839ee5d"}
Sep 10 21:32:50.014238 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.014215    2568 generic.go:356] "Generic (PLEG): container finished" podID="0f6c84a0-277c-4539-8942-8b619ed56ed4" containerID="315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c" exitCode=0
Sep 10 21:32:50.014384 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.014310    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"
Sep 10 21:32:50.014384 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.014314    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch" event={"ID":"0f6c84a0-277c-4539-8942-8b619ed56ed4","Type":"ContainerDied","Data":"315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c"}
Sep 10 21:32:50.014384 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.014352    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch" event={"ID":"0f6c84a0-277c-4539-8942-8b619ed56ed4","Type":"ContainerDied","Data":"5339f7360a92b7b281bf2d795d14fa7f487c595ddd1b39675a2ffffb329be6a7"}
Sep 10 21:32:50.022918 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.022902    2568 scope.go:117] "RemoveContainer" containerID="19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2"
Sep 10 21:32:50.023179 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:32:50.023163    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2\": container with ID starting with 19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2 not found: ID does not exist" containerID="19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2"
Sep 10 21:32:50.023259 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.023189    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2"} err="failed to get container status \"19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2\": rpc error: code = NotFound desc = could not find container \"19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2\": container with ID starting with 19fd5b5267af48ab04987fa3d5a480d4e1f8d486f1daf39cb174f33e95a35ff2 not found: ID does not exist"
Sep 10 21:32:50.023259 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.023224    2568 scope.go:117] "RemoveContainer" containerID="9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800"
Sep 10 21:32:50.032907 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.032891    2568 scope.go:117] "RemoveContainer" containerID="9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800"
Sep 10 21:32:50.033183 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:32:50.033165    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800\": container with ID starting with 9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800 not found: ID does not exist" containerID="9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800"
Sep 10 21:32:50.033330 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.033189    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800"} err="failed to get container status \"9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800\": rpc error: code = NotFound desc = could not find container \"9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800\": container with ID starting with 9c1e813ef8236a14fc29105dd86e53cb393300f320a179e7bc42695e96ef9800 not found: ID does not exist"
Sep 10 21:32:50.033330 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.033225    2568 scope.go:117] "RemoveContainer" containerID="315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c"
Sep 10 21:32:50.041407 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.041390    2568 scope.go:117] "RemoveContainer" containerID="315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c"
Sep 10 21:32:50.041666 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:32:50.041644    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c\": container with ID starting with 315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c not found: ID does not exist" containerID="315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c"
Sep 10 21:32:50.041724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.041675    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c"} err="failed to get container status \"315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c\": rpc error: code = NotFound desc = could not find container \"315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c\": container with ID starting with 315281bbf087155e9d78858519b78ce0210263abde897e0af6490195c7e63b6c not found: ID does not exist"
Sep 10 21:32:50.070011 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.069987    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"]
Sep 10 21:32:50.079740 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.079714    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e39a0476-678649c5b5-xwlqt"]
Sep 10 21:32:50.098386 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.098359    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"]
Sep 10 21:32:50.103374 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.103349    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e39a0476-67665f4469-txxch"]
Sep 10 21:32:50.122461 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.122438    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"]
Sep 10 21:32:50.126055 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.126034    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e39a0476-5579685758-fd2d9"]
Sep 10 21:32:50.197689 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.197667    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f6c84a0-277c-4539-8942-8b619ed56ed4" path="/var/lib/kubelet/pods/0f6c84a0-277c-4539-8942-8b619ed56ed4/volumes"
Sep 10 21:32:50.198069 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.198056    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320" path="/var/lib/kubelet/pods/4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320/volumes"
Sep 10 21:32:50.198403 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:50.198390    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d3305b3-fd20-44a5-b22f-0a6880f7d642" path="/var/lib/kubelet/pods/9d3305b3-fd20-44a5-b22f-0a6880f7d642/volumes"
Sep 10 21:32:53.703879 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.703839    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"]
Sep 10 21:32:53.704635 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.704617    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320" containerName="maas-api"
Sep 10 21:32:53.704685 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.704639    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320" containerName="maas-api"
Sep 10 21:32:53.704685 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.704653    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f6c84a0-277c-4539-8942-8b619ed56ed4" containerName="payload-processing"
Sep 10 21:32:53.704685 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.704662    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f6c84a0-277c-4539-8942-8b619ed56ed4" containerName="payload-processing"
Sep 10 21:32:53.704782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.704685    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d3305b3-fd20-44a5-b22f-0a6880f7d642" containerName="payload-pre-processing"
Sep 10 21:32:53.704782 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.704696    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d3305b3-fd20-44a5-b22f-0a6880f7d642" containerName="payload-pre-processing"
Sep 10 21:32:53.704846 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.704811    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f6c84a0-277c-4539-8942-8b619ed56ed4" containerName="payload-processing"
Sep 10 21:32:53.704846 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.704825    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6e8724-f7dd-4aca-ae76-fa8c9a0dd320" containerName="maas-api"
Sep 10 21:32:53.704846 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.704834    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d3305b3-fd20-44a5-b22f-0a6880f7d642" containerName="payload-pre-processing"
Sep 10 21:32:53.710023 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.710002    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.712470 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.712451    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-30df1990-serving-cert\""
Sep 10 21:32:53.719957 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.719933    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"]
Sep 10 21:32:53.835561 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.835525    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-maas-api-tls\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.835561 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.835561    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-metrics-certs\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.835787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.835647    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9snfm\" (UniqueName: \"kubernetes.io/projected/45bc23fd-1f91-4ba5-9329-ec67136ad418-kube-api-access-9snfm\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.835787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.835666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45bc23fd-1f91-4ba5-9329-ec67136ad418-openshift-service-ca\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.936656 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.936618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-maas-api-tls\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.936839 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.936660    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-metrics-certs\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.936839 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.936752    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9snfm\" (UniqueName: \"kubernetes.io/projected/45bc23fd-1f91-4ba5-9329-ec67136ad418-kube-api-access-9snfm\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.936839 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.936780    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45bc23fd-1f91-4ba5-9329-ec67136ad418-openshift-service-ca\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.937502 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.937475    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45bc23fd-1f91-4ba5-9329-ec67136ad418-openshift-service-ca\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.939240 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.939213    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-metrics-certs\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.939347 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.939293    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-maas-api-tls\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:53.950704 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:53.950675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9snfm\" (UniqueName: \"kubernetes.io/projected/45bc23fd-1f91-4ba5-9329-ec67136ad418-kube-api-access-9snfm\") pod \"maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:54.023541 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:54.023450    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:54.305039 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:54.305013    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"]
Sep 10 21:32:54.306021 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:32:54.305992    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45bc23fd_1f91_4ba5_9329_ec67136ad418.slice/crio-2a9fc50aff3a937bea339fb93a148c6c0e50016ab90e628590614d55f706af04 WatchSource:0}: Error finding container 2a9fc50aff3a937bea339fb93a148c6c0e50016ab90e628590614d55f706af04: Status 404 returned error can't find the container with id 2a9fc50aff3a937bea339fb93a148c6c0e50016ab90e628590614d55f706af04
Sep 10 21:32:55.053926 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:55.053881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq" event={"ID":"45bc23fd-1f91-4ba5-9329-ec67136ad418","Type":"ContainerStarted","Data":"291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221"}
Sep 10 21:32:55.054404 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:55.053957    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:32:55.054404 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:55.053981    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq" event={"ID":"45bc23fd-1f91-4ba5-9329-ec67136ad418","Type":"ContainerStarted","Data":"2a9fc50aff3a937bea339fb93a148c6c0e50016ab90e628590614d55f706af04"}
Sep 10 21:32:55.074118 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:32:55.074066    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq" podStartSLOduration=1.7552454960000001 podStartE2EDuration="2.074051992s" totalImagesPullingTime="318.806496ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:32:55.072997799 +0000 UTC m=+825.275328372" watchObservedRunningTime="2026-09-10 21:32:55.074051992 +0000 UTC m=+825.276382564"
Sep 10 21:33:01.066984 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:01.066948    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:33:24.219644 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.219611    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"]
Sep 10 21:33:24.220122 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.219815    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq" podUID="45bc23fd-1f91-4ba5-9329-ec67136ad418" containerName="maas-api" containerID="cri-o://291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221" gracePeriod=30
Sep 10 21:33:24.471563 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.471494    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:33:24.628919 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.628889    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-metrics-certs\") pod \"45bc23fd-1f91-4ba5-9329-ec67136ad418\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") "
Sep 10 21:33:24.629092 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.628969    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-maas-api-tls\") pod \"45bc23fd-1f91-4ba5-9329-ec67136ad418\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") "
Sep 10 21:33:24.629092 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.628996    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45bc23fd-1f91-4ba5-9329-ec67136ad418-openshift-service-ca\") pod \"45bc23fd-1f91-4ba5-9329-ec67136ad418\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") "
Sep 10 21:33:24.629092 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.629049    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9snfm\" (UniqueName: \"kubernetes.io/projected/45bc23fd-1f91-4ba5-9329-ec67136ad418-kube-api-access-9snfm\") pod \"45bc23fd-1f91-4ba5-9329-ec67136ad418\" (UID: \"45bc23fd-1f91-4ba5-9329-ec67136ad418\") "
Sep 10 21:33:24.629410 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.629377    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45bc23fd-1f91-4ba5-9329-ec67136ad418-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "45bc23fd-1f91-4ba5-9329-ec67136ad418" (UID: "45bc23fd-1f91-4ba5-9329-ec67136ad418"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:33:24.631235 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.631178    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45bc23fd-1f91-4ba5-9329-ec67136ad418-kube-api-access-9snfm" (OuterVolumeSpecName: "kube-api-access-9snfm") pod "45bc23fd-1f91-4ba5-9329-ec67136ad418" (UID: "45bc23fd-1f91-4ba5-9329-ec67136ad418"). InnerVolumeSpecName "kube-api-access-9snfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:33:24.631235 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.631178    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "45bc23fd-1f91-4ba5-9329-ec67136ad418" (UID: "45bc23fd-1f91-4ba5-9329-ec67136ad418"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:33:24.631377 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.631236    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "45bc23fd-1f91-4ba5-9329-ec67136ad418" (UID: "45bc23fd-1f91-4ba5-9329-ec67136ad418"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:33:24.730954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.730881    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:33:24.730954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.730905    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45bc23fd-1f91-4ba5-9329-ec67136ad418-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:33:24.730954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.730916    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45bc23fd-1f91-4ba5-9329-ec67136ad418-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:33:24.730954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:24.730925    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9snfm\" (UniqueName: \"kubernetes.io/projected/45bc23fd-1f91-4ba5-9329-ec67136ad418-kube-api-access-9snfm\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:33:25.249884 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:25.249846    2568 generic.go:356] "Generic (PLEG): container finished" podID="45bc23fd-1f91-4ba5-9329-ec67136ad418" containerID="291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221" exitCode=0
Sep 10 21:33:25.250407 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:25.249891    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"
Sep 10 21:33:25.250407 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:25.249940    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq" event={"ID":"45bc23fd-1f91-4ba5-9329-ec67136ad418","Type":"ContainerDied","Data":"291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221"}
Sep 10 21:33:25.250407 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:25.250002    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq" event={"ID":"45bc23fd-1f91-4ba5-9329-ec67136ad418","Type":"ContainerDied","Data":"2a9fc50aff3a937bea339fb93a148c6c0e50016ab90e628590614d55f706af04"}
Sep 10 21:33:25.250407 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:25.250033    2568 scope.go:117] "RemoveContainer" containerID="291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221"
Sep 10 21:33:25.261390 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:25.261370    2568 scope.go:117] "RemoveContainer" containerID="291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221"
Sep 10 21:33:25.261675 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:33:25.261657    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221\": container with ID starting with 291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221 not found: ID does not exist" containerID="291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221"
Sep 10 21:33:25.261762 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:25.261684    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221"} err="failed to get container status \"291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221\": rpc error: code = NotFound desc = could not find container \"291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221\": container with ID starting with 291d4c1d38582eb9cdb059618e6eba79613c88c8f9e8d4a23189a42bd3b08221 not found: ID does not exist"
Sep 10 21:33:25.273357 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:25.273335    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"]
Sep 10 21:33:25.276229 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:25.276194    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-30df1990-695dcbb44c-hngxq"]
Sep 10 21:33:26.196658 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:26.196625    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45bc23fd-1f91-4ba5-9329-ec67136ad418" path="/var/lib/kubelet/pods/45bc23fd-1f91-4ba5-9329-ec67136ad418/volumes"
Sep 10 21:33:28.824096 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:28.824066    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"]
Sep 10 21:33:28.824677 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:28.824658    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45bc23fd-1f91-4ba5-9329-ec67136ad418" containerName="maas-api"
Sep 10 21:33:28.824729 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:28.824680    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="45bc23fd-1f91-4ba5-9329-ec67136ad418" containerName="maas-api"
Sep 10 21:33:28.824797 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:28.824788    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="45bc23fd-1f91-4ba5-9329-ec67136ad418" containerName="maas-api"
Sep 10 21:33:28.829603 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:28.829582    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:28.832028 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:28.832005    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-07c263d6-serving-cert\""
Sep 10 21:33:28.842262 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:28.842241    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"]
Sep 10 21:33:28.967874 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:28.967836    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-maas-api-tls\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:28.967874 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:28.967877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-metrics-certs\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:28.968081 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:28.967896    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fzxn\" (UniqueName: \"kubernetes.io/projected/b9bb2155-689f-4cbb-b4c5-7f12d6718248-kube-api-access-6fzxn\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:28.968081 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:28.967992    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9bb2155-689f-4cbb-b4c5-7f12d6718248-openshift-service-ca\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:29.069001 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:29.068965    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-maas-api-tls\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:29.069001 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:29.069005    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-metrics-certs\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:29.069193 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:29.069024    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fzxn\" (UniqueName: \"kubernetes.io/projected/b9bb2155-689f-4cbb-b4c5-7f12d6718248-kube-api-access-6fzxn\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:29.069193 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:29.069113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9bb2155-689f-4cbb-b4c5-7f12d6718248-openshift-service-ca\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:29.069193 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:33:29.069120    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-serving-cert: secret "maas-api-e2e-ait-07c263d6-serving-cert" not found
Sep 10 21:33:29.069193 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:33:29.069188    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-maas-api-tls podName:b9bb2155-689f-4cbb-b4c5-7f12d6718248 nodeName:}" failed. No retries permitted until 2026-09-10 21:33:29.569165652 +0000 UTC m=+859.771496219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-maas-api-tls") pod "maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l" (UID: "b9bb2155-689f-4cbb-b4c5-7f12d6718248") : secret "maas-api-e2e-ait-07c263d6-serving-cert" not found
Sep 10 21:33:29.069767 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:29.069742    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9bb2155-689f-4cbb-b4c5-7f12d6718248-openshift-service-ca\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:29.071624 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:29.071599    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-metrics-certs\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:29.078423 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:29.078365    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fzxn\" (UniqueName: \"kubernetes.io/projected/b9bb2155-689f-4cbb-b4c5-7f12d6718248-kube-api-access-6fzxn\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:29.574675 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:29.574645    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-maas-api-tls\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:29.576890 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:29.576866    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-maas-api-tls\") pod \"maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:29.741708 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:29.741673    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:30.020159 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:30.020125    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"]
Sep 10 21:33:30.021507 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:33:30.021477    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bb2155_689f_4cbb_b4c5_7f12d6718248.slice/crio-2d231b8b6185497c1043704b26e920730b6e5b29e0c723811bcbbf3aea3389e4 WatchSource:0}: Error finding container 2d231b8b6185497c1043704b26e920730b6e5b29e0c723811bcbbf3aea3389e4: Status 404 returned error can't find the container with id 2d231b8b6185497c1043704b26e920730b6e5b29e0c723811bcbbf3aea3389e4
Sep 10 21:33:30.285770 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:30.285671    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l" event={"ID":"b9bb2155-689f-4cbb-b4c5-7f12d6718248","Type":"ContainerStarted","Data":"2d231b8b6185497c1043704b26e920730b6e5b29e0c723811bcbbf3aea3389e4"}
Sep 10 21:33:31.293812 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:31.293779    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l" event={"ID":"b9bb2155-689f-4cbb-b4c5-7f12d6718248","Type":"ContainerStarted","Data":"c542bcb22ce78f84e18be2375d58436cd105ceeec20a3d8dca3820fe2733efde"}
Sep 10 21:33:31.294186 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:31.293849    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:31.313517 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:31.313469    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l" podStartSLOduration=2.839102396 podStartE2EDuration="3.313454533s" totalImagesPullingTime="474.352137ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:33:31.311125801 +0000 UTC m=+861.513456372" watchObservedRunningTime="2026-09-10 21:33:31.313454533 +0000 UTC m=+861.515785105"
Sep 10 21:33:37.305701 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:37.305669    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:59.317139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.317108    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"]
Sep 10 21:33:59.317726 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.317345    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l" podUID="b9bb2155-689f-4cbb-b4c5-7f12d6718248" containerName="maas-api" containerID="cri-o://c542bcb22ce78f84e18be2375d58436cd105ceeec20a3d8dca3820fe2733efde" gracePeriod=30
Sep 10 21:33:59.476717 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.476687    2568 generic.go:356] "Generic (PLEG): container finished" podID="b9bb2155-689f-4cbb-b4c5-7f12d6718248" containerID="c542bcb22ce78f84e18be2375d58436cd105ceeec20a3d8dca3820fe2733efde" exitCode=0
Sep 10 21:33:59.476881 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.476740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l" event={"ID":"b9bb2155-689f-4cbb-b4c5-7f12d6718248","Type":"ContainerDied","Data":"c542bcb22ce78f84e18be2375d58436cd105ceeec20a3d8dca3820fe2733efde"}
Sep 10 21:33:59.589129 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.589104    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:33:59.651275 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.651234    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-maas-api-tls\") pod \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") "
Sep 10 21:33:59.651453 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.651281    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fzxn\" (UniqueName: \"kubernetes.io/projected/b9bb2155-689f-4cbb-b4c5-7f12d6718248-kube-api-access-6fzxn\") pod \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") "
Sep 10 21:33:59.651453 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.651345    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9bb2155-689f-4cbb-b4c5-7f12d6718248-openshift-service-ca\") pod \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") "
Sep 10 21:33:59.651453 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.651390    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-metrics-certs\") pod \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\" (UID: \"b9bb2155-689f-4cbb-b4c5-7f12d6718248\") "
Sep 10 21:33:59.651763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.651724    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9bb2155-689f-4cbb-b4c5-7f12d6718248-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9bb2155-689f-4cbb-b4c5-7f12d6718248" (UID: "b9bb2155-689f-4cbb-b4c5-7f12d6718248"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:33:59.653862 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.653820    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9bb2155-689f-4cbb-b4c5-7f12d6718248" (UID: "b9bb2155-689f-4cbb-b4c5-7f12d6718248"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:33:59.654499 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.654423    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b9bb2155-689f-4cbb-b4c5-7f12d6718248" (UID: "b9bb2155-689f-4cbb-b4c5-7f12d6718248"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:33:59.654499 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.654452    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bb2155-689f-4cbb-b4c5-7f12d6718248-kube-api-access-6fzxn" (OuterVolumeSpecName: "kube-api-access-6fzxn") pod "b9bb2155-689f-4cbb-b4c5-7f12d6718248" (UID: "b9bb2155-689f-4cbb-b4c5-7f12d6718248"). InnerVolumeSpecName "kube-api-access-6fzxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:33:59.752615 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.752580    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:33:59.752615 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.752609    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fzxn\" (UniqueName: \"kubernetes.io/projected/b9bb2155-689f-4cbb-b4c5-7f12d6718248-kube-api-access-6fzxn\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:33:59.752784 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.752623    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9bb2155-689f-4cbb-b4c5-7f12d6718248-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:33:59.752784 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:33:59.752635    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9bb2155-689f-4cbb-b4c5-7f12d6718248-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:34:00.483173 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:00.483101    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"
Sep 10 21:34:00.483550 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:00.483100    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l" event={"ID":"b9bb2155-689f-4cbb-b4c5-7f12d6718248","Type":"ContainerDied","Data":"2d231b8b6185497c1043704b26e920730b6e5b29e0c723811bcbbf3aea3389e4"}
Sep 10 21:34:00.483550 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:00.483239    2568 scope.go:117] "RemoveContainer" containerID="c542bcb22ce78f84e18be2375d58436cd105ceeec20a3d8dca3820fe2733efde"
Sep 10 21:34:00.502839 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:00.502803    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"]
Sep 10 21:34:00.508844 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:00.508815    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07c263d6-7d57c796cf-2f97l"]
Sep 10 21:34:02.197593 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:02.197561    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9bb2155-689f-4cbb-b4c5-7f12d6718248" path="/var/lib/kubelet/pods/b9bb2155-689f-4cbb-b4c5-7f12d6718248/volumes"
Sep 10 21:34:04.928887 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:04.928855    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"]
Sep 10 21:34:04.931428 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:04.929547    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bb2155-689f-4cbb-b4c5-7f12d6718248" containerName="maas-api"
Sep 10 21:34:04.931428 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:04.929564    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bb2155-689f-4cbb-b4c5-7f12d6718248" containerName="maas-api"
Sep 10 21:34:04.931428 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:04.929648    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bb2155-689f-4cbb-b4c5-7f12d6718248" containerName="maas-api"
Sep 10 21:34:04.932813 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:04.932796    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:04.936005 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:04.935985    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-bfdc6d74-serving-cert\""
Sep 10 21:34:04.947092 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:04.947069    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"]
Sep 10 21:34:05.007158 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.007128    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-maas-api-tls\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.007339 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.007259    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/243eb4e8-9e24-4588-a86b-3c64ef665fdd-openshift-service-ca\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.007339 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.007287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-metrics-certs\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.007339 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.007332    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4s7j\" (UniqueName: \"kubernetes.io/projected/243eb4e8-9e24-4588-a86b-3c64ef665fdd-kube-api-access-z4s7j\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.108777 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.108744    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/243eb4e8-9e24-4588-a86b-3c64ef665fdd-openshift-service-ca\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.108948 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.108786    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-metrics-certs\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.108948 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.108821    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4s7j\" (UniqueName: \"kubernetes.io/projected/243eb4e8-9e24-4588-a86b-3c64ef665fdd-kube-api-access-z4s7j\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.108948 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.108908    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-maas-api-tls\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.109134 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:34:05.109115    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-serving-cert: secret "maas-api-e2e-derive-bfdc6d74-serving-cert" not found
Sep 10 21:34:05.109191 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:34:05.109180    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-maas-api-tls podName:243eb4e8-9e24-4588-a86b-3c64ef665fdd nodeName:}" failed. No retries permitted until 2026-09-10 21:34:05.60916399 +0000 UTC m=+895.811494545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-maas-api-tls") pod "maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj" (UID: "243eb4e8-9e24-4588-a86b-3c64ef665fdd") : secret "maas-api-e2e-derive-bfdc6d74-serving-cert" not found
Sep 10 21:34:05.109444 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.109417    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/243eb4e8-9e24-4588-a86b-3c64ef665fdd-openshift-service-ca\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.111376 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.111349    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-metrics-certs\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.117258 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.117236    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4s7j\" (UniqueName: \"kubernetes.io/projected/243eb4e8-9e24-4588-a86b-3c64ef665fdd-kube-api-access-z4s7j\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.614869 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.614831    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-maas-api-tls\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.617183 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.617157    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-maas-api-tls\") pod \"maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:05.845675 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:05.845640    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:06.127445 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:06.127413    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"]
Sep 10 21:34:06.127802 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:34:06.127774    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243eb4e8_9e24_4588_a86b_3c64ef665fdd.slice/crio-9a1a99defa5c5e3f77818bb6e56bfce67b2c723072a824cfb3c6f41103595635 WatchSource:0}: Error finding container 9a1a99defa5c5e3f77818bb6e56bfce67b2c723072a824cfb3c6f41103595635: Status 404 returned error can't find the container with id 9a1a99defa5c5e3f77818bb6e56bfce67b2c723072a824cfb3c6f41103595635
Sep 10 21:34:06.523036 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:06.522994    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj" event={"ID":"243eb4e8-9e24-4588-a86b-3c64ef665fdd","Type":"ContainerStarted","Data":"9a1a99defa5c5e3f77818bb6e56bfce67b2c723072a824cfb3c6f41103595635"}
Sep 10 21:34:07.531817 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:07.531781    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj" event={"ID":"243eb4e8-9e24-4588-a86b-3c64ef665fdd","Type":"ContainerStarted","Data":"8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad"}
Sep 10 21:34:07.532227 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:07.531968    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:07.570337 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:07.570283    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj" podStartSLOduration=3.070746643 podStartE2EDuration="3.570268272s" totalImagesPullingTime="499.521629ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:34:07.568021434 +0000 UTC m=+897.770352008" watchObservedRunningTime="2026-09-10 21:34:07.570268272 +0000 UTC m=+897.772598866"
Sep 10 21:34:09.029727 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.029692    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"]
Sep 10 21:34:09.033745 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.033721    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.037261 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.037233    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3984e6\"/\"test-model-3984e6-kserve-self-signed-certs\""
Sep 10 21:34:09.037261 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.037257    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3984e6\"/\"openshift-service-ca.crt\""
Sep 10 21:34:09.037459 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.037282    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3984e6\"/\"default-dockercfg-vrqpm\""
Sep 10 21:34:09.037459 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.037238    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3984e6\"/\"kube-root-ca.crt\""
Sep 10 21:34:09.049526 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.049505    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"]
Sep 10 21:34:09.148506 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.148482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-dshm\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.148638 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.148511    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p96q\" (UniqueName: \"kubernetes.io/projected/65d482f5-4637-4645-8dd8-892c7f01d65d-kube-api-access-6p96q\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.148638 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.148548    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d482f5-4637-4645-8dd8-892c7f01d65d-tls-certs\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.148638 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.148610    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-home\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.148744 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.148639    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-model-cache\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.148744 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.148675    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-tmp-dir\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.249952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.249923    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d482f5-4637-4645-8dd8-892c7f01d65d-tls-certs\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.250099 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.249969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-home\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.250099 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.249994    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-model-cache\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.250099 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.250033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-tmp-dir\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.250322 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.250104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-dshm\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.250322 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.250134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p96q\" (UniqueName: \"kubernetes.io/projected/65d482f5-4637-4645-8dd8-892c7f01d65d-kube-api-access-6p96q\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.250426 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.250408    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-home\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.250681 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.250657    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-tmp-dir\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.250825 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.250806    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-model-cache\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.253053 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.253025    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-dshm\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.253261 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.253237    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d482f5-4637-4645-8dd8-892c7f01d65d-tls-certs\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.258783 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.258759    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p96q\" (UniqueName: \"kubernetes.io/projected/65d482f5-4637-4645-8dd8-892c7f01d65d-kube-api-access-6p96q\") pod \"test-model-3984e6-kserve-645b5f7895-f82gt\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") " pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.343232 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.343191    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:09.620016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:09.619992    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"]
Sep 10 21:34:09.621441 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:34:09.621408    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65d482f5_4637_4645_8dd8_892c7f01d65d.slice/crio-9f2210316adac97d0ad64cf5cc518b141e8c2cd28bf96f2554041d1768696b2c WatchSource:0}: Error finding container 9f2210316adac97d0ad64cf5cc518b141e8c2cd28bf96f2554041d1768696b2c: Status 404 returned error can't find the container with id 9f2210316adac97d0ad64cf5cc518b141e8c2cd28bf96f2554041d1768696b2c
Sep 10 21:34:10.234839 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:10.234814    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:34:10.235996 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:10.235974    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:34:10.552522 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:10.552485    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt" event={"ID":"65d482f5-4637-4645-8dd8-892c7f01d65d","Type":"ContainerStarted","Data":"87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4"}
Sep 10 21:34:10.552705 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:10.552536    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt" event={"ID":"65d482f5-4637-4645-8dd8-892c7f01d65d","Type":"ContainerStarted","Data":"9f2210316adac97d0ad64cf5cc518b141e8c2cd28bf96f2554041d1768696b2c"}
Sep 10 21:34:10.574065 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:10.574014    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt" podStartSLOduration=2.574000251 podStartE2EDuration="2.574000251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:34:10.57092004 +0000 UTC m=+900.773250613" watchObservedRunningTime="2026-09-10 21:34:10.574000251 +0000 UTC m=+900.776331188"
Sep 10 21:34:13.543742 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:13.543711    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:19.344016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:19.343982    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:19.344475 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:19.344032    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:19.357465 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:19.357438    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:19.623894 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:19.623827    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:34:32.067605 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.067566    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"]
Sep 10 21:34:32.068134 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.067870    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc" podUID="71bb2b6d-7292-49c0-9e15-9f460a9bd7b1" containerName="payload-processing" containerID="cri-o://190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8" gracePeriod=30
Sep 10 21:34:32.343188 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.343163    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:34:32.464713 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.464679    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brcfm\" (UniqueName: \"kubernetes.io/projected/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-kube-api-access-brcfm\") pod \"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1\" (UID: \"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1\") "
Sep 10 21:34:32.464877 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.464746    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-plugins-config-volume\") pod \"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1\" (UID: \"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1\") "
Sep 10 21:34:32.465154 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.465126    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "71bb2b6d-7292-49c0-9e15-9f460a9bd7b1" (UID: "71bb2b6d-7292-49c0-9e15-9f460a9bd7b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:34:32.466813 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.466779    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-kube-api-access-brcfm" (OuterVolumeSpecName: "kube-api-access-brcfm") pod "71bb2b6d-7292-49c0-9e15-9f460a9bd7b1" (UID: "71bb2b6d-7292-49c0-9e15-9f460a9bd7b1"). InnerVolumeSpecName "kube-api-access-brcfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:34:32.566545 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.566515    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-plugins-config-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:34:32.566545 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.566542    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brcfm\" (UniqueName: \"kubernetes.io/projected/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1-kube-api-access-brcfm\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:34:32.702802 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.702724    2568 generic.go:356] "Generic (PLEG): container finished" podID="71bb2b6d-7292-49c0-9e15-9f460a9bd7b1" containerID="190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8" exitCode=0
Sep 10 21:34:32.702802 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.702763    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"
Sep 10 21:34:32.703012 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.702806    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc" event={"ID":"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1","Type":"ContainerDied","Data":"190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8"}
Sep 10 21:34:32.703012 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.702865    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc" event={"ID":"71bb2b6d-7292-49c0-9e15-9f460a9bd7b1","Type":"ContainerDied","Data":"500f6a09c4e121ea25b34d4a93887856c606839e9ebf141ce06de49edc8faa8b"}
Sep 10 21:34:32.703012 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.702896    2568 scope.go:117] "RemoveContainer" containerID="190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8"
Sep 10 21:34:32.713022 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.713004    2568 scope.go:117] "RemoveContainer" containerID="190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8"
Sep 10 21:34:32.713328 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:34:32.713309    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8\": container with ID starting with 190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8 not found: ID does not exist" containerID="190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8"
Sep 10 21:34:32.713387 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.713336    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8"} err="failed to get container status \"190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8\": rpc error: code = NotFound desc = could not find container \"190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8\": container with ID starting with 190de2a81608584e6cabaac395c0be101074e300133a5516a79024dd666935e8 not found: ID does not exist"
Sep 10 21:34:32.731000 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.730975    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"]
Sep 10 21:34:32.735725 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:32.735695    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b08e7-5cd79dbb8f-tgvhc"]
Sep 10 21:34:34.197214 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:34.197169    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71bb2b6d-7292-49c0-9e15-9f460a9bd7b1" path="/var/lib/kubelet/pods/71bb2b6d-7292-49c0-9e15-9f460a9bd7b1/volumes"
Sep 10 21:34:35.727617 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:35.726687    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"]
Sep 10 21:34:35.727617 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:35.727090    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj" podUID="243eb4e8-9e24-4588-a86b-3c64ef665fdd" containerName="maas-api" containerID="cri-o://8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad" gracePeriod=30
Sep 10 21:34:35.978696 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:35.978638    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:36.097417 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.097373    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4s7j\" (UniqueName: \"kubernetes.io/projected/243eb4e8-9e24-4588-a86b-3c64ef665fdd-kube-api-access-z4s7j\") pod \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") "
Sep 10 21:34:36.097610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.097540    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/243eb4e8-9e24-4588-a86b-3c64ef665fdd-openshift-service-ca\") pod \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") "
Sep 10 21:34:36.097677 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.097628    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-metrics-certs\") pod \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") "
Sep 10 21:34:36.097728 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.097689    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-maas-api-tls\") pod \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\" (UID: \"243eb4e8-9e24-4588-a86b-3c64ef665fdd\") "
Sep 10 21:34:36.098217 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.098153    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/243eb4e8-9e24-4588-a86b-3c64ef665fdd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "243eb4e8-9e24-4588-a86b-3c64ef665fdd" (UID: "243eb4e8-9e24-4588-a86b-3c64ef665fdd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:34:36.100303 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.100275    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "243eb4e8-9e24-4588-a86b-3c64ef665fdd" (UID: "243eb4e8-9e24-4588-a86b-3c64ef665fdd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:34:36.100515 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.100487    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "243eb4e8-9e24-4588-a86b-3c64ef665fdd" (UID: "243eb4e8-9e24-4588-a86b-3c64ef665fdd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:34:36.100515 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.100506    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/243eb4e8-9e24-4588-a86b-3c64ef665fdd-kube-api-access-z4s7j" (OuterVolumeSpecName: "kube-api-access-z4s7j") pod "243eb4e8-9e24-4588-a86b-3c64ef665fdd" (UID: "243eb4e8-9e24-4588-a86b-3c64ef665fdd"). InnerVolumeSpecName "kube-api-access-z4s7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:34:36.198810 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.198780    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:34:36.198810 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.198805    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/243eb4e8-9e24-4588-a86b-3c64ef665fdd-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:34:36.198810 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.198815    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4s7j\" (UniqueName: \"kubernetes.io/projected/243eb4e8-9e24-4588-a86b-3c64ef665fdd-kube-api-access-z4s7j\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:34:36.199127 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.198823    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/243eb4e8-9e24-4588-a86b-3c64ef665fdd-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:34:36.735486 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.735453    2568 generic.go:356] "Generic (PLEG): container finished" podID="243eb4e8-9e24-4588-a86b-3c64ef665fdd" containerID="8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad" exitCode=0
Sep 10 21:34:36.735952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.735500    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"
Sep 10 21:34:36.735952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.735540    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj" event={"ID":"243eb4e8-9e24-4588-a86b-3c64ef665fdd","Type":"ContainerDied","Data":"8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad"}
Sep 10 21:34:36.735952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.735602    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj" event={"ID":"243eb4e8-9e24-4588-a86b-3c64ef665fdd","Type":"ContainerDied","Data":"9a1a99defa5c5e3f77818bb6e56bfce67b2c723072a824cfb3c6f41103595635"}
Sep 10 21:34:36.735952 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.735638    2568 scope.go:117] "RemoveContainer" containerID="8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad"
Sep 10 21:34:36.745260 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.745247    2568 scope.go:117] "RemoveContainer" containerID="8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad"
Sep 10 21:34:36.745523 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:34:36.745502    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad\": container with ID starting with 8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad not found: ID does not exist" containerID="8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad"
Sep 10 21:34:36.745584 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.745531    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad"} err="failed to get container status \"8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad\": rpc error: code = NotFound desc = could not find container \"8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad\": container with ID starting with 8761f5404dee2b179132dd9d002689bfe62e73172161f5723633760e11b103ad not found: ID does not exist"
Sep 10 21:34:36.759895 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.759860    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"]
Sep 10 21:34:36.762501 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:36.762483    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bfdc6d74-688f855ddc-d6jdj"]
Sep 10 21:34:38.197012 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:34:38.196979    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="243eb4e8-9e24-4588-a86b-3c64ef665fdd" path="/var/lib/kubelet/pods/243eb4e8-9e24-4588-a86b-3c64ef665fdd/volumes"
Sep 10 21:36:10.162850 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:10.162813    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"]
Sep 10 21:36:20.199111 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.199072    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"]
Sep 10 21:36:20.199767 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.199747    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243eb4e8-9e24-4588-a86b-3c64ef665fdd" containerName="maas-api"
Sep 10 21:36:20.199859 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.199768    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="243eb4e8-9e24-4588-a86b-3c64ef665fdd" containerName="maas-api"
Sep 10 21:36:20.199859 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.199785    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71bb2b6d-7292-49c0-9e15-9f460a9bd7b1" containerName="payload-processing"
Sep 10 21:36:20.199859 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.199792    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="71bb2b6d-7292-49c0-9e15-9f460a9bd7b1" containerName="payload-processing"
Sep 10 21:36:20.200012 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.199947    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="243eb4e8-9e24-4588-a86b-3c64ef665fdd" containerName="maas-api"
Sep 10 21:36:20.200012 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.199968    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="71bb2b6d-7292-49c0-9e15-9f460a9bd7b1" containerName="payload-processing"
Sep 10 21:36:20.203495 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.203469    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.205951 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.205929    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-92c5c624-serving-cert\""
Sep 10 21:36:20.214612 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.214588    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"]
Sep 10 21:36:20.379051 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.379017    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-maas-api-tls\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.379312 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.379118    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-openshift-service-ca\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.379312 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.379156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-metrics-certs\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.379312 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.379188    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtzbm\" (UniqueName: \"kubernetes.io/projected/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-kube-api-access-mtzbm\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.480250 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.480141    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-maas-api-tls\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.480250 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.480248    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-openshift-service-ca\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.480455 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.480273    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-metrics-certs\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.480455 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.480300    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzbm\" (UniqueName: \"kubernetes.io/projected/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-kube-api-access-mtzbm\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.480987 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.480957    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-openshift-service-ca\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.482661 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.482623    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-maas-api-tls\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.482789 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.482757    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-metrics-certs\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.488637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.488612    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtzbm\" (UniqueName: \"kubernetes.io/projected/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-kube-api-access-mtzbm\") pod \"maas-api-e2e-mt-92c5c624-f5cf69c-srtdd\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.517409 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.517390    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:20.795508 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.795477    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"]
Sep 10 21:36:20.796304 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:36:20.796268    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b77b9c2_c529_4ed1_9d49_7b0352dbaeba.slice/crio-0eb458b08cb8fcb1381fd3bb2611cb494962942f3f0ea0feed17ebd6ab1ae009 WatchSource:0}: Error finding container 0eb458b08cb8fcb1381fd3bb2611cb494962942f3f0ea0feed17ebd6ab1ae009: Status 404 returned error can't find the container with id 0eb458b08cb8fcb1381fd3bb2611cb494962942f3f0ea0feed17ebd6ab1ae009
Sep 10 21:36:20.797772 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:20.797751    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:36:21.419258 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:21.419219    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd" event={"ID":"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba","Type":"ContainerStarted","Data":"a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239"}
Sep 10 21:36:21.419592 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:21.419286    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:36:21.419592 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:21.419305    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd" event={"ID":"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba","Type":"ContainerStarted","Data":"0eb458b08cb8fcb1381fd3bb2611cb494962942f3f0ea0feed17ebd6ab1ae009"}
Sep 10 21:36:21.437336 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:21.437288    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd" podStartSLOduration=0.908852327 podStartE2EDuration="1.437274227s" totalImagesPullingTime="528.4219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:36:21.435171566 +0000 UTC m=+1031.637502139" watchObservedRunningTime="2026-09-10 21:36:21.437274227 +0000 UTC m=+1031.639604827"
Sep 10 21:36:23.197424 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.197385    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"]
Sep 10 21:36:23.197870 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.197604    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd" podUID="d363d177-eef2-4240-b64f-9849cc1b8a50" containerName="maas-api" containerID="cri-o://aa93da30b7709d140b5563e7679d3b8017f3fecee27f10c4c4e2f83d41a69b7e" gracePeriod=30
Sep 10 21:36:23.261587 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.261548    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"]
Sep 10 21:36:23.261816 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.261782    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt" podUID="5a549fdd-661b-4687-b198-ccafdaac3d9f" containerName="payload-pre-processing" containerID="cri-o://5dcaecae4af4477603a780bb50b35edb29817138fd5a737e74cf5a1ed0e5197f" gracePeriod=30
Sep 10 21:36:23.438723 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.438437    2568 generic.go:356] "Generic (PLEG): container finished" podID="d363d177-eef2-4240-b64f-9849cc1b8a50" containerID="aa93da30b7709d140b5563e7679d3b8017f3fecee27f10c4c4e2f83d41a69b7e" exitCode=0
Sep 10 21:36:23.438866 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.438845    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd" event={"ID":"d363d177-eef2-4240-b64f-9849cc1b8a50","Type":"ContainerDied","Data":"aa93da30b7709d140b5563e7679d3b8017f3fecee27f10c4c4e2f83d41a69b7e"}
Sep 10 21:36:23.440939 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.440912    2568 generic.go:356] "Generic (PLEG): container finished" podID="5a549fdd-661b-4687-b198-ccafdaac3d9f" containerID="5dcaecae4af4477603a780bb50b35edb29817138fd5a737e74cf5a1ed0e5197f" exitCode=0
Sep 10 21:36:23.441055 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.440975    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt" event={"ID":"5a549fdd-661b-4687-b198-ccafdaac3d9f","Type":"ContainerDied","Data":"5dcaecae4af4477603a780bb50b35edb29817138fd5a737e74cf5a1ed0e5197f"}
Sep 10 21:36:23.515557 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.515531    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:36:23.557899 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.557875    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:36:23.609894 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.609865    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rm6nk\" (UniqueName: \"kubernetes.io/projected/d363d177-eef2-4240-b64f-9849cc1b8a50-kube-api-access-rm6nk\") pod \"d363d177-eef2-4240-b64f-9849cc1b8a50\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") "
Sep 10 21:36:23.610030 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.609916    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-metrics-certs\") pod \"d363d177-eef2-4240-b64f-9849cc1b8a50\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") "
Sep 10 21:36:23.610030 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.609944    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d363d177-eef2-4240-b64f-9849cc1b8a50-openshift-service-ca\") pod \"d363d177-eef2-4240-b64f-9849cc1b8a50\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") "
Sep 10 21:36:23.610112 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.610064    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-maas-api-tls\") pod \"d363d177-eef2-4240-b64f-9849cc1b8a50\" (UID: \"d363d177-eef2-4240-b64f-9849cc1b8a50\") "
Sep 10 21:36:23.610390 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.610370    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d363d177-eef2-4240-b64f-9849cc1b8a50-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d363d177-eef2-4240-b64f-9849cc1b8a50" (UID: "d363d177-eef2-4240-b64f-9849cc1b8a50"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:36:23.610502 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.610485    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d363d177-eef2-4240-b64f-9849cc1b8a50-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:23.612026 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.612006    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d363d177-eef2-4240-b64f-9849cc1b8a50-kube-api-access-rm6nk" (OuterVolumeSpecName: "kube-api-access-rm6nk") pod "d363d177-eef2-4240-b64f-9849cc1b8a50" (UID: "d363d177-eef2-4240-b64f-9849cc1b8a50"). InnerVolumeSpecName "kube-api-access-rm6nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:36:23.612148 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.612050    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d363d177-eef2-4240-b64f-9849cc1b8a50" (UID: "d363d177-eef2-4240-b64f-9849cc1b8a50"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:36:23.612148 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.612064    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d363d177-eef2-4240-b64f-9849cc1b8a50" (UID: "d363d177-eef2-4240-b64f-9849cc1b8a50"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:36:23.711573 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.711537    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a549fdd-661b-4687-b198-ccafdaac3d9f-plugins-config-volume\") pod \"5a549fdd-661b-4687-b198-ccafdaac3d9f\" (UID: \"5a549fdd-661b-4687-b198-ccafdaac3d9f\") "
Sep 10 21:36:23.711700 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.711677    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr756\" (UniqueName: \"kubernetes.io/projected/5a549fdd-661b-4687-b198-ccafdaac3d9f-kube-api-access-fr756\") pod \"5a549fdd-661b-4687-b198-ccafdaac3d9f\" (UID: \"5a549fdd-661b-4687-b198-ccafdaac3d9f\") "
Sep 10 21:36:23.711938 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.711910    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a549fdd-661b-4687-b198-ccafdaac3d9f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a549fdd-661b-4687-b198-ccafdaac3d9f" (UID: "5a549fdd-661b-4687-b198-ccafdaac3d9f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:36:23.712054 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.712012    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:23.712054 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.712028    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm6nk\" (UniqueName: \"kubernetes.io/projected/d363d177-eef2-4240-b64f-9849cc1b8a50-kube-api-access-rm6nk\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:23.712054 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.712037    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d363d177-eef2-4240-b64f-9849cc1b8a50-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:23.712054 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.712045    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a549fdd-661b-4687-b198-ccafdaac3d9f-plugins-config-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:23.713504 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.713485    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a549fdd-661b-4687-b198-ccafdaac3d9f-kube-api-access-fr756" (OuterVolumeSpecName: "kube-api-access-fr756") pod "5a549fdd-661b-4687-b198-ccafdaac3d9f" (UID: "5a549fdd-661b-4687-b198-ccafdaac3d9f"). InnerVolumeSpecName "kube-api-access-fr756". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:36:23.813248 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:23.813209    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr756\" (UniqueName: \"kubernetes.io/projected/5a549fdd-661b-4687-b198-ccafdaac3d9f-kube-api-access-fr756\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:24.455244 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:24.455186    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"
Sep 10 21:36:24.455244 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:24.455226    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd" event={"ID":"d363d177-eef2-4240-b64f-9849cc1b8a50","Type":"ContainerDied","Data":"8e31de4398056b106d0c9f520f7a3ca903dc2f4cfa3b861f06ed3b69ca9969c6"}
Sep 10 21:36:24.455737 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:24.455318    2568 scope.go:117] "RemoveContainer" containerID="aa93da30b7709d140b5563e7679d3b8017f3fecee27f10c4c4e2f83d41a69b7e"
Sep 10 21:36:24.457184 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:24.457152    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt" event={"ID":"5a549fdd-661b-4687-b198-ccafdaac3d9f","Type":"ContainerDied","Data":"de1470201ad16a40b703fb7ed3dcc09bcfe3f72112738071162d002ab9b86ca3"}
Sep 10 21:36:24.457184 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:24.457177    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"
Sep 10 21:36:24.466006 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:24.465986    2568 scope.go:117] "RemoveContainer" containerID="5dcaecae4af4477603a780bb50b35edb29817138fd5a737e74cf5a1ed0e5197f"
Sep 10 21:36:24.476324 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:24.476297    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"]
Sep 10 21:36:24.480311 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:24.480289    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3984e6-75c4cbb8db-pr5sd"]
Sep 10 21:36:24.490305 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:24.490280    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"]
Sep 10 21:36:24.493894 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:24.493873    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3984e6-bcc6fcddb-vcsvt"]
Sep 10 21:36:25.182997 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.182952    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt" podUID="65d482f5-4637-4645-8dd8-892c7f01d65d" containerName="main" containerID="cri-o://87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4" gracePeriod=45
Sep 10 21:36:25.439248 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.439179    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:36:25.465718 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.465693    2568 generic.go:356] "Generic (PLEG): container finished" podID="65d482f5-4637-4645-8dd8-892c7f01d65d" containerID="87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4" exitCode=0
Sep 10 21:36:25.466122 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.465734    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"
Sep 10 21:36:25.466122 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.465776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt" event={"ID":"65d482f5-4637-4645-8dd8-892c7f01d65d","Type":"ContainerDied","Data":"87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4"}
Sep 10 21:36:25.466122 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.465824    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt" event={"ID":"65d482f5-4637-4645-8dd8-892c7f01d65d","Type":"ContainerDied","Data":"9f2210316adac97d0ad64cf5cc518b141e8c2cd28bf96f2554041d1768696b2c"}
Sep 10 21:36:25.466122 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.465850    2568 scope.go:117] "RemoveContainer" containerID="87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4"
Sep 10 21:36:25.475723 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.475704    2568 scope.go:117] "RemoveContainer" containerID="87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4"
Sep 10 21:36:25.476012 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:36:25.475994    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4\": container with ID starting with 87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4 not found: ID does not exist" containerID="87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4"
Sep 10 21:36:25.476078 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.476022    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4"} err="failed to get container status \"87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4\": rpc error: code = NotFound desc = could not find container \"87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4\": container with ID starting with 87ef6b7b0d4edb31a9c8cc7a48ed30e52020ab3fb4dd6fcd6029e7f66669b9d4 not found: ID does not exist"
Sep 10 21:36:25.630629 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.630606    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-tmp-dir\") pod \"65d482f5-4637-4645-8dd8-892c7f01d65d\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") "
Sep 10 21:36:25.630778 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.630649    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-dshm\") pod \"65d482f5-4637-4645-8dd8-892c7f01d65d\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") "
Sep 10 21:36:25.630778 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.630721    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-home\") pod \"65d482f5-4637-4645-8dd8-892c7f01d65d\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") "
Sep 10 21:36:25.630904 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.630797    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p96q\" (UniqueName: \"kubernetes.io/projected/65d482f5-4637-4645-8dd8-892c7f01d65d-kube-api-access-6p96q\") pod \"65d482f5-4637-4645-8dd8-892c7f01d65d\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") "
Sep 10 21:36:25.630904 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.630844    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-model-cache\") pod \"65d482f5-4637-4645-8dd8-892c7f01d65d\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") "
Sep 10 21:36:25.630904 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.630875    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d482f5-4637-4645-8dd8-892c7f01d65d-tls-certs\") pod \"65d482f5-4637-4645-8dd8-892c7f01d65d\" (UID: \"65d482f5-4637-4645-8dd8-892c7f01d65d\") "
Sep 10 21:36:25.630904 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.630875    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "65d482f5-4637-4645-8dd8-892c7f01d65d" (UID: "65d482f5-4637-4645-8dd8-892c7f01d65d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:36:25.631121 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.631031    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-home" (OuterVolumeSpecName: "home") pod "65d482f5-4637-4645-8dd8-892c7f01d65d" (UID: "65d482f5-4637-4645-8dd8-892c7f01d65d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:36:25.631121 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.631106    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-model-cache" (OuterVolumeSpecName: "model-cache") pod "65d482f5-4637-4645-8dd8-892c7f01d65d" (UID: "65d482f5-4637-4645-8dd8-892c7f01d65d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:36:25.631253 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.631238    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-tmp-dir\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:25.631301 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.631253    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-home\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:25.631301 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.631262    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-model-cache\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:25.632975 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.632949    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-dshm" (OuterVolumeSpecName: "dshm") pod "65d482f5-4637-4645-8dd8-892c7f01d65d" (UID: "65d482f5-4637-4645-8dd8-892c7f01d65d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:36:25.633075 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.633018    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65d482f5-4637-4645-8dd8-892c7f01d65d-kube-api-access-6p96q" (OuterVolumeSpecName: "kube-api-access-6p96q") pod "65d482f5-4637-4645-8dd8-892c7f01d65d" (UID: "65d482f5-4637-4645-8dd8-892c7f01d65d"). InnerVolumeSpecName "kube-api-access-6p96q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:36:25.633075 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.633029    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65d482f5-4637-4645-8dd8-892c7f01d65d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "65d482f5-4637-4645-8dd8-892c7f01d65d" (UID: "65d482f5-4637-4645-8dd8-892c7f01d65d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:36:25.731806 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.731733    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65d482f5-4637-4645-8dd8-892c7f01d65d-dshm\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:25.731806 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.731764    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p96q\" (UniqueName: \"kubernetes.io/projected/65d482f5-4637-4645-8dd8-892c7f01d65d-kube-api-access-6p96q\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:25.731806 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.731775    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d482f5-4637-4645-8dd8-892c7f01d65d-tls-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:36:25.790337 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.790313    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"]
Sep 10 21:36:25.794055 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:25.794032    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-3984e6/test-model-3984e6-kserve-645b5f7895-f82gt"]
Sep 10 21:36:26.197318 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:26.197287    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a549fdd-661b-4687-b198-ccafdaac3d9f" path="/var/lib/kubelet/pods/5a549fdd-661b-4687-b198-ccafdaac3d9f/volumes"
Sep 10 21:36:26.197753 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:26.197734    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65d482f5-4637-4645-8dd8-892c7f01d65d" path="/var/lib/kubelet/pods/65d482f5-4637-4645-8dd8-892c7f01d65d/volumes"
Sep 10 21:36:26.198141 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:26.198128    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d363d177-eef2-4240-b64f-9849cc1b8a50" path="/var/lib/kubelet/pods/d363d177-eef2-4240-b64f-9849cc1b8a50/volumes"
Sep 10 21:36:27.431484 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:36:27.431459    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:37:02.156247 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.156211    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"]
Sep 10 21:37:02.157195 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.157135    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd" podUID="7b77b9c2-c529-4ed1-9d49-7b0352dbaeba" containerName="maas-api" containerID="cri-o://a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239" gracePeriod=30
Sep 10 21:37:02.411758 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.411700    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:37:02.570786 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.570756    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-maas-api-tls\") pod \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") "
Sep 10 21:37:02.570954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.570808    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-metrics-certs\") pod \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") "
Sep 10 21:37:02.571030 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.570963    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-openshift-service-ca\") pod \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") "
Sep 10 21:37:02.571087 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.571026    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtzbm\" (UniqueName: \"kubernetes.io/projected/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-kube-api-access-mtzbm\") pod \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\" (UID: \"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba\") "
Sep 10 21:37:02.571402 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.571379    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7b77b9c2-c529-4ed1-9d49-7b0352dbaeba" (UID: "7b77b9c2-c529-4ed1-9d49-7b0352dbaeba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:37:02.573048 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.573014    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7b77b9c2-c529-4ed1-9d49-7b0352dbaeba" (UID: "7b77b9c2-c529-4ed1-9d49-7b0352dbaeba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:37:02.573164 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.573045    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7b77b9c2-c529-4ed1-9d49-7b0352dbaeba" (UID: "7b77b9c2-c529-4ed1-9d49-7b0352dbaeba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:37:02.573164 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.573077    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-kube-api-access-mtzbm" (OuterVolumeSpecName: "kube-api-access-mtzbm") pod "7b77b9c2-c529-4ed1-9d49-7b0352dbaeba" (UID: "7b77b9c2-c529-4ed1-9d49-7b0352dbaeba"). InnerVolumeSpecName "kube-api-access-mtzbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:37:02.672648 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.672592    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:37:02.672648 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.672613    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:37:02.672648 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.672621    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:37:02.672648 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.672630    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtzbm\" (UniqueName: \"kubernetes.io/projected/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba-kube-api-access-mtzbm\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:37:02.701394 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.701366    2568 generic.go:356] "Generic (PLEG): container finished" podID="7b77b9c2-c529-4ed1-9d49-7b0352dbaeba" containerID="a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239" exitCode=0
Sep 10 21:37:02.701492 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.701430    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"
Sep 10 21:37:02.701492 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.701451    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd" event={"ID":"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba","Type":"ContainerDied","Data":"a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239"}
Sep 10 21:37:02.701654 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.701515    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd" event={"ID":"7b77b9c2-c529-4ed1-9d49-7b0352dbaeba","Type":"ContainerDied","Data":"0eb458b08cb8fcb1381fd3bb2611cb494962942f3f0ea0feed17ebd6ab1ae009"}
Sep 10 21:37:02.701654 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.701539    2568 scope.go:117] "RemoveContainer" containerID="a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239"
Sep 10 21:37:02.711610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.711592    2568 scope.go:117] "RemoveContainer" containerID="a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239"
Sep 10 21:37:02.711875 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:37:02.711855    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239\": container with ID starting with a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239 not found: ID does not exist" containerID="a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239"
Sep 10 21:37:02.711917 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.711884    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239"} err="failed to get container status \"a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239\": rpc error: code = NotFound desc = could not find container \"a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239\": container with ID starting with a453402040825a37247f83c929346bd3ac60a603f1909689007eee6225f8c239 not found: ID does not exist"
Sep 10 21:37:02.724650 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.724627    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"]
Sep 10 21:37:02.730246 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:02.730223    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c5c624-f5cf69c-srtdd"]
Sep 10 21:37:04.197173 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:04.197132    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b77b9c2-c529-4ed1-9d49-7b0352dbaeba" path="/var/lib/kubelet/pods/7b77b9c2-c529-4ed1-9d49-7b0352dbaeba/volumes"
Sep 10 21:37:21.731118 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731087    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"]
Sep 10 21:37:21.731577 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731563    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a549fdd-661b-4687-b198-ccafdaac3d9f" containerName="payload-pre-processing"
Sep 10 21:37:21.731632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731580    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a549fdd-661b-4687-b198-ccafdaac3d9f" containerName="payload-pre-processing"
Sep 10 21:37:21.731632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731601    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b77b9c2-c529-4ed1-9d49-7b0352dbaeba" containerName="maas-api"
Sep 10 21:37:21.731632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731607    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b77b9c2-c529-4ed1-9d49-7b0352dbaeba" containerName="maas-api"
Sep 10 21:37:21.731632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731617    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65d482f5-4637-4645-8dd8-892c7f01d65d" containerName="main"
Sep 10 21:37:21.731632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731623    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="65d482f5-4637-4645-8dd8-892c7f01d65d" containerName="main"
Sep 10 21:37:21.731632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731631    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d363d177-eef2-4240-b64f-9849cc1b8a50" containerName="maas-api"
Sep 10 21:37:21.731847 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731637    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d363d177-eef2-4240-b64f-9849cc1b8a50" containerName="maas-api"
Sep 10 21:37:21.731847 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731709    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d363d177-eef2-4240-b64f-9849cc1b8a50" containerName="maas-api"
Sep 10 21:37:21.731847 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731717    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b77b9c2-c529-4ed1-9d49-7b0352dbaeba" containerName="maas-api"
Sep 10 21:37:21.731847 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731724    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="65d482f5-4637-4645-8dd8-892c7f01d65d" containerName="main"
Sep 10 21:37:21.731847 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.731731    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a549fdd-661b-4687-b198-ccafdaac3d9f" containerName="payload-pre-processing"
Sep 10 21:37:21.736611 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.736587    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:21.738980 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.738958    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-67d5e2-serving-cert\""
Sep 10 21:37:21.745440 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.745418    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"]
Sep 10 21:37:21.842336 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.842307    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:21.842525 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.842343    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8vj6\" (UniqueName: \"kubernetes.io/projected/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-kube-api-access-m8vj6\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:21.842525 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.842372    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:21.842525 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.842486    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:21.943491 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.943456    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:21.943491 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.943495    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vj6\" (UniqueName: \"kubernetes.io/projected/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-kube-api-access-m8vj6\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:21.943726 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.943518    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:21.943726 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.943587    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:21.943726 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:37:21.943700    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-serving-cert: secret "maas-api-e2e-shared-b-w3-67d5e2-serving-cert" not found
Sep 10 21:37:21.943910 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:37:21.943776    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-maas-api-tls podName:4b6c3c06-6236-4c34-b6ad-466dbf581cfb nodeName:}" failed. No retries permitted until 2026-09-10 21:37:22.44375431 +0000 UTC m=+1092.646084869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-maas-api-tls") pod "maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62" (UID: "4b6c3c06-6236-4c34-b6ad-466dbf581cfb") : secret "maas-api-e2e-shared-b-w3-67d5e2-serving-cert" not found
Sep 10 21:37:21.944056 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.944038    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:21.945869 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.945850    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:21.951896 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:21.951869    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8vj6\" (UniqueName: \"kubernetes.io/projected/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-kube-api-access-m8vj6\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:22.449031 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:22.448999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:22.451648 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:22.451621    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:22.649518 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:22.649486    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:22.928644 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:22.928618    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"]
Sep 10 21:37:22.930183 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:37:22.930156    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6c3c06_6236_4c34_b6ad_466dbf581cfb.slice/crio-cf2a6298ca7b55c13de5d146343f810b8123c9f15e58fcae1b5706b68688ba17 WatchSource:0}: Error finding container cf2a6298ca7b55c13de5d146343f810b8123c9f15e58fcae1b5706b68688ba17: Status 404 returned error can't find the container with id cf2a6298ca7b55c13de5d146343f810b8123c9f15e58fcae1b5706b68688ba17
Sep 10 21:37:23.841515 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:23.841476    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62" event={"ID":"4b6c3c06-6236-4c34-b6ad-466dbf581cfb","Type":"ContainerStarted","Data":"51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb"}
Sep 10 21:37:23.841679 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:23.841537    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62" event={"ID":"4b6c3c06-6236-4c34-b6ad-466dbf581cfb","Type":"ContainerStarted","Data":"cf2a6298ca7b55c13de5d146343f810b8123c9f15e58fcae1b5706b68688ba17"}
Sep 10 21:37:23.841679 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:23.841578    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:23.860002 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:23.859944    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62" podStartSLOduration=2.468351257 podStartE2EDuration="2.859930255s" totalImagesPullingTime="391.578998ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:37:23.857987224 +0000 UTC m=+1094.060317797" watchObservedRunningTime="2026-09-10 21:37:23.859930255 +0000 UTC m=+1094.062260826"
Sep 10 21:37:27.603428 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.603390    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"]
Sep 10 21:37:27.607894 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.607873    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:27.610370 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.610345    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-4b45c2-serving-cert\""
Sep 10 21:37:27.618295 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.618274    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"]
Sep 10 21:37:27.698849 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.698819    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:27.698977 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.698857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzx9b\" (UniqueName: \"kubernetes.io/projected/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-kube-api-access-bzx9b\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:27.698977 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.698944    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:27.699050 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.698995    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:27.799770 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.799736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:27.799941 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.799789    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:27.799941 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.799823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:27.799941 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.799848    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzx9b\" (UniqueName: \"kubernetes.io/projected/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-kube-api-access-bzx9b\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:27.800121 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:37:27.799957    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-serving-cert: secret "maas-api-e2e-shared-a-w2-4b45c2-serving-cert" not found
Sep 10 21:37:27.800121 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:37:27.800025    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-maas-api-tls podName:85ab73c6-8a5d-4d1b-9c22-8adab98e1272 nodeName:}" failed. No retries permitted until 2026-09-10 21:37:28.30000688 +0000 UTC m=+1098.502337431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-maas-api-tls") pod "maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88" (UID: "85ab73c6-8a5d-4d1b-9c22-8adab98e1272") : secret "maas-api-e2e-shared-a-w2-4b45c2-serving-cert" not found
Sep 10 21:37:27.800558 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.800539    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:27.802282 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.802260    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:27.809943 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:27.809915    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzx9b\" (UniqueName: \"kubernetes.io/projected/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-kube-api-access-bzx9b\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:28.305267 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:28.305231    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:28.307643 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:28.307623    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:28.521223 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:28.521170    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:28.802136 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:28.802107    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"]
Sep 10 21:37:28.803518 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:37:28.803493    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ab73c6_8a5d_4d1b_9c22_8adab98e1272.slice/crio-169ab2e213b113043ae6ab4478e235ac99169a52cdf319372fa6fcb13d3cdbc2 WatchSource:0}: Error finding container 169ab2e213b113043ae6ab4478e235ac99169a52cdf319372fa6fcb13d3cdbc2: Status 404 returned error can't find the container with id 169ab2e213b113043ae6ab4478e235ac99169a52cdf319372fa6fcb13d3cdbc2
Sep 10 21:37:28.875321 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:28.875254    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88" event={"ID":"85ab73c6-8a5d-4d1b-9c22-8adab98e1272","Type":"ContainerStarted","Data":"169ab2e213b113043ae6ab4478e235ac99169a52cdf319372fa6fcb13d3cdbc2"}
Sep 10 21:37:29.854349 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:29.854308    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:37:29.884668 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:29.884631    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88" event={"ID":"85ab73c6-8a5d-4d1b-9c22-8adab98e1272","Type":"ContainerStarted","Data":"683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8"}
Sep 10 21:37:29.884865 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:29.884692    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:29.902770 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:29.902715    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88" podStartSLOduration=2.3752760889999998 podStartE2EDuration="2.902694851s" totalImagesPullingTime="527.418762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:37:29.902224619 +0000 UTC m=+1100.104555190" watchObservedRunningTime="2026-09-10 21:37:29.902694851 +0000 UTC m=+1100.105025424"
Sep 10 21:37:35.897042 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:35.897013    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:37:56.076268 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.076230    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"]
Sep 10 21:37:56.081112 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.081085    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.084514 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.084491    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-b4c9bb-serving-cert\""
Sep 10 21:37:56.091156 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.091123    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"]
Sep 10 21:37:56.163691 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.163662    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6z58\" (UniqueName: \"kubernetes.io/projected/202ba49a-a413-4ff2-b381-1d5d8bdd124b-kube-api-access-x6z58\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.163834 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.163696    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.163834 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.163724    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.163834 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.163791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/202ba49a-a413-4ff2-b381-1d5d8bdd124b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.264344 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.264310    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6z58\" (UniqueName: \"kubernetes.io/projected/202ba49a-a413-4ff2-b381-1d5d8bdd124b-kube-api-access-x6z58\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.264537 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.264355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.264537 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.264381    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.264537 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:37:56.264511    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-serving-cert: secret "maas-api-e2e-shared-b-w2-b4c9bb-serving-cert" not found
Sep 10 21:37:56.264716 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:37:56.264611    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-maas-api-tls podName:202ba49a-a413-4ff2-b381-1d5d8bdd124b nodeName:}" failed. No retries permitted until 2026-09-10 21:37:56.764586446 +0000 UTC m=+1126.966917019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-maas-api-tls") pod "maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l" (UID: "202ba49a-a413-4ff2-b381-1d5d8bdd124b") : secret "maas-api-e2e-shared-b-w2-b4c9bb-serving-cert" not found
Sep 10 21:37:56.264716 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.264659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/202ba49a-a413-4ff2-b381-1d5d8bdd124b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.265305 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.265274    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/202ba49a-a413-4ff2-b381-1d5d8bdd124b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.266843 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.266823    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.281608 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.281585    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6z58\" (UniqueName: \"kubernetes.io/projected/202ba49a-a413-4ff2-b381-1d5d8bdd124b-kube-api-access-x6z58\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.768299 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.768263    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.770667 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.770632    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:56.993324 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:56.993286    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:57.274617 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:57.274592    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"]
Sep 10 21:37:57.276721 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:37:57.276683    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202ba49a_a413_4ff2_b381_1d5d8bdd124b.slice/crio-ed7401b95c1edbacea23ca0236b01fcd4a64d5aed5f5c290a9b747ff5840051d WatchSource:0}: Error finding container ed7401b95c1edbacea23ca0236b01fcd4a64d5aed5f5c290a9b747ff5840051d: Status 404 returned error can't find the container with id ed7401b95c1edbacea23ca0236b01fcd4a64d5aed5f5c290a9b747ff5840051d
Sep 10 21:37:58.069799 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:58.069765    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l" event={"ID":"202ba49a-a413-4ff2-b381-1d5d8bdd124b","Type":"ContainerStarted","Data":"6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc"}
Sep 10 21:37:58.069959 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:58.069830    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:37:58.069959 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:58.069853    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l" event={"ID":"202ba49a-a413-4ff2-b381-1d5d8bdd124b","Type":"ContainerStarted","Data":"ed7401b95c1edbacea23ca0236b01fcd4a64d5aed5f5c290a9b747ff5840051d"}
Sep 10 21:37:58.093839 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:37:58.093790    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l" podStartSLOduration=1.691097334 podStartE2EDuration="2.093775098s" totalImagesPullingTime="402.677764ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:37:58.092415752 +0000 UTC m=+1128.294746323" watchObservedRunningTime="2026-09-10 21:37:58.093775098 +0000 UTC m=+1128.296105673"
Sep 10 21:38:04.081523 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:04.081495    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:38:20.680185 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:20.680150    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-8ed82d"]
Sep 10 21:38:20.683941 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:20.683916    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-8ed82d"
Sep 10 21:38:20.686927 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:20.686884    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zd54x\""
Sep 10 21:38:20.689352 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:20.689327    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-8ed82d"]
Sep 10 21:38:20.781774 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:20.781747    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8gvq\" (UniqueName: \"kubernetes.io/projected/8035ca0d-dc78-4282-911a-9a188b9d7c2b-kube-api-access-f8gvq\") pod \"test-curl-7552-8ed82d\" (UID: \"8035ca0d-dc78-4282-911a-9a188b9d7c2b\") " pod="opendatahub/test-curl-7552-8ed82d"
Sep 10 21:38:20.882851 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:20.882816    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8gvq\" (UniqueName: \"kubernetes.io/projected/8035ca0d-dc78-4282-911a-9a188b9d7c2b-kube-api-access-f8gvq\") pod \"test-curl-7552-8ed82d\" (UID: \"8035ca0d-dc78-4282-911a-9a188b9d7c2b\") " pod="opendatahub/test-curl-7552-8ed82d"
Sep 10 21:38:20.891077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:20.891044    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8gvq\" (UniqueName: \"kubernetes.io/projected/8035ca0d-dc78-4282-911a-9a188b9d7c2b-kube-api-access-f8gvq\") pod \"test-curl-7552-8ed82d\" (UID: \"8035ca0d-dc78-4282-911a-9a188b9d7c2b\") " pod="opendatahub/test-curl-7552-8ed82d"
Sep 10 21:38:20.996175 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:20.996112    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-8ed82d"
Sep 10 21:38:21.269296 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:21.269268    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-8ed82d"]
Sep 10 21:38:21.270890 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:38:21.270862    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8035ca0d_dc78_4282_911a_9a188b9d7c2b.slice/crio-b0cafb7bda8e5380bb78ebde1eea6bf120afa82fba971e137c5b32ee36a22d0b WatchSource:0}: Error finding container b0cafb7bda8e5380bb78ebde1eea6bf120afa82fba971e137c5b32ee36a22d0b: Status 404 returned error can't find the container with id b0cafb7bda8e5380bb78ebde1eea6bf120afa82fba971e137c5b32ee36a22d0b
Sep 10 21:38:22.234270 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:22.234236    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-8ed82d" event={"ID":"8035ca0d-dc78-4282-911a-9a188b9d7c2b","Type":"ContainerStarted","Data":"b0cafb7bda8e5380bb78ebde1eea6bf120afa82fba971e137c5b32ee36a22d0b"}
Sep 10 21:38:24.248369 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:24.248332    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-8ed82d" event={"ID":"8035ca0d-dc78-4282-911a-9a188b9d7c2b","Type":"ContainerStarted","Data":"5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf"}
Sep 10 21:38:24.264116 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:24.264071    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7552-8ed82d" podStartSLOduration=2.113958937 podStartE2EDuration="4.264057492s" totalImagesPullingTime="2.150098555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:38:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:38:24.261732964 +0000 UTC m=+1154.464063537" watchObservedRunningTime="2026-09-10 21:38:24.264057492 +0000 UTC m=+1154.466388063"
Sep 10 21:38:24.874013 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:24.873979    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-8ed82d"]
Sep 10 21:38:24.878713 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:24.878680    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-8ed82d"]
Sep 10 21:38:24.993320 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:24.993235    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-514b3f"]
Sep 10 21:38:24.993763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:24.993749    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8035ca0d-dc78-4282-911a-9a188b9d7c2b" containerName="test-curl-7552-8ed82d"
Sep 10 21:38:24.993815 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:24.993764    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8035ca0d-dc78-4282-911a-9a188b9d7c2b" containerName="test-curl-7552-8ed82d"
Sep 10 21:38:24.993859 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:24.993835    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8035ca0d-dc78-4282-911a-9a188b9d7c2b" containerName="test-curl-7552-8ed82d"
Sep 10 21:38:24.997279 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:24.997263    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-514b3f"
Sep 10 21:38:25.002767 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:25.002740    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-514b3f"]
Sep 10 21:38:25.122927 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:25.122899    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flvhf\" (UniqueName: \"kubernetes.io/projected/1eb7a48d-8c77-4bcc-8131-5dfab4f6df85-kube-api-access-flvhf\") pod \"test-curl-7552-514b3f\" (UID: \"1eb7a48d-8c77-4bcc-8131-5dfab4f6df85\") " pod="opendatahub/test-curl-7552-514b3f"
Sep 10 21:38:25.223815 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:25.223791    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flvhf\" (UniqueName: \"kubernetes.io/projected/1eb7a48d-8c77-4bcc-8131-5dfab4f6df85-kube-api-access-flvhf\") pod \"test-curl-7552-514b3f\" (UID: \"1eb7a48d-8c77-4bcc-8131-5dfab4f6df85\") " pod="opendatahub/test-curl-7552-514b3f"
Sep 10 21:38:25.231411 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:25.231387    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flvhf\" (UniqueName: \"kubernetes.io/projected/1eb7a48d-8c77-4bcc-8131-5dfab4f6df85-kube-api-access-flvhf\") pod \"test-curl-7552-514b3f\" (UID: \"1eb7a48d-8c77-4bcc-8131-5dfab4f6df85\") " pod="opendatahub/test-curl-7552-514b3f"
Sep 10 21:38:25.255184 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:25.255122    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7552-8ed82d" container="test-curl-7552-8ed82d"
Sep 10 21:38:25.309264 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:25.309234    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-514b3f"
Sep 10 21:38:25.581453 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:25.581426    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-514b3f"]
Sep 10 21:38:25.582011 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:38:25.581987    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1eb7a48d_8c77_4bcc_8131_5dfab4f6df85.slice/crio-e808f217955c0163fba733cbd520e3d543c6b07a8587fd207d20c7fb0a444464 WatchSource:0}: Error finding container e808f217955c0163fba733cbd520e3d543c6b07a8587fd207d20c7fb0a444464: Status 404 returned error can't find the container with id e808f217955c0163fba733cbd520e3d543c6b07a8587fd207d20c7fb0a444464
Sep 10 21:38:26.262677 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.262634    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-514b3f" event={"ID":"1eb7a48d-8c77-4bcc-8131-5dfab4f6df85","Type":"ContainerStarted","Data":"06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441"}
Sep 10 21:38:26.262677 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.262684    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-514b3f" event={"ID":"1eb7a48d-8c77-4bcc-8131-5dfab4f6df85","Type":"ContainerStarted","Data":"e808f217955c0163fba733cbd520e3d543c6b07a8587fd207d20c7fb0a444464"}
Sep 10 21:38:26.263165 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.262719    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7552-8ed82d" podUID="8035ca0d-dc78-4282-911a-9a188b9d7c2b" containerName="test-curl-7552-8ed82d" containerID="cri-o://5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf" gracePeriod=2
Sep 10 21:38:26.282498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.282453    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7552-514b3f" podStartSLOduration=2.28243904 podStartE2EDuration="2.28243904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:38:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:38:26.280478203 +0000 UTC m=+1156.482808776" watchObservedRunningTime="2026-09-10 21:38:26.28243904 +0000 UTC m=+1156.484769643"
Sep 10 21:38:26.870511 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.870455    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-514b3f"]
Sep 10 21:38:26.873592 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.873565    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-514b3f"]
Sep 10 21:38:26.987324 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.987249    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-91f082"]
Sep 10 21:38:26.987856 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.987836    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb7a48d-8c77-4bcc-8131-5dfab4f6df85" containerName="test-curl-7552-514b3f"
Sep 10 21:38:26.987957 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.987859    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb7a48d-8c77-4bcc-8131-5dfab4f6df85" containerName="test-curl-7552-514b3f"
Sep 10 21:38:26.988013 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.987993    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eb7a48d-8c77-4bcc-8131-5dfab4f6df85" containerName="test-curl-7552-514b3f"
Sep 10 21:38:26.990884 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.990855    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-91f082"
Sep 10 21:38:26.995027 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:26.995001    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-91f082"]
Sep 10 21:38:27.142178 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:27.142149    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkdsc\" (UniqueName: \"kubernetes.io/projected/f0c7fe4a-20a0-418e-9195-2d12d4caac00-kube-api-access-zkdsc\") pod \"test-curl-7552-91f082\" (UID: \"f0c7fe4a-20a0-418e-9195-2d12d4caac00\") " pod="opendatahub/test-curl-7552-91f082"
Sep 10 21:38:27.242777 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:27.242716    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkdsc\" (UniqueName: \"kubernetes.io/projected/f0c7fe4a-20a0-418e-9195-2d12d4caac00-kube-api-access-zkdsc\") pod \"test-curl-7552-91f082\" (UID: \"f0c7fe4a-20a0-418e-9195-2d12d4caac00\") " pod="opendatahub/test-curl-7552-91f082"
Sep 10 21:38:27.250736 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:27.250711    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkdsc\" (UniqueName: \"kubernetes.io/projected/f0c7fe4a-20a0-418e-9195-2d12d4caac00-kube-api-access-zkdsc\") pod \"test-curl-7552-91f082\" (UID: \"f0c7fe4a-20a0-418e-9195-2d12d4caac00\") " pod="opendatahub/test-curl-7552-91f082"
Sep 10 21:38:27.269176 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:27.269155    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7552-514b3f" container="test-curl-7552-514b3f"
Sep 10 21:38:27.302268 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:27.302246    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-91f082"
Sep 10 21:38:27.573938 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:27.573910    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-91f082"]
Sep 10 21:38:27.575444 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:38:27.575418    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0c7fe4a_20a0_418e_9195_2d12d4caac00.slice/crio-029b307bed14bc261ca0c06ecb4ca7439a75ebd0bccf4c4feb0a90e162750de9 WatchSource:0}: Error finding container 029b307bed14bc261ca0c06ecb4ca7439a75ebd0bccf4c4feb0a90e162750de9: Status 404 returned error can't find the container with id 029b307bed14bc261ca0c06ecb4ca7439a75ebd0bccf4c4feb0a90e162750de9
Sep 10 21:38:28.277846 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:28.277818    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-91f082" event={"ID":"f0c7fe4a-20a0-418e-9195-2d12d4caac00","Type":"ContainerStarted","Data":"9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852"}
Sep 10 21:38:28.278270 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:28.277861    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-91f082" event={"ID":"f0c7fe4a-20a0-418e-9195-2d12d4caac00","Type":"ContainerStarted","Data":"029b307bed14bc261ca0c06ecb4ca7439a75ebd0bccf4c4feb0a90e162750de9"}
Sep 10 21:38:28.278270 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:28.277913    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7552-514b3f" podUID="1eb7a48d-8c77-4bcc-8131-5dfab4f6df85" containerName="test-curl-7552-514b3f" containerID="cri-o://06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441" gracePeriod=2
Sep 10 21:38:28.294213 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:28.294159    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7552-91f082" podStartSLOduration=2.294146139 podStartE2EDuration="2.294146139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:38:28.29142472 +0000 UTC m=+1158.493755292" watchObservedRunningTime="2026-09-10 21:38:28.294146139 +0000 UTC m=+1158.496476710"
Sep 10 21:38:28.447039 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:28.447012    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-8ed82d"
Sep 10 21:38:28.556441 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:28.556418    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8gvq\" (UniqueName: \"kubernetes.io/projected/8035ca0d-dc78-4282-911a-9a188b9d7c2b-kube-api-access-f8gvq\") pod \"8035ca0d-dc78-4282-911a-9a188b9d7c2b\" (UID: \"8035ca0d-dc78-4282-911a-9a188b9d7c2b\") "
Sep 10 21:38:28.558336 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:28.558305    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8035ca0d-dc78-4282-911a-9a188b9d7c2b-kube-api-access-f8gvq" (OuterVolumeSpecName: "kube-api-access-f8gvq") pod "8035ca0d-dc78-4282-911a-9a188b9d7c2b" (UID: "8035ca0d-dc78-4282-911a-9a188b9d7c2b"). InnerVolumeSpecName "kube-api-access-f8gvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:38:28.664588 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:28.658530    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8gvq\" (UniqueName: \"kubernetes.io/projected/8035ca0d-dc78-4282-911a-9a188b9d7c2b-kube-api-access-f8gvq\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:38:28.889661 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:28.889582    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-91f082"]
Sep 10 21:38:28.896962 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:28.896933    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-91f082"]
Sep 10 21:38:29.009394 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.009363    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-55c86f"]
Sep 10 21:38:29.009837 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.009823    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c7fe4a-20a0-418e-9195-2d12d4caac00" containerName="test-curl-7552-91f082"
Sep 10 21:38:29.009889 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.009839    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c7fe4a-20a0-418e-9195-2d12d4caac00" containerName="test-curl-7552-91f082"
Sep 10 21:38:29.009947 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.009938    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0c7fe4a-20a0-418e-9195-2d12d4caac00" containerName="test-curl-7552-91f082"
Sep 10 21:38:29.013298 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.013282    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-55c86f"
Sep 10 21:38:29.018021 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.017994    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-55c86f"]
Sep 10 21:38:29.164195 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.164128    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5kc\" (UniqueName: \"kubernetes.io/projected/a3c53e33-f207-4027-a966-d5536412b652-kube-api-access-qm5kc\") pod \"test-curl-7552-55c86f\" (UID: \"a3c53e33-f207-4027-a966-d5536412b652\") " pod="opendatahub/test-curl-7552-55c86f"
Sep 10 21:38:29.265223 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.265182    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5kc\" (UniqueName: \"kubernetes.io/projected/a3c53e33-f207-4027-a966-d5536412b652-kube-api-access-qm5kc\") pod \"test-curl-7552-55c86f\" (UID: \"a3c53e33-f207-4027-a966-d5536412b652\") " pod="opendatahub/test-curl-7552-55c86f"
Sep 10 21:38:29.278101 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.278079    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5kc\" (UniqueName: \"kubernetes.io/projected/a3c53e33-f207-4027-a966-d5536412b652-kube-api-access-qm5kc\") pod \"test-curl-7552-55c86f\" (UID: \"a3c53e33-f207-4027-a966-d5536412b652\") " pod="opendatahub/test-curl-7552-55c86f"
Sep 10 21:38:29.286416 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.286389    2568 generic.go:356] "Generic (PLEG): container finished" podID="8035ca0d-dc78-4282-911a-9a188b9d7c2b" containerID="5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf" exitCode=137
Sep 10 21:38:29.286537 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.286440    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-8ed82d"
Sep 10 21:38:29.286537 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.286489    2568 scope.go:117] "RemoveContainer" containerID="5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf"
Sep 10 21:38:29.286825 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:29.286807    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7552-91f082" container="test-curl-7552-91f082"
Sep 10 21:38:29.296589 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.296570    2568 scope.go:117] "RemoveContainer" containerID="5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf"
Sep 10 21:38:29.296841 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:29.296824    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf\": container with ID starting with 5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf not found: ID does not exist" containerID="5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf"
Sep 10 21:38:29.296935 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.296847    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf"} err="failed to get container status \"5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf\": rpc error: code = NotFound desc = could not find container \"5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf\": container with ID starting with 5b17d7208c5daba82a4d74b27283b956be0ea3c8a0f9c6aef241c0b8b14628bf not found: ID does not exist"
Sep 10 21:38:29.297913 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:29.297889    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7552-8ed82d\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="8035ca0d-dc78-4282-911a-9a188b9d7c2b" pod="opendatahub/test-curl-7552-8ed82d"
Sep 10 21:38:29.324026 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.323995    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-55c86f"
Sep 10 21:38:29.595094 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:29.595069    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-55c86f"]
Sep 10 21:38:29.596024 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:38:29.596004    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3c53e33_f207_4027_a966_d5536412b652.slice/crio-b6859354523afe8df267d6d4f6d2d753f26347bd7e97752b4b4d62c8d5584266 WatchSource:0}: Error finding container b6859354523afe8df267d6d4f6d2d753f26347bd7e97752b4b4d62c8d5584266: Status 404 returned error can't find the container with id b6859354523afe8df267d6d4f6d2d753f26347bd7e97752b4b4d62c8d5584266
Sep 10 21:38:30.194931 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:30.194897    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7552-8ed82d\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="8035ca0d-dc78-4282-911a-9a188b9d7c2b" pod="opendatahub/test-curl-7552-8ed82d"
Sep 10 21:38:30.196990 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:30.196966    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8035ca0d-dc78-4282-911a-9a188b9d7c2b" path="/var/lib/kubelet/pods/8035ca0d-dc78-4282-911a-9a188b9d7c2b/volumes"
Sep 10 21:38:30.295555 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:30.295528    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-55c86f" event={"ID":"a3c53e33-f207-4027-a966-d5536412b652","Type":"ContainerStarted","Data":"006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34"}
Sep 10 21:38:30.295880 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:30.295570    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-55c86f" event={"ID":"a3c53e33-f207-4027-a966-d5536412b652","Type":"ContainerStarted","Data":"b6859354523afe8df267d6d4f6d2d753f26347bd7e97752b4b4d62c8d5584266"}
Sep 10 21:38:30.296650 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:30.296625    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7552-91f082" podUID="f0c7fe4a-20a0-418e-9195-2d12d4caac00" containerName="test-curl-7552-91f082" containerID="cri-o://9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852" gracePeriod=2
Sep 10 21:38:30.311633 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:30.311593    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7552-55c86f" podStartSLOduration=2.3115791 podStartE2EDuration="2.3115791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:38:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:38:30.308164089 +0000 UTC m=+1160.510494673" watchObservedRunningTime="2026-09-10 21:38:30.3115791 +0000 UTC m=+1160.513909671"
Sep 10 21:38:30.464772 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:30.464750    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-514b3f"
Sep 10 21:38:30.579272 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:30.579245    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flvhf\" (UniqueName: \"kubernetes.io/projected/1eb7a48d-8c77-4bcc-8131-5dfab4f6df85-kube-api-access-flvhf\") pod \"1eb7a48d-8c77-4bcc-8131-5dfab4f6df85\" (UID: \"1eb7a48d-8c77-4bcc-8131-5dfab4f6df85\") "
Sep 10 21:38:30.581176 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:30.581155    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb7a48d-8c77-4bcc-8131-5dfab4f6df85-kube-api-access-flvhf" (OuterVolumeSpecName: "kube-api-access-flvhf") pod "1eb7a48d-8c77-4bcc-8131-5dfab4f6df85" (UID: "1eb7a48d-8c77-4bcc-8131-5dfab4f6df85"). InnerVolumeSpecName "kube-api-access-flvhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:38:30.680561 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:30.680533    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flvhf\" (UniqueName: \"kubernetes.io/projected/1eb7a48d-8c77-4bcc-8131-5dfab4f6df85-kube-api-access-flvhf\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:38:30.894526 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:30.894492    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-55c86f"]
Sep 10 21:38:30.897494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:30.897469    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-55c86f"]
Sep 10 21:38:31.304424 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:31.304400    2568 generic.go:356] "Generic (PLEG): container finished" podID="1eb7a48d-8c77-4bcc-8131-5dfab4f6df85" containerID="06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441" exitCode=137
Sep 10 21:38:31.304866 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:31.304437    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-514b3f"
Sep 10 21:38:31.304866 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:31.304510    2568 scope.go:117] "RemoveContainer" containerID="06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441"
Sep 10 21:38:31.304866 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:31.304687    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7552-55c86f" container="test-curl-7552-55c86f"
Sep 10 21:38:31.314668 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:31.314574    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7552-514b3f\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="1eb7a48d-8c77-4bcc-8131-5dfab4f6df85" pod="opendatahub/test-curl-7552-514b3f"
Sep 10 21:38:31.314758 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:31.314668    2568 scope.go:117] "RemoveContainer" containerID="06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441"
Sep 10 21:38:31.314951 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:31.314934    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441\": container with ID starting with 06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441 not found: ID does not exist" containerID="06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441"
Sep 10 21:38:31.314996 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:31.314960    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441"} err="failed to get container status \"06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441\": rpc error: code = NotFound desc = could not find container \"06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441\": container with ID starting with 06139bf9ba44df434c3b94daf0f77e9b481f62ae45717ef6ac71b5ef8902f441 not found: ID does not exist"
Sep 10 21:38:32.197521 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:32.197485    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eb7a48d-8c77-4bcc-8131-5dfab4f6df85" path="/var/lib/kubelet/pods/1eb7a48d-8c77-4bcc-8131-5dfab4f6df85/volumes"
Sep 10 21:38:32.312569 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:32.312532    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7552-55c86f" podUID="a3c53e33-f207-4027-a966-d5536412b652" containerName="test-curl-7552-55c86f" containerID="cri-o://006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34" gracePeriod=2
Sep 10 21:38:32.471530 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:32.471508    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-91f082"
Sep 10 21:38:32.602840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:32.602816    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkdsc\" (UniqueName: \"kubernetes.io/projected/f0c7fe4a-20a0-418e-9195-2d12d4caac00-kube-api-access-zkdsc\") pod \"f0c7fe4a-20a0-418e-9195-2d12d4caac00\" (UID: \"f0c7fe4a-20a0-418e-9195-2d12d4caac00\") "
Sep 10 21:38:32.604859 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:32.604833    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0c7fe4a-20a0-418e-9195-2d12d4caac00-kube-api-access-zkdsc" (OuterVolumeSpecName: "kube-api-access-zkdsc") pod "f0c7fe4a-20a0-418e-9195-2d12d4caac00" (UID: "f0c7fe4a-20a0-418e-9195-2d12d4caac00"). InnerVolumeSpecName "kube-api-access-zkdsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:38:32.704044 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:32.703973    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkdsc\" (UniqueName: \"kubernetes.io/projected/f0c7fe4a-20a0-418e-9195-2d12d4caac00-kube-api-access-zkdsc\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:38:33.319939 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:33.319905    2568 generic.go:356] "Generic (PLEG): container finished" podID="f0c7fe4a-20a0-418e-9195-2d12d4caac00" containerID="9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852" exitCode=137
Sep 10 21:38:33.320367 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:33.319952    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-91f082"
Sep 10 21:38:33.320367 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:33.320002    2568 scope.go:117] "RemoveContainer" containerID="9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852"
Sep 10 21:38:33.329950 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:33.329936    2568 scope.go:117] "RemoveContainer" containerID="9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852"
Sep 10 21:38:33.330068 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:33.330044    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7552-91f082\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="f0c7fe4a-20a0-418e-9195-2d12d4caac00" pod="opendatahub/test-curl-7552-91f082"
Sep 10 21:38:33.330278 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:33.330257    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852\": container with ID starting with 9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852 not found: ID does not exist" containerID="9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852"
Sep 10 21:38:33.330332 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:33.330292    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852"} err="failed to get container status \"9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852\": rpc error: code = NotFound desc = could not find container \"9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852\": container with ID starting with 9ebdc3d8f8096f84d4166539d87e18be90135196c7e50580d99cc0c6ebb4b852 not found: ID does not exist"
Sep 10 21:38:34.197138 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:34.197103    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0c7fe4a-20a0-418e-9195-2d12d4caac00" path="/var/lib/kubelet/pods/f0c7fe4a-20a0-418e-9195-2d12d4caac00/volumes"
Sep 10 21:38:34.462816 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:34.462754    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-55c86f"
Sep 10 21:38:34.620477 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:34.620446    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm5kc\" (UniqueName: \"kubernetes.io/projected/a3c53e33-f207-4027-a966-d5536412b652-kube-api-access-qm5kc\") pod \"a3c53e33-f207-4027-a966-d5536412b652\" (UID: \"a3c53e33-f207-4027-a966-d5536412b652\") "
Sep 10 21:38:34.622502 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:34.622471    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3c53e33-f207-4027-a966-d5536412b652-kube-api-access-qm5kc" (OuterVolumeSpecName: "kube-api-access-qm5kc") pod "a3c53e33-f207-4027-a966-d5536412b652" (UID: "a3c53e33-f207-4027-a966-d5536412b652"). InnerVolumeSpecName "kube-api-access-qm5kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:38:34.721420 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:34.721350    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm5kc\" (UniqueName: \"kubernetes.io/projected/a3c53e33-f207-4027-a966-d5536412b652-kube-api-access-qm5kc\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:38:35.335224 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.335170    2568 generic.go:356] "Generic (PLEG): container finished" podID="a3c53e33-f207-4027-a966-d5536412b652" containerID="006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34" exitCode=137
Sep 10 21:38:35.335488 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.335232    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-55c86f"
Sep 10 21:38:35.335488 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.335270    2568 scope.go:117] "RemoveContainer" containerID="006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34"
Sep 10 21:38:35.345368 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.345348    2568 scope.go:117] "RemoveContainer" containerID="006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34"
Sep 10 21:38:35.345634 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:35.345615    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34\": container with ID starting with 006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34 not found: ID does not exist" containerID="006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34"
Sep 10 21:38:35.345702 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.345645    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34"} err="failed to get container status \"006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34\": rpc error: code = NotFound desc = could not find container \"006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34\": container with ID starting with 006c63c5fe662ff162c55a7268be755a3e8b0ef80233de49643bfaf6edd23b34 not found: ID does not exist"
Sep 10 21:38:35.346586 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:35.346564    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7552-55c86f\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="a3c53e33-f207-4027-a966-d5536412b652" pod="opendatahub/test-curl-7552-55c86f"
Sep 10 21:38:35.920099 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.920067    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"]
Sep 10 21:38:35.920618 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.920602    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3c53e33-f207-4027-a966-d5536412b652" containerName="test-curl-7552-55c86f"
Sep 10 21:38:35.920669 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.920621    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3c53e33-f207-4027-a966-d5536412b652" containerName="test-curl-7552-55c86f"
Sep 10 21:38:35.920731 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.920705    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3c53e33-f207-4027-a966-d5536412b652" containerName="test-curl-7552-55c86f"
Sep 10 21:38:35.925239 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.925189    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:35.927730 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.927708    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8c245620-serving-cert\""
Sep 10 21:38:35.930801 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.930701    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7v94\" (UniqueName: \"kubernetes.io/projected/1a7ef083-f485-451c-975e-29a135a022b2-kube-api-access-m7v94\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:35.930801 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.930762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-maas-api-tls\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:35.930990 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.930822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-metrics-certs\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:35.930990 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.930923    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7ef083-f485-451c-975e-29a135a022b2-openshift-service-ca\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:35.934514 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:35.934493    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"]
Sep 10 21:38:35.944480 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:38:35.944450    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7552-55c86f\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="a3c53e33-f207-4027-a966-d5536412b652" pod="opendatahub/test-curl-7552-55c86f"
Sep 10 21:38:36.032071 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:36.032038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7ef083-f485-451c-975e-29a135a022b2-openshift-service-ca\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:36.032071 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:36.032075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7v94\" (UniqueName: \"kubernetes.io/projected/1a7ef083-f485-451c-975e-29a135a022b2-kube-api-access-m7v94\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:36.032300 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:36.032108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-maas-api-tls\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:36.032300 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:36.032156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-metrics-certs\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:36.032767 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:36.032739    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7ef083-f485-451c-975e-29a135a022b2-openshift-service-ca\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:36.034609 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:36.034585    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-maas-api-tls\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:36.034813 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:36.034796    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-metrics-certs\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:36.040499 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:36.040478    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7v94\" (UniqueName: \"kubernetes.io/projected/1a7ef083-f485-451c-975e-29a135a022b2-kube-api-access-m7v94\") pod \"maas-api-e2e-mt-8c245620-648b8b8c9-kwch4\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:36.198213 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:36.198125    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3c53e33-f207-4027-a966-d5536412b652" path="/var/lib/kubelet/pods/a3c53e33-f207-4027-a966-d5536412b652/volumes"
Sep 10 21:38:36.237734 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:36.237711    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:36.524371 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:36.524343    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"]
Sep 10 21:38:36.525182 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:38:36.525160    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7ef083_f485_451c_975e_29a135a022b2.slice/crio-dc54e7633fde97ac1a0b067c23eb704785ff873e808175c3e0c76321272b661e WatchSource:0}: Error finding container dc54e7633fde97ac1a0b067c23eb704785ff873e808175c3e0c76321272b661e: Status 404 returned error can't find the container with id dc54e7633fde97ac1a0b067c23eb704785ff873e808175c3e0c76321272b661e
Sep 10 21:38:37.352108 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:37.352072    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4" event={"ID":"1a7ef083-f485-451c-975e-29a135a022b2","Type":"ContainerStarted","Data":"62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e"}
Sep 10 21:38:37.352634 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:37.352133    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4" event={"ID":"1a7ef083-f485-451c-975e-29a135a022b2","Type":"ContainerStarted","Data":"dc54e7633fde97ac1a0b067c23eb704785ff873e808175c3e0c76321272b661e"}
Sep 10 21:38:37.352634 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:37.352302    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:38:37.370059 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:37.369993    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4" podStartSLOduration=1.906514973 podStartE2EDuration="2.369973717s" totalImagesPullingTime="463.458744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:38:37.367949328 +0000 UTC m=+1167.570279892" watchObservedRunningTime="2026-09-10 21:38:37.369973717 +0000 UTC m=+1167.572304289"
Sep 10 21:38:43.365045 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:38:43.365016    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:39:10.282278 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:10.282252    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:39:10.284769 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:10.282903    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:39:18.021351 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.021316    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"]
Sep 10 21:39:18.026512 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.026493    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.029732 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.029706    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8c245620\"/\"openshift-service-ca.crt\""
Sep 10 21:39:18.029865 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.029710    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8c245620\"/\"kube-root-ca.crt\""
Sep 10 21:39:18.029865 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.029790    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8c245620\"/\"e2e-lifecycle-model-8c245620-kserve-self-signed-certs\""
Sep 10 21:39:18.029865 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.029792    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8c245620\"/\"default-dockercfg-xrn68\""
Sep 10 21:39:18.034669 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.034620    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"]
Sep 10 21:39:18.101342 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.101314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-dshm\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.101462 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.101345    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tls-certs\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.101462 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.101369    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-home\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.101544 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.101475    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tmp-dir\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.101544 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.101518    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc4jt\" (UniqueName: \"kubernetes.io/projected/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-kube-api-access-hc4jt\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.101614 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.101577    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-model-cache\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.204240 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.204184    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-dshm\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.204404 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.204248    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tls-certs\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.204404 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.204283    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-home\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.204529 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.204460    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tmp-dir\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.204593 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.204522    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc4jt\" (UniqueName: \"kubernetes.io/projected/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-kube-api-access-hc4jt\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.204593 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.204579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-model-cache\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.204702 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.204664    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-home\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.204850 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.204826    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tmp-dir\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.205026 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.204900    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-model-cache\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.206484 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.206460    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-dshm\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.207127 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.207106    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tls-certs\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.212978 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.212956    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc4jt\" (UniqueName: \"kubernetes.io/projected/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-kube-api-access-hc4jt\") pod \"e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") " pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.336859 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.336818    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:18.615926 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:18.615897    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"]
Sep 10 21:39:18.616549 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:39:18.616524    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbe5325f_2f23_4ad9_8771_a6e3efae6df9.slice/crio-21ca19a0d3cbd358488914b203cd1fa210f26aa3fc6d2430e85f0148bcaed011 WatchSource:0}: Error finding container 21ca19a0d3cbd358488914b203cd1fa210f26aa3fc6d2430e85f0148bcaed011: Status 404 returned error can't find the container with id 21ca19a0d3cbd358488914b203cd1fa210f26aa3fc6d2430e85f0148bcaed011
Sep 10 21:39:19.629097 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:19.629067    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv" event={"ID":"bbe5325f-2f23-4ad9-8771-a6e3efae6df9","Type":"ContainerStarted","Data":"a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2"}
Sep 10 21:39:19.629494 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:19.629104    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv" event={"ID":"bbe5325f-2f23-4ad9-8771-a6e3efae6df9","Type":"ContainerStarted","Data":"21ca19a0d3cbd358488914b203cd1fa210f26aa3fc6d2430e85f0148bcaed011"}
Sep 10 21:39:19.645114 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:19.645044    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv" podStartSLOduration=1.645025758 podStartE2EDuration="1.645025758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:39:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:39:19.644786368 +0000 UTC m=+1209.847116941" watchObservedRunningTime="2026-09-10 21:39:19.645025758 +0000 UTC m=+1209.847356329"
Sep 10 21:39:28.337822 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:28.337783    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:28.338228 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:28.337836    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:28.351698 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:28.351672    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:39:28.696446 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:39:28.696367    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:40:15.236941 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.236745    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"]
Sep 10 21:40:15.237508 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.237330    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4" podUID="1a7ef083-f485-451c-975e-29a135a022b2" containerName="maas-api" containerID="cri-o://62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e" gracePeriod=30
Sep 10 21:40:15.494091 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.494035    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:40:15.623785 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.623756    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7ef083-f485-451c-975e-29a135a022b2-openshift-service-ca\") pod \"1a7ef083-f485-451c-975e-29a135a022b2\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") "
Sep 10 21:40:15.623954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.623812    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-maas-api-tls\") pod \"1a7ef083-f485-451c-975e-29a135a022b2\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") "
Sep 10 21:40:15.623954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.623833    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7v94\" (UniqueName: \"kubernetes.io/projected/1a7ef083-f485-451c-975e-29a135a022b2-kube-api-access-m7v94\") pod \"1a7ef083-f485-451c-975e-29a135a022b2\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") "
Sep 10 21:40:15.623954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.623876    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-metrics-certs\") pod \"1a7ef083-f485-451c-975e-29a135a022b2\" (UID: \"1a7ef083-f485-451c-975e-29a135a022b2\") "
Sep 10 21:40:15.624166 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.624135    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a7ef083-f485-451c-975e-29a135a022b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1a7ef083-f485-451c-975e-29a135a022b2" (UID: "1a7ef083-f485-451c-975e-29a135a022b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:40:15.626052 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.626019    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1a7ef083-f485-451c-975e-29a135a022b2" (UID: "1a7ef083-f485-451c-975e-29a135a022b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:40:15.626052 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.626034    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1a7ef083-f485-451c-975e-29a135a022b2" (UID: "1a7ef083-f485-451c-975e-29a135a022b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:40:15.626184 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.626127    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a7ef083-f485-451c-975e-29a135a022b2-kube-api-access-m7v94" (OuterVolumeSpecName: "kube-api-access-m7v94") pod "1a7ef083-f485-451c-975e-29a135a022b2" (UID: "1a7ef083-f485-451c-975e-29a135a022b2"). InnerVolumeSpecName "kube-api-access-m7v94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:40:15.725369 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.725344    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7ef083-f485-451c-975e-29a135a022b2-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:40:15.725369 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.725365    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:40:15.725518 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.725375    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7v94\" (UniqueName: \"kubernetes.io/projected/1a7ef083-f485-451c-975e-29a135a022b2-kube-api-access-m7v94\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:40:15.725518 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.725385    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a7ef083-f485-451c-975e-29a135a022b2-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:40:15.996821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.996786    2568 generic.go:356] "Generic (PLEG): container finished" podID="1a7ef083-f485-451c-975e-29a135a022b2" containerID="62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e" exitCode=0
Sep 10 21:40:15.996991 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.996829    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"
Sep 10 21:40:15.996991 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.996876    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4" event={"ID":"1a7ef083-f485-451c-975e-29a135a022b2","Type":"ContainerDied","Data":"62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e"}
Sep 10 21:40:15.996991 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.996925    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4" event={"ID":"1a7ef083-f485-451c-975e-29a135a022b2","Type":"ContainerDied","Data":"dc54e7633fde97ac1a0b067c23eb704785ff873e808175c3e0c76321272b661e"}
Sep 10 21:40:15.996991 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:15.996949    2568 scope.go:117] "RemoveContainer" containerID="62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e"
Sep 10 21:40:16.007754 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:16.007738    2568 scope.go:117] "RemoveContainer" containerID="62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e"
Sep 10 21:40:16.008035 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:40:16.008018    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e\": container with ID starting with 62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e not found: ID does not exist" containerID="62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e"
Sep 10 21:40:16.008102 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:16.008048    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e"} err="failed to get container status \"62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e\": rpc error: code = NotFound desc = could not find container \"62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e\": container with ID starting with 62b302a1b955bc5f6bd82074f517289c035686dd4678fa8afd635e59d6a3b34e not found: ID does not exist"
Sep 10 21:40:16.019990 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:16.019966    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"]
Sep 10 21:40:16.022605 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:16.022586    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c245620-648b8b8c9-kwch4"]
Sep 10 21:40:16.197363 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:16.197331    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a7ef083-f485-451c-975e-29a135a022b2" path="/var/lib/kubelet/pods/1a7ef083-f485-451c-975e-29a135a022b2/volumes"
Sep 10 21:40:23.567916 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:23.567879    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"]
Sep 10 21:40:38.587743 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.587689    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv" podUID="bbe5325f-2f23-4ad9-8771-a6e3efae6df9" containerName="main" containerID="cri-o://a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2" gracePeriod=45
Sep 10 21:40:38.685953 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.685917    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv" podUID="bbe5325f-2f23-4ad9-8771-a6e3efae6df9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": dial tcp 10.132.0.87:8000: connect: connection refused"
Sep 10 21:40:38.844023 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.843967    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:40:38.938442 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.938400    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tmp-dir\") pod \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") "
Sep 10 21:40:38.938604 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.938451    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc4jt\" (UniqueName: \"kubernetes.io/projected/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-kube-api-access-hc4jt\") pod \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") "
Sep 10 21:40:38.938604 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.938496    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-dshm\") pod \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") "
Sep 10 21:40:38.938604 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.938557    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-home\") pod \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") "
Sep 10 21:40:38.938604 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.938583    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-model-cache\") pod \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") "
Sep 10 21:40:38.938846 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.938640    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tls-certs\") pod \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\" (UID: \"bbe5325f-2f23-4ad9-8771-a6e3efae6df9\") "
Sep 10 21:40:38.938846 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.938703    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bbe5325f-2f23-4ad9-8771-a6e3efae6df9" (UID: "bbe5325f-2f23-4ad9-8771-a6e3efae6df9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:40:38.938961 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.938872    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-home" (OuterVolumeSpecName: "home") pod "bbe5325f-2f23-4ad9-8771-a6e3efae6df9" (UID: "bbe5325f-2f23-4ad9-8771-a6e3efae6df9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:40:38.938961 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.938891    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-model-cache" (OuterVolumeSpecName: "model-cache") pod "bbe5325f-2f23-4ad9-8771-a6e3efae6df9" (UID: "bbe5325f-2f23-4ad9-8771-a6e3efae6df9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:40:38.939052 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.939025    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tmp-dir\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:40:38.939052 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.939043    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-home\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:40:38.939052 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.939052    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-model-cache\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:40:38.940690 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.940668    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-dshm" (OuterVolumeSpecName: "dshm") pod "bbe5325f-2f23-4ad9-8771-a6e3efae6df9" (UID: "bbe5325f-2f23-4ad9-8771-a6e3efae6df9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:40:38.940787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.940717    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bbe5325f-2f23-4ad9-8771-a6e3efae6df9" (UID: "bbe5325f-2f23-4ad9-8771-a6e3efae6df9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:40:38.940787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:38.940754    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-kube-api-access-hc4jt" (OuterVolumeSpecName: "kube-api-access-hc4jt") pod "bbe5325f-2f23-4ad9-8771-a6e3efae6df9" (UID: "bbe5325f-2f23-4ad9-8771-a6e3efae6df9"). InnerVolumeSpecName "kube-api-access-hc4jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:40:39.040410 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.040387    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc4jt\" (UniqueName: \"kubernetes.io/projected/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-kube-api-access-hc4jt\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:40:39.040410 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.040408    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-dshm\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:40:39.040553 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.040419    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbe5325f-2f23-4ad9-8771-a6e3efae6df9-tls-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:40:39.147256 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.147175    2568 generic.go:356] "Generic (PLEG): container finished" podID="bbe5325f-2f23-4ad9-8771-a6e3efae6df9" containerID="a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2" exitCode=0
Sep 10 21:40:39.147256 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.147228    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"
Sep 10 21:40:39.147447 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.147256    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv" event={"ID":"bbe5325f-2f23-4ad9-8771-a6e3efae6df9","Type":"ContainerDied","Data":"a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2"}
Sep 10 21:40:39.147447 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.147296    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv" event={"ID":"bbe5325f-2f23-4ad9-8771-a6e3efae6df9","Type":"ContainerDied","Data":"21ca19a0d3cbd358488914b203cd1fa210f26aa3fc6d2430e85f0148bcaed011"}
Sep 10 21:40:39.147447 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.147317    2568 scope.go:117] "RemoveContainer" containerID="a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2"
Sep 10 21:40:39.160632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.160616    2568 scope.go:117] "RemoveContainer" containerID="a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2"
Sep 10 21:40:39.160995 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:40:39.160972    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2\": container with ID starting with a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2 not found: ID does not exist" containerID="a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2"
Sep 10 21:40:39.161100 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.161004    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2"} err="failed to get container status \"a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2\": rpc error: code = NotFound desc = could not find container \"a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2\": container with ID starting with a951ca5478b692de23bf6693dfef90f72e4107f9d21462a400aabe221d7651a2 not found: ID does not exist"
Sep 10 21:40:39.171972 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.171946    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"]
Sep 10 21:40:39.177297 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:39.177276    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8c245620/e2e-lifecycle-model-8c245620-kserve-686794f85f-swnkv"]
Sep 10 21:40:40.197239 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:40:40.197188    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbe5325f-2f23-4ad9-8771-a6e3efae6df9" path="/var/lib/kubelet/pods/bbe5325f-2f23-4ad9-8771-a6e3efae6df9/volumes"
Sep 10 21:41:17.920721 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:17.920680    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-9c63ec"]
Sep 10 21:41:17.921379 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:17.921358    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a7ef083-f485-451c-975e-29a135a022b2" containerName="maas-api"
Sep 10 21:41:17.921495 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:17.921381    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a7ef083-f485-451c-975e-29a135a022b2" containerName="maas-api"
Sep 10 21:41:17.921495 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:17.921429    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbe5325f-2f23-4ad9-8771-a6e3efae6df9" containerName="main"
Sep 10 21:41:17.921495 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:17.921439    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbe5325f-2f23-4ad9-8771-a6e3efae6df9" containerName="main"
Sep 10 21:41:17.921653 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:17.921555    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a7ef083-f485-451c-975e-29a135a022b2" containerName="maas-api"
Sep 10 21:41:17.921653 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:17.921573    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbe5325f-2f23-4ad9-8771-a6e3efae6df9" containerName="main"
Sep 10 21:41:17.926026 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:17.925994    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-9c63ec"
Sep 10 21:41:17.928484 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:17.928461    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zd54x\""
Sep 10 21:41:17.932641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:17.932618    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-9c63ec"]
Sep 10 21:41:17.992107 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:17.992077    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2qd4\" (UniqueName: \"kubernetes.io/projected/1594798a-f794-43a7-87d6-b86c5320a328-kube-api-access-x2qd4\") pod \"test-curl-7555-9c63ec\" (UID: \"1594798a-f794-43a7-87d6-b86c5320a328\") " pod="opendatahub/test-curl-7555-9c63ec"
Sep 10 21:41:18.092773 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:18.092746    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2qd4\" (UniqueName: \"kubernetes.io/projected/1594798a-f794-43a7-87d6-b86c5320a328-kube-api-access-x2qd4\") pod \"test-curl-7555-9c63ec\" (UID: \"1594798a-f794-43a7-87d6-b86c5320a328\") " pod="opendatahub/test-curl-7555-9c63ec"
Sep 10 21:41:18.099928 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:18.099904    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2qd4\" (UniqueName: \"kubernetes.io/projected/1594798a-f794-43a7-87d6-b86c5320a328-kube-api-access-x2qd4\") pod \"test-curl-7555-9c63ec\" (UID: \"1594798a-f794-43a7-87d6-b86c5320a328\") " pod="opendatahub/test-curl-7555-9c63ec"
Sep 10 21:41:18.238310 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:18.238232    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-9c63ec"
Sep 10 21:41:18.511763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:18.511735    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-9c63ec"]
Sep 10 21:41:18.512290 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:41:18.512267    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1594798a_f794_43a7_87d6_b86c5320a328.slice/crio-4476a89defccc6d9bf76b39c98b0c38882cdff36e827b64bd7ca72385836e69a WatchSource:0}: Error finding container 4476a89defccc6d9bf76b39c98b0c38882cdff36e827b64bd7ca72385836e69a: Status 404 returned error can't find the container with id 4476a89defccc6d9bf76b39c98b0c38882cdff36e827b64bd7ca72385836e69a
Sep 10 21:41:19.402957 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:19.402918    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-9c63ec" event={"ID":"1594798a-f794-43a7-87d6-b86c5320a328","Type":"ContainerStarted","Data":"2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515"}
Sep 10 21:41:19.403450 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:19.402966    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-9c63ec" event={"ID":"1594798a-f794-43a7-87d6-b86c5320a328","Type":"ContainerStarted","Data":"4476a89defccc6d9bf76b39c98b0c38882cdff36e827b64bd7ca72385836e69a"}
Sep 10 21:41:19.420073 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:19.420025    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7555-9c63ec" podStartSLOduration=2.420010819 podStartE2EDuration="2.420010819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:41:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:41:19.418273804 +0000 UTC m=+1329.620604375" watchObservedRunningTime="2026-09-10 21:41:19.420010819 +0000 UTC m=+1329.622341391"
Sep 10 21:41:20.045555 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:20.045519    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-9c63ec"]
Sep 10 21:41:20.050689 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:20.050655    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-9c63ec"]
Sep 10 21:41:20.408902 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:41:20.408871    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7555-9c63ec" container="test-curl-7555-9c63ec"
Sep 10 21:41:21.414810 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:21.414770    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7555-9c63ec" podUID="1594798a-f794-43a7-87d6-b86c5320a328" containerName="test-curl-7555-9c63ec" containerID="cri-o://2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515" gracePeriod=2
Sep 10 21:41:23.586971 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:23.586945    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-9c63ec"
Sep 10 21:41:23.645359 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:23.645323    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2qd4\" (UniqueName: \"kubernetes.io/projected/1594798a-f794-43a7-87d6-b86c5320a328-kube-api-access-x2qd4\") pod \"1594798a-f794-43a7-87d6-b86c5320a328\" (UID: \"1594798a-f794-43a7-87d6-b86c5320a328\") "
Sep 10 21:41:23.647226 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:23.647191    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1594798a-f794-43a7-87d6-b86c5320a328-kube-api-access-x2qd4" (OuterVolumeSpecName: "kube-api-access-x2qd4") pod "1594798a-f794-43a7-87d6-b86c5320a328" (UID: "1594798a-f794-43a7-87d6-b86c5320a328"). InnerVolumeSpecName "kube-api-access-x2qd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:41:23.746182 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:23.746109    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2qd4\" (UniqueName: \"kubernetes.io/projected/1594798a-f794-43a7-87d6-b86c5320a328-kube-api-access-x2qd4\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:41:24.197242 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:24.197194    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1594798a-f794-43a7-87d6-b86c5320a328" path="/var/lib/kubelet/pods/1594798a-f794-43a7-87d6-b86c5320a328/volumes"
Sep 10 21:41:24.435354 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:24.435320    2568 generic.go:356] "Generic (PLEG): container finished" podID="1594798a-f794-43a7-87d6-b86c5320a328" containerID="2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515" exitCode=137
Sep 10 21:41:24.435354 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:24.435361    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-9c63ec"
Sep 10 21:41:24.435604 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:24.435455    2568 scope.go:117] "RemoveContainer" containerID="2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515"
Sep 10 21:41:24.444796 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:24.444769    2568 scope.go:117] "RemoveContainer" containerID="2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515"
Sep 10 21:41:24.445032 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:41:24.445015    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515\": container with ID starting with 2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515 not found: ID does not exist" containerID="2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515"
Sep 10 21:41:24.445086 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:41:24.445040    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515"} err="failed to get container status \"2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515\": rpc error: code = NotFound desc = could not find container \"2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515\": container with ID starting with 2f4c9356e5a3c79339590df2628b9eb2cafc3e38b5dccc9094df70a39eb61515 not found: ID does not exist"
Sep 10 21:42:05.966780 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:05.966748    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"]
Sep 10 21:42:05.967671 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:05.967647    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1594798a-f794-43a7-87d6-b86c5320a328" containerName="test-curl-7555-9c63ec"
Sep 10 21:42:05.967788 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:05.967674    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1594798a-f794-43a7-87d6-b86c5320a328" containerName="test-curl-7555-9c63ec"
Sep 10 21:42:05.967848 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:05.967826    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1594798a-f794-43a7-87d6-b86c5320a328" containerName="test-curl-7555-9c63ec"
Sep 10 21:42:05.971281 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:05.971259    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:05.973637 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:05.973616    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-93f046-serving-cert\""
Sep 10 21:42:05.983187 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:05.982979    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"]
Sep 10 21:42:06.016167 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.016135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-maas-api-tls\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.016310 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.016182    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-metrics-certs\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.016310 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.016284    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf5pb\" (UniqueName: \"kubernetes.io/projected/22fc6d26-4143-4699-a0b5-85020cc179fb-kube-api-access-cf5pb\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.016391 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.016320    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fc6d26-4143-4699-a0b5-85020cc179fb-openshift-service-ca\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.117290 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.117256    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-metrics-certs\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.117451 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.117342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf5pb\" (UniqueName: \"kubernetes.io/projected/22fc6d26-4143-4699-a0b5-85020cc179fb-kube-api-access-cf5pb\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.117451 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.117384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fc6d26-4143-4699-a0b5-85020cc179fb-openshift-service-ca\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.117529 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.117447    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-maas-api-tls\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.117582 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:42:06.117567    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-serving-cert: secret "maas-api-e2e-api-a-93f046-serving-cert" not found
Sep 10 21:42:06.117652 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:42:06.117641    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-maas-api-tls podName:22fc6d26-4143-4699-a0b5-85020cc179fb nodeName:}" failed. No retries permitted until 2026-09-10 21:42:06.617624049 +0000 UTC m=+1376.819954603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-maas-api-tls") pod "maas-api-e2e-api-a-93f046-64b69c844d-tgmmx" (UID: "22fc6d26-4143-4699-a0b5-85020cc179fb") : secret "maas-api-e2e-api-a-93f046-serving-cert" not found
Sep 10 21:42:06.118081 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.118058    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fc6d26-4143-4699-a0b5-85020cc179fb-openshift-service-ca\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.119688 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.119665    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-metrics-certs\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.124985 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.124965    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf5pb\" (UniqueName: \"kubernetes.io/projected/22fc6d26-4143-4699-a0b5-85020cc179fb-kube-api-access-cf5pb\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.622154 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.622122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-maas-api-tls\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.624507 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.624478    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-maas-api-tls\") pod \"maas-api-e2e-api-a-93f046-64b69c844d-tgmmx\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:06.885610 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:06.885536    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:07.161522 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:42:07.161482    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22fc6d26_4143_4699_a0b5_85020cc179fb.slice/crio-6c6f32f49d79b63f89267b158a322f692ca5e152180d6ceea60a544057add31d WatchSource:0}: Error finding container 6c6f32f49d79b63f89267b158a322f692ca5e152180d6ceea60a544057add31d: Status 404 returned error can't find the container with id 6c6f32f49d79b63f89267b158a322f692ca5e152180d6ceea60a544057add31d
Sep 10 21:42:07.161916 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:07.161639    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"]
Sep 10 21:42:07.163234 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:07.163194    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:42:07.714187 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:07.714159    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx" event={"ID":"22fc6d26-4143-4699-a0b5-85020cc179fb","Type":"ContainerStarted","Data":"48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e"}
Sep 10 21:42:07.714321 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:07.714236    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx" event={"ID":"22fc6d26-4143-4699-a0b5-85020cc179fb","Type":"ContainerStarted","Data":"6c6f32f49d79b63f89267b158a322f692ca5e152180d6ceea60a544057add31d"}
Sep 10 21:42:07.714411 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:07.714390    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:07.744728 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:07.744681    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx" podStartSLOduration=2.2658910150000002 podStartE2EDuration="2.744666045s" totalImagesPullingTime="478.77503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:42:07.741999162 +0000 UTC m=+1377.944329735" watchObservedRunningTime="2026-09-10 21:42:07.744666045 +0000 UTC m=+1377.946996632"
Sep 10 21:42:13.725177 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:13.725145    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:42:35.104823 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.104786    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"]
Sep 10 21:42:35.110372 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.110348    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.112487 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.112467    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a867da-serving-cert\""
Sep 10 21:42:35.118227 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.118192    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"]
Sep 10 21:42:35.280831 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.280793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-metrics-certs\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.280831 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.280833    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-maas-api-tls\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.281093 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.281039    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq8n7\" (UniqueName: \"kubernetes.io/projected/eaf252d6-d916-4020-a956-c2e8ae85f6a4-kube-api-access-dq8n7\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.281170 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.281126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf252d6-d916-4020-a956-c2e8ae85f6a4-openshift-service-ca\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.382524 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.382441    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8n7\" (UniqueName: \"kubernetes.io/projected/eaf252d6-d916-4020-a956-c2e8ae85f6a4-kube-api-access-dq8n7\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.382524 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.382489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf252d6-d916-4020-a956-c2e8ae85f6a4-openshift-service-ca\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.382763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.382613    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-metrics-certs\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.382763 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.382649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-maas-api-tls\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.383296 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.383271    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf252d6-d916-4020-a956-c2e8ae85f6a4-openshift-service-ca\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.385068 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.385043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-maas-api-tls\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.385230 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.385076    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-metrics-certs\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.390605 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.390585    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq8n7\" (UniqueName: \"kubernetes.io/projected/eaf252d6-d916-4020-a956-c2e8ae85f6a4-kube-api-access-dq8n7\") pod \"maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.424306 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.424282    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:35.702060 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.702031    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"]
Sep 10 21:42:35.702893 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:42:35.702865    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf252d6_d916_4020_a956_c2e8ae85f6a4.slice/crio-05166dc3f405af6cfa8c17975462345835627f37914b0f331500c7033e0a5f81 WatchSource:0}: Error finding container 05166dc3f405af6cfa8c17975462345835627f37914b0f331500c7033e0a5f81: Status 404 returned error can't find the container with id 05166dc3f405af6cfa8c17975462345835627f37914b0f331500c7033e0a5f81
Sep 10 21:42:35.893821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:35.893786    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7" event={"ID":"eaf252d6-d916-4020-a956-c2e8ae85f6a4","Type":"ContainerStarted","Data":"05166dc3f405af6cfa8c17975462345835627f37914b0f331500c7033e0a5f81"}
Sep 10 21:42:36.901732 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:36.901693    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7" event={"ID":"eaf252d6-d916-4020-a956-c2e8ae85f6a4","Type":"ContainerStarted","Data":"b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58"}
Sep 10 21:42:36.902187 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:36.901896    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:36.920101 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:36.920046    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7" podStartSLOduration=1.59178897 podStartE2EDuration="1.920034046s" totalImagesPullingTime="328.245076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:42:36.917955558 +0000 UTC m=+1407.120286132" watchObservedRunningTime="2026-09-10 21:42:36.920034046 +0000 UTC m=+1407.122364617"
Sep 10 21:42:42.914457 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:42.914424    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:42:48.822699 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:48.822652    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-6180c5"]
Sep 10 21:42:48.826325 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:48.826304    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-6180c5"
Sep 10 21:42:48.828958 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:48.828934    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zd54x\""
Sep 10 21:42:48.832712 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:48.832692    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-6180c5"]
Sep 10 21:42:48.908535 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:48.908507    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxbqz\" (UniqueName: \"kubernetes.io/projected/be398ad4-0ea4-410e-bdd9-394fa9a60b2d-kube-api-access-sxbqz\") pod \"test-curl-7555-6180c5\" (UID: \"be398ad4-0ea4-410e-bdd9-394fa9a60b2d\") " pod="opendatahub/test-curl-7555-6180c5"
Sep 10 21:42:49.009168 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:49.009138    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxbqz\" (UniqueName: \"kubernetes.io/projected/be398ad4-0ea4-410e-bdd9-394fa9a60b2d-kube-api-access-sxbqz\") pod \"test-curl-7555-6180c5\" (UID: \"be398ad4-0ea4-410e-bdd9-394fa9a60b2d\") " pod="opendatahub/test-curl-7555-6180c5"
Sep 10 21:42:49.016902 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:49.016876    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxbqz\" (UniqueName: \"kubernetes.io/projected/be398ad4-0ea4-410e-bdd9-394fa9a60b2d-kube-api-access-sxbqz\") pod \"test-curl-7555-6180c5\" (UID: \"be398ad4-0ea4-410e-bdd9-394fa9a60b2d\") " pod="opendatahub/test-curl-7555-6180c5"
Sep 10 21:42:49.138715 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:49.138643    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-6180c5"
Sep 10 21:42:49.409635 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:49.409603    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-6180c5"]
Sep 10 21:42:49.410863 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:42:49.410838    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe398ad4_0ea4_410e_bdd9_394fa9a60b2d.slice/crio-d3be042a866cba69462a8ee520a7cef9e9e1b387d974d4e2565932fc0e360000 WatchSource:0}: Error finding container d3be042a866cba69462a8ee520a7cef9e9e1b387d974d4e2565932fc0e360000: Status 404 returned error can't find the container with id d3be042a866cba69462a8ee520a7cef9e9e1b387d974d4e2565932fc0e360000
Sep 10 21:42:49.983392 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:49.983357    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-6180c5" event={"ID":"be398ad4-0ea4-410e-bdd9-394fa9a60b2d","Type":"ContainerStarted","Data":"a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24"}
Sep 10 21:42:49.983392 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:49.983402    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-6180c5" event={"ID":"be398ad4-0ea4-410e-bdd9-394fa9a60b2d","Type":"ContainerStarted","Data":"d3be042a866cba69462a8ee520a7cef9e9e1b387d974d4e2565932fc0e360000"}
Sep 10 21:42:49.999254 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:49.999180    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7555-6180c5" podStartSLOduration=1.999167372 podStartE2EDuration="1.999167372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:42:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:42:49.997987032 +0000 UTC m=+1420.200317603" watchObservedRunningTime="2026-09-10 21:42:49.999167372 +0000 UTC m=+1420.201497943"
Sep 10 21:42:50.595960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:50.595929    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-6180c5"]
Sep 10 21:42:50.605585 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:50.605555    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-6180c5"]
Sep 10 21:42:50.718871 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:50.718799    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-ed26cc"]
Sep 10 21:42:50.719302 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:50.719288    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be398ad4-0ea4-410e-bdd9-394fa9a60b2d" containerName="test-curl-7555-6180c5"
Sep 10 21:42:50.719353 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:50.719304    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="be398ad4-0ea4-410e-bdd9-394fa9a60b2d" containerName="test-curl-7555-6180c5"
Sep 10 21:42:50.719391 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:50.719373    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="be398ad4-0ea4-410e-bdd9-394fa9a60b2d" containerName="test-curl-7555-6180c5"
Sep 10 21:42:50.722522 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:50.722507    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-ed26cc"
Sep 10 21:42:50.729906 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:50.729881    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-ed26cc"]
Sep 10 21:42:50.825595 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:50.825568    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8bch\" (UniqueName: \"kubernetes.io/projected/62f89265-cbd5-46ee-8482-3fa080c7a49c-kube-api-access-l8bch\") pod \"test-curl-7555-ed26cc\" (UID: \"62f89265-cbd5-46ee-8482-3fa080c7a49c\") " pod="opendatahub/test-curl-7555-ed26cc"
Sep 10 21:42:50.926974 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:50.926942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8bch\" (UniqueName: \"kubernetes.io/projected/62f89265-cbd5-46ee-8482-3fa080c7a49c-kube-api-access-l8bch\") pod \"test-curl-7555-ed26cc\" (UID: \"62f89265-cbd5-46ee-8482-3fa080c7a49c\") " pod="opendatahub/test-curl-7555-ed26cc"
Sep 10 21:42:50.935241 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:50.935193    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8bch\" (UniqueName: \"kubernetes.io/projected/62f89265-cbd5-46ee-8482-3fa080c7a49c-kube-api-access-l8bch\") pod \"test-curl-7555-ed26cc\" (UID: \"62f89265-cbd5-46ee-8482-3fa080c7a49c\") " pod="opendatahub/test-curl-7555-ed26cc"
Sep 10 21:42:50.989296 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:42:50.989136    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7555-6180c5" container="test-curl-7555-6180c5"
Sep 10 21:42:51.033284 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:51.033260    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-ed26cc"
Sep 10 21:42:51.306577 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:51.306549    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-ed26cc"]
Sep 10 21:42:51.306904 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:42:51.306876    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62f89265_cbd5_46ee_8482_3fa080c7a49c.slice/crio-b34260c7246811204df830cb118bc110e47eee57754f11aa9def15cf3cf6ff21 WatchSource:0}: Error finding container b34260c7246811204df830cb118bc110e47eee57754f11aa9def15cf3cf6ff21: Status 404 returned error can't find the container with id b34260c7246811204df830cb118bc110e47eee57754f11aa9def15cf3cf6ff21
Sep 10 21:42:51.997183 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:51.997151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-ed26cc" event={"ID":"62f89265-cbd5-46ee-8482-3fa080c7a49c","Type":"ContainerStarted","Data":"61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67"}
Sep 10 21:42:51.997677 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:51.997194    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-ed26cc" event={"ID":"62f89265-cbd5-46ee-8482-3fa080c7a49c","Type":"ContainerStarted","Data":"b34260c7246811204df830cb118bc110e47eee57754f11aa9def15cf3cf6ff21"}
Sep 10 21:42:51.997677 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:51.997346    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7555-6180c5" podUID="be398ad4-0ea4-410e-bdd9-394fa9a60b2d" containerName="test-curl-7555-6180c5" containerID="cri-o://a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24" gracePeriod=2
Sep 10 21:42:52.013954 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:52.013884    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7555-ed26cc" podStartSLOduration=2.013861872 podStartE2EDuration="2.013861872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:42:52.009141897 +0000 UTC m=+1422.211472468" watchObservedRunningTime="2026-09-10 21:42:52.013861872 +0000 UTC m=+1422.216192448"
Sep 10 21:42:52.018861 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:42:52.018819    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-6180c5\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="be398ad4-0ea4-410e-bdd9-394fa9a60b2d" pod="opendatahub/test-curl-7555-6180c5"
Sep 10 21:42:52.618433 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:52.618395    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-ed26cc"]
Sep 10 21:42:52.623368 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:52.623341    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-ed26cc"]
Sep 10 21:42:53.004193 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:42:53.004164    2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7555-ed26cc" container="test-curl-7555-ed26cc"
Sep 10 21:42:54.010614 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:54.010579    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7555-ed26cc" podUID="62f89265-cbd5-46ee-8482-3fa080c7a49c" containerName="test-curl-7555-ed26cc" containerID="cri-o://61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67" gracePeriod=2
Sep 10 21:42:54.013035 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:42:54.012927    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-ed26cc\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="62f89265-cbd5-46ee-8482-3fa080c7a49c" pod="opendatahub/test-curl-7555-ed26cc"
Sep 10 21:42:54.193700 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:54.193673    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-6180c5"
Sep 10 21:42:54.196039 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:42:54.196011    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-ed26cc\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="62f89265-cbd5-46ee-8482-3fa080c7a49c" pod="opendatahub/test-curl-7555-ed26cc"
Sep 10 21:42:54.258021 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:54.257953    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxbqz\" (UniqueName: \"kubernetes.io/projected/be398ad4-0ea4-410e-bdd9-394fa9a60b2d-kube-api-access-sxbqz\") pod \"be398ad4-0ea4-410e-bdd9-394fa9a60b2d\" (UID: \"be398ad4-0ea4-410e-bdd9-394fa9a60b2d\") "
Sep 10 21:42:54.260104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:54.260077    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be398ad4-0ea4-410e-bdd9-394fa9a60b2d-kube-api-access-sxbqz" (OuterVolumeSpecName: "kube-api-access-sxbqz") pod "be398ad4-0ea4-410e-bdd9-394fa9a60b2d" (UID: "be398ad4-0ea4-410e-bdd9-394fa9a60b2d"). InnerVolumeSpecName "kube-api-access-sxbqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:42:54.359351 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:54.359318    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxbqz\" (UniqueName: \"kubernetes.io/projected/be398ad4-0ea4-410e-bdd9-394fa9a60b2d-kube-api-access-sxbqz\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:42:55.018263 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:55.018225    2568 generic.go:356] "Generic (PLEG): container finished" podID="be398ad4-0ea4-410e-bdd9-394fa9a60b2d" containerID="a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24" exitCode=137
Sep 10 21:42:55.018263 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:55.018266    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-6180c5"
Sep 10 21:42:55.018744 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:55.018353    2568 scope.go:117] "RemoveContainer" containerID="a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24"
Sep 10 21:42:55.027605 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:55.027590    2568 scope.go:117] "RemoveContainer" containerID="a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24"
Sep 10 21:42:55.027865 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:42:55.027846    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24\": container with ID starting with a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24 not found: ID does not exist" containerID="a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24"
Sep 10 21:42:55.027912 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:55.027873    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24"} err="failed to get container status \"a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24\": rpc error: code = NotFound desc = could not find container \"a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24\": container with ID starting with a89ecb906ae94f7e2688ec3edc9b98fde4662fdf8165043e59334c12d336cc24 not found: ID does not exist"
Sep 10 21:42:56.190997 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:56.190972    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-ed26cc"
Sep 10 21:42:56.197052 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:56.197023    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be398ad4-0ea4-410e-bdd9-394fa9a60b2d" path="/var/lib/kubelet/pods/be398ad4-0ea4-410e-bdd9-394fa9a60b2d/volumes"
Sep 10 21:42:56.277792 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:56.277718    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8bch\" (UniqueName: \"kubernetes.io/projected/62f89265-cbd5-46ee-8482-3fa080c7a49c-kube-api-access-l8bch\") pod \"62f89265-cbd5-46ee-8482-3fa080c7a49c\" (UID: \"62f89265-cbd5-46ee-8482-3fa080c7a49c\") "
Sep 10 21:42:56.279739 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:56.279711    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62f89265-cbd5-46ee-8482-3fa080c7a49c-kube-api-access-l8bch" (OuterVolumeSpecName: "kube-api-access-l8bch") pod "62f89265-cbd5-46ee-8482-3fa080c7a49c" (UID: "62f89265-cbd5-46ee-8482-3fa080c7a49c"). InnerVolumeSpecName "kube-api-access-l8bch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:42:56.378825 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:56.378789    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8bch\" (UniqueName: \"kubernetes.io/projected/62f89265-cbd5-46ee-8482-3fa080c7a49c-kube-api-access-l8bch\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:42:57.033605 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:57.033570    2568 generic.go:356] "Generic (PLEG): container finished" podID="62f89265-cbd5-46ee-8482-3fa080c7a49c" containerID="61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67" exitCode=137
Sep 10 21:42:57.033789 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:57.033620    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-ed26cc"
Sep 10 21:42:57.033789 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:57.033671    2568 scope.go:117] "RemoveContainer" containerID="61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67"
Sep 10 21:42:57.044403 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:57.044160    2568 scope.go:117] "RemoveContainer" containerID="61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67"
Sep 10 21:42:57.044468 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:42:57.044426    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67\": container with ID starting with 61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67 not found: ID does not exist" containerID="61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67"
Sep 10 21:42:57.044468 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:57.044447    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67"} err="failed to get container status \"61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67\": rpc error: code = NotFound desc = could not find container \"61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67\": container with ID starting with 61cf0445bb2548560cf0f26efd2b7665caf27695710b1ac1d28b5134856a8f67 not found: ID does not exist"
Sep 10 21:42:58.197930 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:42:58.197888    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62f89265-cbd5-46ee-8482-3fa080c7a49c" path="/var/lib/kubelet/pods/62f89265-cbd5-46ee-8482-3fa080c7a49c/volumes"
Sep 10 21:43:17.400258 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.400220    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"]
Sep 10 21:43:17.400750 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.400492    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx" podUID="22fc6d26-4143-4699-a0b5-85020cc179fb" containerName="maas-api" containerID="cri-o://48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e" gracePeriod=30
Sep 10 21:43:17.671950 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.671925    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:43:17.788911 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.788869    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-metrics-certs\") pod \"22fc6d26-4143-4699-a0b5-85020cc179fb\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") "
Sep 10 21:43:17.789064 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.788925    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf5pb\" (UniqueName: \"kubernetes.io/projected/22fc6d26-4143-4699-a0b5-85020cc179fb-kube-api-access-cf5pb\") pod \"22fc6d26-4143-4699-a0b5-85020cc179fb\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") "
Sep 10 21:43:17.789064 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.789001    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fc6d26-4143-4699-a0b5-85020cc179fb-openshift-service-ca\") pod \"22fc6d26-4143-4699-a0b5-85020cc179fb\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") "
Sep 10 21:43:17.789139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.789073    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-maas-api-tls\") pod \"22fc6d26-4143-4699-a0b5-85020cc179fb\" (UID: \"22fc6d26-4143-4699-a0b5-85020cc179fb\") "
Sep 10 21:43:17.789495 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.789458    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22fc6d26-4143-4699-a0b5-85020cc179fb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22fc6d26-4143-4699-a0b5-85020cc179fb" (UID: "22fc6d26-4143-4699-a0b5-85020cc179fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:43:17.789652 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.789553    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fc6d26-4143-4699-a0b5-85020cc179fb-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:17.791263 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.791233    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22fc6d26-4143-4699-a0b5-85020cc179fb" (UID: "22fc6d26-4143-4699-a0b5-85020cc179fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:43:17.791576 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.791550    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "22fc6d26-4143-4699-a0b5-85020cc179fb" (UID: "22fc6d26-4143-4699-a0b5-85020cc179fb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:43:17.791656 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.791585    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22fc6d26-4143-4699-a0b5-85020cc179fb-kube-api-access-cf5pb" (OuterVolumeSpecName: "kube-api-access-cf5pb") pod "22fc6d26-4143-4699-a0b5-85020cc179fb" (UID: "22fc6d26-4143-4699-a0b5-85020cc179fb"). InnerVolumeSpecName "kube-api-access-cf5pb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:43:17.890376 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.890347    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:17.890376 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.890373    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf5pb\" (UniqueName: \"kubernetes.io/projected/22fc6d26-4143-4699-a0b5-85020cc179fb-kube-api-access-cf5pb\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:17.890376 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:17.890385    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fc6d26-4143-4699-a0b5-85020cc179fb-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:18.176543 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:18.176506    2568 generic.go:356] "Generic (PLEG): container finished" podID="22fc6d26-4143-4699-a0b5-85020cc179fb" containerID="48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e" exitCode=0
Sep 10 21:43:18.176707 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:18.176547    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"
Sep 10 21:43:18.176707 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:18.176584    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx" event={"ID":"22fc6d26-4143-4699-a0b5-85020cc179fb","Type":"ContainerDied","Data":"48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e"}
Sep 10 21:43:18.176707 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:18.176634    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx" event={"ID":"22fc6d26-4143-4699-a0b5-85020cc179fb","Type":"ContainerDied","Data":"6c6f32f49d79b63f89267b158a322f692ca5e152180d6ceea60a544057add31d"}
Sep 10 21:43:18.176707 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:18.176655    2568 scope.go:117] "RemoveContainer" containerID="48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e"
Sep 10 21:43:18.187726 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:18.187704    2568 scope.go:117] "RemoveContainer" containerID="48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e"
Sep 10 21:43:18.188026 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:43:18.188003    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e\": container with ID starting with 48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e not found: ID does not exist" containerID="48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e"
Sep 10 21:43:18.188115 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:18.188035    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e"} err="failed to get container status \"48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e\": rpc error: code = NotFound desc = could not find container \"48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e\": container with ID starting with 48c6bb968cfafb49de72255e6336df1b04cddfff325819c028c436b7fcfd188e not found: ID does not exist"
Sep 10 21:43:18.200738 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:18.200715    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"]
Sep 10 21:43:18.208355 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:18.208335    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93f046-64b69c844d-tgmmx"]
Sep 10 21:43:20.196630 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:20.196598    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22fc6d26-4143-4699-a0b5-85020cc179fb" path="/var/lib/kubelet/pods/22fc6d26-4143-4699-a0b5-85020cc179fb/volumes"
Sep 10 21:43:39.914573 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:39.914541    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"]
Sep 10 21:43:39.915063 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:39.914842    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7" podUID="eaf252d6-d916-4020-a956-c2e8ae85f6a4" containerName="maas-api" containerID="cri-o://b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58" gracePeriod=30
Sep 10 21:43:40.181060 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.181003    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:43:40.292567 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.292531    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf252d6-d916-4020-a956-c2e8ae85f6a4-openshift-service-ca\") pod \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") "
Sep 10 21:43:40.292749 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.292586    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq8n7\" (UniqueName: \"kubernetes.io/projected/eaf252d6-d916-4020-a956-c2e8ae85f6a4-kube-api-access-dq8n7\") pod \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") "
Sep 10 21:43:40.292749 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.292655    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-metrics-certs\") pod \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") "
Sep 10 21:43:40.292749 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.292728    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-maas-api-tls\") pod \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\" (UID: \"eaf252d6-d916-4020-a956-c2e8ae85f6a4\") "
Sep 10 21:43:40.292913 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.292855    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf252d6-d916-4020-a956-c2e8ae85f6a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eaf252d6-d916-4020-a956-c2e8ae85f6a4" (UID: "eaf252d6-d916-4020-a956-c2e8ae85f6a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:43:40.293016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.293001    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf252d6-d916-4020-a956-c2e8ae85f6a4-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:40.294717 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.294684    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "eaf252d6-d916-4020-a956-c2e8ae85f6a4" (UID: "eaf252d6-d916-4020-a956-c2e8ae85f6a4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:43:40.294836 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.294753    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf252d6-d916-4020-a956-c2e8ae85f6a4-kube-api-access-dq8n7" (OuterVolumeSpecName: "kube-api-access-dq8n7") pod "eaf252d6-d916-4020-a956-c2e8ae85f6a4" (UID: "eaf252d6-d916-4020-a956-c2e8ae85f6a4"). InnerVolumeSpecName "kube-api-access-dq8n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:43:40.294836 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.294824    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eaf252d6-d916-4020-a956-c2e8ae85f6a4" (UID: "eaf252d6-d916-4020-a956-c2e8ae85f6a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:43:40.310377 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.310353    2568 generic.go:356] "Generic (PLEG): container finished" podID="eaf252d6-d916-4020-a956-c2e8ae85f6a4" containerID="b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58" exitCode=0
Sep 10 21:43:40.310478 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.310390    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7" event={"ID":"eaf252d6-d916-4020-a956-c2e8ae85f6a4","Type":"ContainerDied","Data":"b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58"}
Sep 10 21:43:40.310478 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.310418    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"
Sep 10 21:43:40.310478 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.310449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7" event={"ID":"eaf252d6-d916-4020-a956-c2e8ae85f6a4","Type":"ContainerDied","Data":"05166dc3f405af6cfa8c17975462345835627f37914b0f331500c7033e0a5f81"}
Sep 10 21:43:40.310478 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.310471    2568 scope.go:117] "RemoveContainer" containerID="b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58"
Sep 10 21:43:40.320282 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.320268    2568 scope.go:117] "RemoveContainer" containerID="b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58"
Sep 10 21:43:40.320551 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:43:40.320532    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58\": container with ID starting with b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58 not found: ID does not exist" containerID="b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58"
Sep 10 21:43:40.320621 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.320559    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58"} err="failed to get container status \"b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58\": rpc error: code = NotFound desc = could not find container \"b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58\": container with ID starting with b569d15d88f38a2d276c6ce39ce8e84cbff3f8f41aef128b1162365106ec5f58 not found: ID does not exist"
Sep 10 21:43:40.333733 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.333698    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"]
Sep 10 21:43:40.337771 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.337745    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a867da-7ccdccf77d-rcjh7"]
Sep 10 21:43:40.394216 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.394174    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq8n7\" (UniqueName: \"kubernetes.io/projected/eaf252d6-d916-4020-a956-c2e8ae85f6a4-kube-api-access-dq8n7\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:40.394314 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.394219    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:40.394314 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:40.394230    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaf252d6-d916-4020-a956-c2e8ae85f6a4-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:42.197572 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:42.197539    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf252d6-d916-4020-a956-c2e8ae85f6a4" path="/var/lib/kubelet/pods/eaf252d6-d916-4020-a956-c2e8ae85f6a4/volumes"
Sep 10 21:43:57.741231 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:57.741178    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"]
Sep 10 21:43:57.741705 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:57.741443    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88" podUID="85ab73c6-8a5d-4d1b-9c22-8adab98e1272" containerName="maas-api" containerID="cri-o://683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8" gracePeriod=30
Sep 10 21:43:58.003752 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.003687    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:43:58.166258 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.166225    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-openshift-service-ca\") pod \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") "
Sep 10 21:43:58.166446 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.166265    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-maas-api-tls\") pod \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") "
Sep 10 21:43:58.166446 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.166306    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzx9b\" (UniqueName: \"kubernetes.io/projected/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-kube-api-access-bzx9b\") pod \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") "
Sep 10 21:43:58.166446 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.166346    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-metrics-certs\") pod \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\" (UID: \"85ab73c6-8a5d-4d1b-9c22-8adab98e1272\") "
Sep 10 21:43:58.166703 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.166669    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "85ab73c6-8a5d-4d1b-9c22-8adab98e1272" (UID: "85ab73c6-8a5d-4d1b-9c22-8adab98e1272"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:43:58.168474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.168452    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-kube-api-access-bzx9b" (OuterVolumeSpecName: "kube-api-access-bzx9b") pod "85ab73c6-8a5d-4d1b-9c22-8adab98e1272" (UID: "85ab73c6-8a5d-4d1b-9c22-8adab98e1272"). InnerVolumeSpecName "kube-api-access-bzx9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:43:58.168575 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.168531    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "85ab73c6-8a5d-4d1b-9c22-8adab98e1272" (UID: "85ab73c6-8a5d-4d1b-9c22-8adab98e1272"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:43:58.168575 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.168556    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "85ab73c6-8a5d-4d1b-9c22-8adab98e1272" (UID: "85ab73c6-8a5d-4d1b-9c22-8adab98e1272"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:43:58.267911 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.267842    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:58.267911 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.267870    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:58.267911 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.267881    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzx9b\" (UniqueName: \"kubernetes.io/projected/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-kube-api-access-bzx9b\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:58.267911 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.267889    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85ab73c6-8a5d-4d1b-9c22-8adab98e1272-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:43:58.427464 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.427429    2568 generic.go:356] "Generic (PLEG): container finished" podID="85ab73c6-8a5d-4d1b-9c22-8adab98e1272" containerID="683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8" exitCode=0
Sep 10 21:43:58.427585 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.427472    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"
Sep 10 21:43:58.427585 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.427518    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88" event={"ID":"85ab73c6-8a5d-4d1b-9c22-8adab98e1272","Type":"ContainerDied","Data":"683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8"}
Sep 10 21:43:58.427585 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.427567    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88" event={"ID":"85ab73c6-8a5d-4d1b-9c22-8adab98e1272","Type":"ContainerDied","Data":"169ab2e213b113043ae6ab4478e235ac99169a52cdf319372fa6fcb13d3cdbc2"}
Sep 10 21:43:58.427693 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.427594    2568 scope.go:117] "RemoveContainer" containerID="683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8"
Sep 10 21:43:58.437861 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.437842    2568 scope.go:117] "RemoveContainer" containerID="683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8"
Sep 10 21:43:58.438131 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:43:58.438113    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8\": container with ID starting with 683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8 not found: ID does not exist" containerID="683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8"
Sep 10 21:43:58.438193 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.438139    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8"} err="failed to get container status \"683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8\": rpc error: code = NotFound desc = could not find container \"683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8\": container with ID starting with 683451fb710012e3ce2aa3a56801cf38e06764433a612ccf56e854513b4f3cd8 not found: ID does not exist"
Sep 10 21:43:58.447486 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.447464    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"]
Sep 10 21:43:58.459583 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:43:58.459560    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4b45c2-7b64f78df7-ppg88"]
Sep 10 21:44:00.197961 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:00.197928    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85ab73c6-8a5d-4d1b-9c22-8adab98e1272" path="/var/lib/kubelet/pods/85ab73c6-8a5d-4d1b-9c22-8adab98e1272/volumes"
Sep 10 21:44:10.326563 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:10.326533    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:44:10.329947 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:10.329923    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:44:15.624113 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.624079    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"]
Sep 10 21:44:15.624697 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.624347    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l" podUID="202ba49a-a413-4ff2-b381-1d5d8bdd124b" containerName="maas-api" containerID="cri-o://6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc" gracePeriod=30
Sep 10 21:44:15.874686 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.874628    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:44:15.918191 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.918165    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/202ba49a-a413-4ff2-b381-1d5d8bdd124b-openshift-service-ca\") pod \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") "
Sep 10 21:44:15.918380 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.918306    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-maas-api-tls\") pod \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") "
Sep 10 21:44:15.918380 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.918353    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-metrics-certs\") pod \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") "
Sep 10 21:44:15.918498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.918412    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6z58\" (UniqueName: \"kubernetes.io/projected/202ba49a-a413-4ff2-b381-1d5d8bdd124b-kube-api-access-x6z58\") pod \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\" (UID: \"202ba49a-a413-4ff2-b381-1d5d8bdd124b\") "
Sep 10 21:44:15.918567 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.918537    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/202ba49a-a413-4ff2-b381-1d5d8bdd124b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "202ba49a-a413-4ff2-b381-1d5d8bdd124b" (UID: "202ba49a-a413-4ff2-b381-1d5d8bdd124b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:44:15.918725 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.918708    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/202ba49a-a413-4ff2-b381-1d5d8bdd124b-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:44:15.920432 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.920405    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "202ba49a-a413-4ff2-b381-1d5d8bdd124b" (UID: "202ba49a-a413-4ff2-b381-1d5d8bdd124b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:44:15.920546 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.920495    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "202ba49a-a413-4ff2-b381-1d5d8bdd124b" (UID: "202ba49a-a413-4ff2-b381-1d5d8bdd124b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:44:15.920546 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:15.920539    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/202ba49a-a413-4ff2-b381-1d5d8bdd124b-kube-api-access-x6z58" (OuterVolumeSpecName: "kube-api-access-x6z58") pod "202ba49a-a413-4ff2-b381-1d5d8bdd124b" (UID: "202ba49a-a413-4ff2-b381-1d5d8bdd124b"). InnerVolumeSpecName "kube-api-access-x6z58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:44:16.019787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.019757    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:44:16.019787 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.019785    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6z58\" (UniqueName: \"kubernetes.io/projected/202ba49a-a413-4ff2-b381-1d5d8bdd124b-kube-api-access-x6z58\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:44:16.019963 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.019796    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/202ba49a-a413-4ff2-b381-1d5d8bdd124b-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:44:16.548651 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.548563    2568 generic.go:356] "Generic (PLEG): container finished" podID="202ba49a-a413-4ff2-b381-1d5d8bdd124b" containerID="6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc" exitCode=0
Sep 10 21:44:16.548651 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.548620    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"
Sep 10 21:44:16.548651 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.548626    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l" event={"ID":"202ba49a-a413-4ff2-b381-1d5d8bdd124b","Type":"ContainerDied","Data":"6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc"}
Sep 10 21:44:16.548929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.548694    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l" event={"ID":"202ba49a-a413-4ff2-b381-1d5d8bdd124b","Type":"ContainerDied","Data":"ed7401b95c1edbacea23ca0236b01fcd4a64d5aed5f5c290a9b747ff5840051d"}
Sep 10 21:44:16.548929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.548725    2568 scope.go:117] "RemoveContainer" containerID="6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc"
Sep 10 21:44:16.559015 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.558984    2568 scope.go:117] "RemoveContainer" containerID="6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc"
Sep 10 21:44:16.559344 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:44:16.559322    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc\": container with ID starting with 6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc not found: ID does not exist" containerID="6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc"
Sep 10 21:44:16.559447 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.559353    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc"} err="failed to get container status \"6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc\": rpc error: code = NotFound desc = could not find container \"6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc\": container with ID starting with 6271812c02501ce29977161d9d2069bb0835e233972747162d488d26edd8dbcc not found: ID does not exist"
Sep 10 21:44:16.566833 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.566811    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"]
Sep 10 21:44:16.572740 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:16.572717    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b4c9bb-57cd6fccfb-7257l"]
Sep 10 21:44:18.196559 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:18.196527    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="202ba49a-a413-4ff2-b381-1d5d8bdd124b" path="/var/lib/kubelet/pods/202ba49a-a413-4ff2-b381-1d5d8bdd124b/volumes"
Sep 10 21:44:32.905146 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905113    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"]
Sep 10 21:44:32.905649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905587    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="202ba49a-a413-4ff2-b381-1d5d8bdd124b" containerName="maas-api"
Sep 10 21:44:32.905649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905603    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="202ba49a-a413-4ff2-b381-1d5d8bdd124b" containerName="maas-api"
Sep 10 21:44:32.905649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905616    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fc6d26-4143-4699-a0b5-85020cc179fb" containerName="maas-api"
Sep 10 21:44:32.905649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905622    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fc6d26-4143-4699-a0b5-85020cc179fb" containerName="maas-api"
Sep 10 21:44:32.905649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905632    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf252d6-d916-4020-a956-c2e8ae85f6a4" containerName="maas-api"
Sep 10 21:44:32.905649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905639    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf252d6-d916-4020-a956-c2e8ae85f6a4" containerName="maas-api"
Sep 10 21:44:32.905649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905647    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f89265-cbd5-46ee-8482-3fa080c7a49c" containerName="test-curl-7555-ed26cc"
Sep 10 21:44:32.905649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905652    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f89265-cbd5-46ee-8482-3fa080c7a49c" containerName="test-curl-7555-ed26cc"
Sep 10 21:44:32.906079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905661    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ab73c6-8a5d-4d1b-9c22-8adab98e1272" containerName="maas-api"
Sep 10 21:44:32.906079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905666    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ab73c6-8a5d-4d1b-9c22-8adab98e1272" containerName="maas-api"
Sep 10 21:44:32.906079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905744    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="22fc6d26-4143-4699-a0b5-85020cc179fb" containerName="maas-api"
Sep 10 21:44:32.906079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905756    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="85ab73c6-8a5d-4d1b-9c22-8adab98e1272" containerName="maas-api"
Sep 10 21:44:32.906079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905764    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="62f89265-cbd5-46ee-8482-3fa080c7a49c" containerName="test-curl-7555-ed26cc"
Sep 10 21:44:32.906079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905772    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="202ba49a-a413-4ff2-b381-1d5d8bdd124b" containerName="maas-api"
Sep 10 21:44:32.906079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.905778    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf252d6-d916-4020-a956-c2e8ae85f6a4" containerName="maas-api"
Sep 10 21:44:32.910439 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.910416    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:32.912678 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.912644    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-8291ef-serving-cert\""
Sep 10 21:44:32.927468 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.927438    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"]
Sep 10 21:44:32.975227 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.975135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl844\" (UniqueName: \"kubernetes.io/projected/a9723afe-bee7-4062-84a5-62eaed7453fc-kube-api-access-sl844\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:32.975227 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.975190    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-metrics-certs\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:32.975387 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.975264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9723afe-bee7-4062-84a5-62eaed7453fc-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:32.975387 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:32.975317    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:33.075998 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:33.075970    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:33.076146 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:33.076025    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl844\" (UniqueName: \"kubernetes.io/projected/a9723afe-bee7-4062-84a5-62eaed7453fc-kube-api-access-sl844\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:33.076146 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:33.076073    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-metrics-certs\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:33.076146 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:44:33.076113    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-serving-cert: secret "maas-api-e2e-ipp-a-8291ef-serving-cert" not found
Sep 10 21:44:33.076146 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:33.076135    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9723afe-bee7-4062-84a5-62eaed7453fc-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:33.076393 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:44:33.076182    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-maas-api-tls podName:a9723afe-bee7-4062-84a5-62eaed7453fc nodeName:}" failed. No retries permitted until 2026-09-10 21:44:33.576165672 +0000 UTC m=+1523.778496232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-maas-api-tls") pod "maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8" (UID: "a9723afe-bee7-4062-84a5-62eaed7453fc") : secret "maas-api-e2e-ipp-a-8291ef-serving-cert" not found
Sep 10 21:44:33.076823 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:33.076802    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9723afe-bee7-4062-84a5-62eaed7453fc-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:33.078527 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:33.078506    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-metrics-certs\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:33.086561 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:33.086542    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl844\" (UniqueName: \"kubernetes.io/projected/a9723afe-bee7-4062-84a5-62eaed7453fc-kube-api-access-sl844\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:33.581899 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:33.581867    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:33.584265 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:33.584239    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:33.826309 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:33.826273    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:34.125658 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:34.125487    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"]
Sep 10 21:44:34.127652 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:44:34.127624    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9723afe_bee7_4062_84a5_62eaed7453fc.slice/crio-cb7512b2fafa3e4d55d73ed6df14bef3210e93deae3fbba7eac3cbb580f775ef WatchSource:0}: Error finding container cb7512b2fafa3e4d55d73ed6df14bef3210e93deae3fbba7eac3cbb580f775ef: Status 404 returned error can't find the container with id cb7512b2fafa3e4d55d73ed6df14bef3210e93deae3fbba7eac3cbb580f775ef
Sep 10 21:44:34.666109 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:34.666079    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8" event={"ID":"a9723afe-bee7-4062-84a5-62eaed7453fc","Type":"ContainerStarted","Data":"76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441"}
Sep 10 21:44:34.666249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:34.666139    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8" event={"ID":"a9723afe-bee7-4062-84a5-62eaed7453fc","Type":"ContainerStarted","Data":"cb7512b2fafa3e4d55d73ed6df14bef3210e93deae3fbba7eac3cbb580f775ef"}
Sep 10 21:44:34.666249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:34.666181    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:44:34.683538 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:34.683492    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8" podStartSLOduration=2.24001006 podStartE2EDuration="2.683476509s" totalImagesPullingTime="443.466449ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:44:34.681755085 +0000 UTC m=+1524.884085669" watchObservedRunningTime="2026-09-10 21:44:34.683476509 +0000 UTC m=+1524.885807081"
Sep 10 21:44:40.678136 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:44:40.678107    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:45:01.455003 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.454968    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"]
Sep 10 21:45:01.459055 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.459033    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:01.462025 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.461833    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-2fbf53-serving-cert\""
Sep 10 21:45:01.473492 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.473467    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"]
Sep 10 21:45:01.526216 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.526167    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:01.526438 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.526264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-metrics-certs\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:01.526438 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.526368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdn9b\" (UniqueName: \"kubernetes.io/projected/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-kube-api-access-sdn9b\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:01.526543 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.526486    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:01.628037 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.628001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:01.628270 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.628064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:01.628270 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.628112    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-metrics-certs\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:01.628270 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:45:01.628150    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-serving-cert: secret "maas-api-e2e-ipp-b-2fbf53-serving-cert" not found
Sep 10 21:45:01.628270 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.628180    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdn9b\" (UniqueName: \"kubernetes.io/projected/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-kube-api-access-sdn9b\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:01.628503 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:45:01.628279    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-maas-api-tls podName:9d8d1e6e-5a13-4001-9018-4037bb8a2f21 nodeName:}" failed. No retries permitted until 2026-09-10 21:45:02.128256218 +0000 UTC m=+1552.330586785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-maas-api-tls") pod "maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v" (UID: "9d8d1e6e-5a13-4001-9018-4037bb8a2f21") : secret "maas-api-e2e-ipp-b-2fbf53-serving-cert" not found
Sep 10 21:45:01.628796 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.628772    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:01.630800 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.630780    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-metrics-certs\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:01.636731 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:01.636711    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdn9b\" (UniqueName: \"kubernetes.io/projected/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-kube-api-access-sdn9b\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:02.132719 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:02.132675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:02.135252 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:02.135221    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:02.371243 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:02.371183    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:02.645308 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:02.645277    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"]
Sep 10 21:45:02.646474 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:45:02.646444    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8d1e6e_5a13_4001_9018_4037bb8a2f21.slice/crio-1dca8a9848c924c90556affa8b9668842c835702f809a0708e0a3d926da52b9e WatchSource:0}: Error finding container 1dca8a9848c924c90556affa8b9668842c835702f809a0708e0a3d926da52b9e: Status 404 returned error can't find the container with id 1dca8a9848c924c90556affa8b9668842c835702f809a0708e0a3d926da52b9e
Sep 10 21:45:02.843644 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:02.843595    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v" event={"ID":"9d8d1e6e-5a13-4001-9018-4037bb8a2f21","Type":"ContainerStarted","Data":"1dca8a9848c924c90556affa8b9668842c835702f809a0708e0a3d926da52b9e"}
Sep 10 21:45:03.852482 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:03.852431    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v" event={"ID":"9d8d1e6e-5a13-4001-9018-4037bb8a2f21","Type":"ContainerStarted","Data":"cc85e34c62e7d2fe8b57dc940842ad46e1e497e24dd753c6cc29674037d51d80"}
Sep 10 21:45:03.852863 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:03.852505    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:03.871614 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:03.871567    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v" podStartSLOduration=2.362619234 podStartE2EDuration="2.871553418s" totalImagesPullingTime="508.934184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:45:03.869648808 +0000 UTC m=+1554.071979380" watchObservedRunningTime="2026-09-10 21:45:03.871553418 +0000 UTC m=+1554.073883990"
Sep 10 21:45:09.865130 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:09.865100    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:45:30.394128 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:45:30.394095    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cpf6d_52436fcb-20bc-42ea-9b32-f232cf2ead71/payload-processing/0.log"
Sep 10 21:46:11.361786 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:11.361703    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cpf6d_52436fcb-20bc-42ea-9b32-f232cf2ead71/payload-processing/0.log"
Sep 10 21:46:16.377631 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.377587    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"]
Sep 10 21:46:16.381572 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.381555    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:16.384145 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.384120    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-bf96d8-serving-cert\""
Sep 10 21:46:16.399951 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.399928    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"]
Sep 10 21:46:16.495649 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.495618    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:16.495877 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.495663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:16.495877 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.495696    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87bde12b-487f-4a2f-8c7a-1cf726505255-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:16.495877 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.495744    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwjs8\" (UniqueName: \"kubernetes.io/projected/87bde12b-487f-4a2f-8c7a-1cf726505255-kube-api-access-pwjs8\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:16.596926 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.596893    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:16.597079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.596937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:16.597079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.596969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87bde12b-487f-4a2f-8c7a-1cf726505255-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:16.597079 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.596994    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwjs8\" (UniqueName: \"kubernetes.io/projected/87bde12b-487f-4a2f-8c7a-1cf726505255-kube-api-access-pwjs8\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:16.597079 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:46:16.597036    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-serving-cert: secret "maas-api-e2e-ipp-cleanup-bf96d8-serving-cert" not found
Sep 10 21:46:16.597267 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:46:16.597110    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-maas-api-tls podName:87bde12b-487f-4a2f-8c7a-1cf726505255 nodeName:}" failed. No retries permitted until 2026-09-10 21:46:17.097094358 +0000 UTC m=+1627.299424908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54" (UID: "87bde12b-487f-4a2f-8c7a-1cf726505255") : secret "maas-api-e2e-ipp-cleanup-bf96d8-serving-cert" not found
Sep 10 21:46:16.597764 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.597735    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87bde12b-487f-4a2f-8c7a-1cf726505255-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:16.599455 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.599434    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:16.610372 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:16.610344    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwjs8\" (UniqueName: \"kubernetes.io/projected/87bde12b-487f-4a2f-8c7a-1cf726505255-kube-api-access-pwjs8\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:17.102104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:17.102069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:17.104526 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:17.104493    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:17.292369 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:17.292334    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:17.590986 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:17.590952    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"]
Sep 10 21:46:17.592631 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:46:17.592600    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87bde12b_487f_4a2f_8c7a_1cf726505255.slice/crio-087326e74ee6602f9198d5f58a1004253a9dc6068b21a29afc9563dba2212f59 WatchSource:0}: Error finding container 087326e74ee6602f9198d5f58a1004253a9dc6068b21a29afc9563dba2212f59: Status 404 returned error can't find the container with id 087326e74ee6602f9198d5f58a1004253a9dc6068b21a29afc9563dba2212f59
Sep 10 21:46:18.340939 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:18.340905    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54" event={"ID":"87bde12b-487f-4a2f-8c7a-1cf726505255","Type":"ContainerStarted","Data":"3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd"}
Sep 10 21:46:18.341126 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:18.340963    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54" event={"ID":"87bde12b-487f-4a2f-8c7a-1cf726505255","Type":"ContainerStarted","Data":"087326e74ee6602f9198d5f58a1004253a9dc6068b21a29afc9563dba2212f59"}
Sep 10 21:46:18.341126 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:18.340984    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:18.364068 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:18.364014    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54" podStartSLOduration=1.907114345 podStartE2EDuration="2.363998706s" totalImagesPullingTime="456.884361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:46:18.363651742 +0000 UTC m=+1628.565982314" watchObservedRunningTime="2026-09-10 21:46:18.363998706 +0000 UTC m=+1628.566329278"
Sep 10 21:46:24.353914 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:24.353885    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:47.064773 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.064738    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"]
Sep 10 21:46:47.065281 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.064982    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54" podUID="87bde12b-487f-4a2f-8c7a-1cf726505255" containerName="maas-api" containerID="cri-o://3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd" gracePeriod=30
Sep 10 21:46:47.322410 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.322355    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:47.374724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.374694    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87bde12b-487f-4a2f-8c7a-1cf726505255-openshift-service-ca\") pod \"87bde12b-487f-4a2f-8c7a-1cf726505255\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") "
Sep 10 21:46:47.374882 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.374787    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwjs8\" (UniqueName: \"kubernetes.io/projected/87bde12b-487f-4a2f-8c7a-1cf726505255-kube-api-access-pwjs8\") pod \"87bde12b-487f-4a2f-8c7a-1cf726505255\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") "
Sep 10 21:46:47.374934 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.374906    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-maas-api-tls\") pod \"87bde12b-487f-4a2f-8c7a-1cf726505255\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") "
Sep 10 21:46:47.374982 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.374955    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-metrics-certs\") pod \"87bde12b-487f-4a2f-8c7a-1cf726505255\" (UID: \"87bde12b-487f-4a2f-8c7a-1cf726505255\") "
Sep 10 21:46:47.375114 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.375093    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87bde12b-487f-4a2f-8c7a-1cf726505255-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "87bde12b-487f-4a2f-8c7a-1cf726505255" (UID: "87bde12b-487f-4a2f-8c7a-1cf726505255"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:46:47.375311 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.375290    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87bde12b-487f-4a2f-8c7a-1cf726505255-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:46:47.377054 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.377016    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "87bde12b-487f-4a2f-8c7a-1cf726505255" (UID: "87bde12b-487f-4a2f-8c7a-1cf726505255"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:46:47.377054 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.377046    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "87bde12b-487f-4a2f-8c7a-1cf726505255" (UID: "87bde12b-487f-4a2f-8c7a-1cf726505255"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:46:47.377429 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.377405    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87bde12b-487f-4a2f-8c7a-1cf726505255-kube-api-access-pwjs8" (OuterVolumeSpecName: "kube-api-access-pwjs8") pod "87bde12b-487f-4a2f-8c7a-1cf726505255" (UID: "87bde12b-487f-4a2f-8c7a-1cf726505255"). InnerVolumeSpecName "kube-api-access-pwjs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:46:47.475926 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.475895    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:46:47.475926 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.475920    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87bde12b-487f-4a2f-8c7a-1cf726505255-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:46:47.475926 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.475930    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwjs8\" (UniqueName: \"kubernetes.io/projected/87bde12b-487f-4a2f-8c7a-1cf726505255-kube-api-access-pwjs8\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:46:47.523565 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.523529    2568 generic.go:356] "Generic (PLEG): container finished" podID="87bde12b-487f-4a2f-8c7a-1cf726505255" containerID="3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd" exitCode=0
Sep 10 21:46:47.523724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.523577    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"
Sep 10 21:46:47.523724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.523583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54" event={"ID":"87bde12b-487f-4a2f-8c7a-1cf726505255","Type":"ContainerDied","Data":"3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd"}
Sep 10 21:46:47.523724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.523636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54" event={"ID":"87bde12b-487f-4a2f-8c7a-1cf726505255","Type":"ContainerDied","Data":"087326e74ee6602f9198d5f58a1004253a9dc6068b21a29afc9563dba2212f59"}
Sep 10 21:46:47.523724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.523666    2568 scope.go:117] "RemoveContainer" containerID="3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd"
Sep 10 21:46:47.534393 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.534375    2568 scope.go:117] "RemoveContainer" containerID="3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd"
Sep 10 21:46:47.534660 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:46:47.534641    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd\": container with ID starting with 3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd not found: ID does not exist" containerID="3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd"
Sep 10 21:46:47.534732 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.534675    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd"} err="failed to get container status \"3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd\": rpc error: code = NotFound desc = could not find container \"3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd\": container with ID starting with 3a1cec8344c761568882e4d83dc8ebc02128b7e8dcf09f008f6c447c3d9aa9fd not found: ID does not exist"
Sep 10 21:46:47.547992 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.547959    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"]
Sep 10 21:46:47.554093 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:47.554060    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-bf96d8-dc7b4df49-8xj54"]
Sep 10 21:46:48.197749 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:46:48.197711    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87bde12b-487f-4a2f-8c7a-1cf726505255" path="/var/lib/kubelet/pods/87bde12b-487f-4a2f-8c7a-1cf726505255/volumes"
Sep 10 21:47:33.514350 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.513078    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"]
Sep 10 21:47:33.514350 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.513331    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8" podUID="a9723afe-bee7-4062-84a5-62eaed7453fc" containerName="maas-api" containerID="cri-o://76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441" gracePeriod=30
Sep 10 21:47:33.770038 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.769968    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:47:33.815214 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.815170    2568 generic.go:356] "Generic (PLEG): container finished" podID="a9723afe-bee7-4062-84a5-62eaed7453fc" containerID="76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441" exitCode=0
Sep 10 21:47:33.815363 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.815251    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"
Sep 10 21:47:33.815363 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.815259    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8" event={"ID":"a9723afe-bee7-4062-84a5-62eaed7453fc","Type":"ContainerDied","Data":"76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441"}
Sep 10 21:47:33.815363 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.815316    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8" event={"ID":"a9723afe-bee7-4062-84a5-62eaed7453fc","Type":"ContainerDied","Data":"cb7512b2fafa3e4d55d73ed6df14bef3210e93deae3fbba7eac3cbb580f775ef"}
Sep 10 21:47:33.815363 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.815340    2568 scope.go:117] "RemoveContainer" containerID="76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441"
Sep 10 21:47:33.825614 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.825592    2568 scope.go:117] "RemoveContainer" containerID="76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441"
Sep 10 21:47:33.825902 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:47:33.825874    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441\": container with ID starting with 76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441 not found: ID does not exist" containerID="76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441"
Sep 10 21:47:33.825962 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.825913    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441"} err="failed to get container status \"76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441\": rpc error: code = NotFound desc = could not find container \"76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441\": container with ID starting with 76cba026644b2b3e80904433bb01d156456e81cc54a1142685f691bd25538441 not found: ID does not exist"
Sep 10 21:47:33.878791 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.878767    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-metrics-certs\") pod \"a9723afe-bee7-4062-84a5-62eaed7453fc\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") "
Sep 10 21:47:33.878950 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.878904    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl844\" (UniqueName: \"kubernetes.io/projected/a9723afe-bee7-4062-84a5-62eaed7453fc-kube-api-access-sl844\") pod \"a9723afe-bee7-4062-84a5-62eaed7453fc\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") "
Sep 10 21:47:33.879026 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.878954    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-maas-api-tls\") pod \"a9723afe-bee7-4062-84a5-62eaed7453fc\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") "
Sep 10 21:47:33.879026 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.878984    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9723afe-bee7-4062-84a5-62eaed7453fc-openshift-service-ca\") pod \"a9723afe-bee7-4062-84a5-62eaed7453fc\" (UID: \"a9723afe-bee7-4062-84a5-62eaed7453fc\") "
Sep 10 21:47:33.879665 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.879635    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9723afe-bee7-4062-84a5-62eaed7453fc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a9723afe-bee7-4062-84a5-62eaed7453fc" (UID: "a9723afe-bee7-4062-84a5-62eaed7453fc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:47:33.880887 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.880860    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a9723afe-bee7-4062-84a5-62eaed7453fc" (UID: "a9723afe-bee7-4062-84a5-62eaed7453fc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:47:33.881062 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.881046    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9723afe-bee7-4062-84a5-62eaed7453fc-kube-api-access-sl844" (OuterVolumeSpecName: "kube-api-access-sl844") pod "a9723afe-bee7-4062-84a5-62eaed7453fc" (UID: "a9723afe-bee7-4062-84a5-62eaed7453fc"). InnerVolumeSpecName "kube-api-access-sl844". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:47:33.881490 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.881460    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a9723afe-bee7-4062-84a5-62eaed7453fc" (UID: "a9723afe-bee7-4062-84a5-62eaed7453fc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:47:33.979746 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.979719    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl844\" (UniqueName: \"kubernetes.io/projected/a9723afe-bee7-4062-84a5-62eaed7453fc-kube-api-access-sl844\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:47:33.979746 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.979745    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:47:33.979908 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.979755    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9723afe-bee7-4062-84a5-62eaed7453fc-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:47:33.979908 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:33.979763    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9723afe-bee7-4062-84a5-62eaed7453fc-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:47:34.140454 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:34.140428    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"]
Sep 10 21:47:34.144773 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:34.144747    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8291ef-759cb9c8db-v5lk8"]
Sep 10 21:47:34.197061 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:47:34.197032    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9723afe-bee7-4062-84a5-62eaed7453fc" path="/var/lib/kubelet/pods/a9723afe-bee7-4062-84a5-62eaed7453fc/volumes"
Sep 10 21:48:33.064497 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.064460    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"]
Sep 10 21:48:33.065070 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.064701    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v" podUID="9d8d1e6e-5a13-4001-9018-4037bb8a2f21" containerName="maas-api" containerID="cri-o://cc85e34c62e7d2fe8b57dc940842ad46e1e497e24dd753c6cc29674037d51d80" gracePeriod=30
Sep 10 21:48:33.216774 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.216742    2568 generic.go:356] "Generic (PLEG): container finished" podID="9d8d1e6e-5a13-4001-9018-4037bb8a2f21" containerID="cc85e34c62e7d2fe8b57dc940842ad46e1e497e24dd753c6cc29674037d51d80" exitCode=0
Sep 10 21:48:33.216917 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.216811    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v" event={"ID":"9d8d1e6e-5a13-4001-9018-4037bb8a2f21","Type":"ContainerDied","Data":"cc85e34c62e7d2fe8b57dc940842ad46e1e497e24dd753c6cc29674037d51d80"}
Sep 10 21:48:33.324409 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.324356    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:48:33.395894 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.395863    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-maas-api-tls\") pod \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") "
Sep 10 21:48:33.396030 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.395923    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdn9b\" (UniqueName: \"kubernetes.io/projected/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-kube-api-access-sdn9b\") pod \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") "
Sep 10 21:48:33.396030 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.395980    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-metrics-certs\") pod \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") "
Sep 10 21:48:33.396030 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.396002    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-openshift-service-ca\") pod \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\" (UID: \"9d8d1e6e-5a13-4001-9018-4037bb8a2f21\") "
Sep 10 21:48:33.396570 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.396433    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9d8d1e6e-5a13-4001-9018-4037bb8a2f21" (UID: "9d8d1e6e-5a13-4001-9018-4037bb8a2f21"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:48:33.398035 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.398006    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9d8d1e6e-5a13-4001-9018-4037bb8a2f21" (UID: "9d8d1e6e-5a13-4001-9018-4037bb8a2f21"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:48:33.398171 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.398030    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9d8d1e6e-5a13-4001-9018-4037bb8a2f21" (UID: "9d8d1e6e-5a13-4001-9018-4037bb8a2f21"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:48:33.398536 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.398511    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-kube-api-access-sdn9b" (OuterVolumeSpecName: "kube-api-access-sdn9b") pod "9d8d1e6e-5a13-4001-9018-4037bb8a2f21" (UID: "9d8d1e6e-5a13-4001-9018-4037bb8a2f21"). InnerVolumeSpecName "kube-api-access-sdn9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:48:33.497603 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.497573    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:48:33.497603 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.497598    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:48:33.497603 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.497608    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:48:33.497807 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:33.497619    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdn9b\" (UniqueName: \"kubernetes.io/projected/9d8d1e6e-5a13-4001-9018-4037bb8a2f21-kube-api-access-sdn9b\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:48:34.228060 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:34.228033    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"
Sep 10 21:48:34.228499 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:34.228075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v" event={"ID":"9d8d1e6e-5a13-4001-9018-4037bb8a2f21","Type":"ContainerDied","Data":"1dca8a9848c924c90556affa8b9668842c835702f809a0708e0a3d926da52b9e"}
Sep 10 21:48:34.228499 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:34.228143    2568 scope.go:117] "RemoveContainer" containerID="cc85e34c62e7d2fe8b57dc940842ad46e1e497e24dd753c6cc29674037d51d80"
Sep 10 21:48:34.246721 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:34.246698    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"]
Sep 10 21:48:34.252245 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:34.252222    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2fbf53-6bddfdb4b-4jv2v"]
Sep 10 21:48:36.197360 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:48:36.197325    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d8d1e6e-5a13-4001-9018-4037bb8a2f21" path="/var/lib/kubelet/pods/9d8d1e6e-5a13-4001-9018-4037bb8a2f21/volumes"
Sep 10 21:49:08.517502 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.517465    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"]
Sep 10 21:49:08.518088 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.517728    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62" podUID="4b6c3c06-6236-4c34-b6ad-466dbf581cfb" containerName="maas-api" containerID="cri-o://51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb" gracePeriod=30
Sep 10 21:49:08.782326 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.782235    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:49:08.896319 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.896288    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-maas-api-tls\") pod \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") "
Sep 10 21:49:08.896498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.896361    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-openshift-service-ca\") pod \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") "
Sep 10 21:49:08.896498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.896483    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8vj6\" (UniqueName: \"kubernetes.io/projected/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-kube-api-access-m8vj6\") pod \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") "
Sep 10 21:49:08.896623 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.896511    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-metrics-certs\") pod \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\" (UID: \"4b6c3c06-6236-4c34-b6ad-466dbf581cfb\") "
Sep 10 21:49:08.896775 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.896739    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b6c3c06-6236-4c34-b6ad-466dbf581cfb" (UID: "4b6c3c06-6236-4c34-b6ad-466dbf581cfb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:49:08.896877 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.896859    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:49:08.898443 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.898409    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b6c3c06-6236-4c34-b6ad-466dbf581cfb" (UID: "4b6c3c06-6236-4c34-b6ad-466dbf581cfb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:49:08.898573 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.898506    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4b6c3c06-6236-4c34-b6ad-466dbf581cfb" (UID: "4b6c3c06-6236-4c34-b6ad-466dbf581cfb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:49:08.898573 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.898556    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-kube-api-access-m8vj6" (OuterVolumeSpecName: "kube-api-access-m8vj6") pod "4b6c3c06-6236-4c34-b6ad-466dbf581cfb" (UID: "4b6c3c06-6236-4c34-b6ad-466dbf581cfb"). InnerVolumeSpecName "kube-api-access-m8vj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:49:08.998069 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.998032    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8vj6\" (UniqueName: \"kubernetes.io/projected/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-kube-api-access-m8vj6\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:49:08.998069 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.998065    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:49:08.998297 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:08.998078    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6c3c06-6236-4c34-b6ad-466dbf581cfb-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:49:09.440984 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:09.440947    2568 generic.go:356] "Generic (PLEG): container finished" podID="4b6c3c06-6236-4c34-b6ad-466dbf581cfb" containerID="51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb" exitCode=0
Sep 10 21:49:09.441156 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:09.440992    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"
Sep 10 21:49:09.441156 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:09.441035    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62" event={"ID":"4b6c3c06-6236-4c34-b6ad-466dbf581cfb","Type":"ContainerDied","Data":"51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb"}
Sep 10 21:49:09.441156 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:09.441093    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62" event={"ID":"4b6c3c06-6236-4c34-b6ad-466dbf581cfb","Type":"ContainerDied","Data":"cf2a6298ca7b55c13de5d146343f810b8123c9f15e58fcae1b5706b68688ba17"}
Sep 10 21:49:09.441156 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:09.441121    2568 scope.go:117] "RemoveContainer" containerID="51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb"
Sep 10 21:49:09.451646 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:09.451621    2568 scope.go:117] "RemoveContainer" containerID="51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb"
Sep 10 21:49:09.451958 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:49:09.451928    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb\": container with ID starting with 51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb not found: ID does not exist" containerID="51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb"
Sep 10 21:49:09.452077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:09.451968    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb"} err="failed to get container status \"51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb\": rpc error: code = NotFound desc = could not find container \"51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb\": container with ID starting with 51127d8b81888d1e45a75ea7ded377e32ec6d3229d036844a914741d6b3a69eb not found: ID does not exist"
Sep 10 21:49:09.463680 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:09.463654    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"]
Sep 10 21:49:09.469024 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:09.469004    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-67d5e2-75998c967b-rrs62"]
Sep 10 21:49:10.196985 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:10.196955    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6c3c06-6236-4c34-b6ad-466dbf581cfb" path="/var/lib/kubelet/pods/4b6c3c06-6236-4c34-b6ad-466dbf581cfb/volumes"
Sep 10 21:49:10.369462 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:10.369348    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:49:10.386107 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:10.374301    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:49:28.133948 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.133912    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xqn7k"]
Sep 10 21:49:28.134483 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.134141    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k" podUID="00575fdf-7fba-413c-9f6f-5567d2a1139e" containerName="manager" containerID="cri-o://8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5" gracePeriod=30
Sep 10 21:49:28.385314 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.385260    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:49:28.470676 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.470649    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mcrm\" (UniqueName: \"kubernetes.io/projected/00575fdf-7fba-413c-9f6f-5567d2a1139e-kube-api-access-8mcrm\") pod \"00575fdf-7fba-413c-9f6f-5567d2a1139e\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") "
Sep 10 21:49:28.470856 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.470706    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-webhook-cert\") pod \"00575fdf-7fba-413c-9f6f-5567d2a1139e\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") "
Sep 10 21:49:28.470856 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.470776    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-metrics-certs\") pod \"00575fdf-7fba-413c-9f6f-5567d2a1139e\" (UID: \"00575fdf-7fba-413c-9f6f-5567d2a1139e\") "
Sep 10 21:49:28.472556 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.472530    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00575fdf-7fba-413c-9f6f-5567d2a1139e-kube-api-access-8mcrm" (OuterVolumeSpecName: "kube-api-access-8mcrm") pod "00575fdf-7fba-413c-9f6f-5567d2a1139e" (UID: "00575fdf-7fba-413c-9f6f-5567d2a1139e"). InnerVolumeSpecName "kube-api-access-8mcrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:49:28.472692 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.472606    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "00575fdf-7fba-413c-9f6f-5567d2a1139e" (UID: "00575fdf-7fba-413c-9f6f-5567d2a1139e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:49:28.472757 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.472690    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "00575fdf-7fba-413c-9f6f-5567d2a1139e" (UID: "00575fdf-7fba-413c-9f6f-5567d2a1139e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:49:28.565105 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.565076    2568 generic.go:356] "Generic (PLEG): container finished" podID="00575fdf-7fba-413c-9f6f-5567d2a1139e" containerID="8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5" exitCode=0
Sep 10 21:49:28.565267 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.565117    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k" event={"ID":"00575fdf-7fba-413c-9f6f-5567d2a1139e","Type":"ContainerDied","Data":"8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5"}
Sep 10 21:49:28.565267 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.565130    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k"
Sep 10 21:49:28.565267 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.565177    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b484dfdf9-xqn7k" event={"ID":"00575fdf-7fba-413c-9f6f-5567d2a1139e","Type":"ContainerDied","Data":"fdfc6f1c6ffc33b5fb6ad5100d0e88ae439f29675b7d169a36b5ddd69c48a269"}
Sep 10 21:49:28.565267 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.565219    2568 scope.go:117] "RemoveContainer" containerID="8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5"
Sep 10 21:49:28.572020 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.571999    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mcrm\" (UniqueName: \"kubernetes.io/projected/00575fdf-7fba-413c-9f6f-5567d2a1139e-kube-api-access-8mcrm\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:49:28.572121 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.572022    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-webhook-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:49:28.572121 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.572036    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00575fdf-7fba-413c-9f6f-5567d2a1139e-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:49:28.575474 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.575459    2568 scope.go:117] "RemoveContainer" containerID="8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5"
Sep 10 21:49:28.575740 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:49:28.575722    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5\": container with ID starting with 8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5 not found: ID does not exist" containerID="8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5"
Sep 10 21:49:28.575813 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.575751    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5"} err="failed to get container status \"8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5\": rpc error: code = NotFound desc = could not find container \"8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5\": container with ID starting with 8a1240cd9c4d3f64281d8e5c13211e5743a3dbde2cefaf92db89d809696256e5 not found: ID does not exist"
Sep 10 21:49:28.587170 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.587148    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xqn7k"]
Sep 10 21:49:28.590398 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:28.590378    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xqn7k"]
Sep 10 21:49:30.199505 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:49:30.199467    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00575fdf-7fba-413c-9f6f-5567d2a1139e" path="/var/lib/kubelet/pods/00575fdf-7fba-413c-9f6f-5567d2a1139e/volumes"
Sep 10 21:50:29.433135 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433094    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xm4dk"]
Sep 10 21:50:29.433751 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433731    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9723afe-bee7-4062-84a5-62eaed7453fc" containerName="maas-api"
Sep 10 21:50:29.433816 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433754    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9723afe-bee7-4062-84a5-62eaed7453fc" containerName="maas-api"
Sep 10 21:50:29.433816 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433788    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6c3c06-6236-4c34-b6ad-466dbf581cfb" containerName="maas-api"
Sep 10 21:50:29.433816 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433797    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6c3c06-6236-4c34-b6ad-466dbf581cfb" containerName="maas-api"
Sep 10 21:50:29.433816 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433807    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00575fdf-7fba-413c-9f6f-5567d2a1139e" containerName="manager"
Sep 10 21:50:29.433960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433816    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00575fdf-7fba-413c-9f6f-5567d2a1139e" containerName="manager"
Sep 10 21:50:29.433960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433827    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87bde12b-487f-4a2f-8c7a-1cf726505255" containerName="maas-api"
Sep 10 21:50:29.433960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433836    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="87bde12b-487f-4a2f-8c7a-1cf726505255" containerName="maas-api"
Sep 10 21:50:29.433960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433852    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8d1e6e-5a13-4001-9018-4037bb8a2f21" containerName="maas-api"
Sep 10 21:50:29.433960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433860    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8d1e6e-5a13-4001-9018-4037bb8a2f21" containerName="maas-api"
Sep 10 21:50:29.433960 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433958    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9723afe-bee7-4062-84a5-62eaed7453fc" containerName="maas-api"
Sep 10 21:50:29.434155 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433968    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8d1e6e-5a13-4001-9018-4037bb8a2f21" containerName="maas-api"
Sep 10 21:50:29.434155 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433975    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="00575fdf-7fba-413c-9f6f-5567d2a1139e" containerName="manager"
Sep 10 21:50:29.434155 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433983    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="87bde12b-487f-4a2f-8c7a-1cf726505255" containerName="maas-api"
Sep 10 21:50:29.434155 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.433990    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6c3c06-6236-4c34-b6ad-466dbf581cfb" containerName="maas-api"
Sep 10 21:50:29.437305 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.437280    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:29.441002 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.440977    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 21:50:29.441002 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.440997    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 21:50:29.441191 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.441022    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 21:50:29.441191 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.441001    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wqmn5\""
Sep 10 21:50:29.450001 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.449979    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xm4dk"]
Sep 10 21:50:29.584993 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.584962    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-metrics-certs\") pod \"maas-controller-6b484dfdf9-xm4dk\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") " pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:29.585142 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.585078    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-webhook-cert\") pod \"maas-controller-6b484dfdf9-xm4dk\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") " pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:29.585142 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.585118    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnbw2\" (UniqueName: \"kubernetes.io/projected/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-kube-api-access-fnbw2\") pod \"maas-controller-6b484dfdf9-xm4dk\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") " pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:29.686138 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.686077    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-metrics-certs\") pod \"maas-controller-6b484dfdf9-xm4dk\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") " pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:29.686138 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.686132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-webhook-cert\") pod \"maas-controller-6b484dfdf9-xm4dk\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") " pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:29.686312 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.686164    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnbw2\" (UniqueName: \"kubernetes.io/projected/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-kube-api-access-fnbw2\") pod \"maas-controller-6b484dfdf9-xm4dk\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") " pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:29.688430 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.688410    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-metrics-certs\") pod \"maas-controller-6b484dfdf9-xm4dk\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") " pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:29.688531 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.688479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-webhook-cert\") pod \"maas-controller-6b484dfdf9-xm4dk\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") " pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:29.696064 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.696042    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnbw2\" (UniqueName: \"kubernetes.io/projected/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-kube-api-access-fnbw2\") pod \"maas-controller-6b484dfdf9-xm4dk\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") " pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:29.748329 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:29.748308    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:30.023312 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:30.023282    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xm4dk"]
Sep 10 21:50:30.024482 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:50:30.024455    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451d6659_8a65_4b2b_82d2_6cf63c14ecdd.slice/crio-a1e01ba56a3fbbf77fc96e2aa8cd5d556329c310c8145cb42b66410dcb6aa462 WatchSource:0}: Error finding container a1e01ba56a3fbbf77fc96e2aa8cd5d556329c310c8145cb42b66410dcb6aa462: Status 404 returned error can't find the container with id a1e01ba56a3fbbf77fc96e2aa8cd5d556329c310c8145cb42b66410dcb6aa462
Sep 10 21:50:30.026163 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:30.026141    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:50:30.939547 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:30.939459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk" event={"ID":"451d6659-8a65-4b2b-82d2-6cf63c14ecdd","Type":"ContainerStarted","Data":"f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091"}
Sep 10 21:50:30.939547 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:30.939520    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk" event={"ID":"451d6659-8a65-4b2b-82d2-6cf63c14ecdd","Type":"ContainerStarted","Data":"a1e01ba56a3fbbf77fc96e2aa8cd5d556329c310c8145cb42b66410dcb6aa462"}
Sep 10 21:50:30.940059 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:30.939616    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:30.957959 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:30.957918    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk" podStartSLOduration=1.42594049 podStartE2EDuration="1.95790635s" totalImagesPullingTime="531.96586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:50:30.956492361 +0000 UTC m=+1881.158822948" watchObservedRunningTime="2026-09-10 21:50:30.95790635 +0000 UTC m=+1881.160236922"
Sep 10 21:50:41.949249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:41.949146    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:51.274378 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.274340    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xm4dk"]
Sep 10 21:50:51.274840 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.274559    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk" podUID="451d6659-8a65-4b2b-82d2-6cf63c14ecdd" containerName="manager" containerID="cri-o://f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091" gracePeriod=30
Sep 10 21:50:51.522574 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.522548    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:51.571038 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.571011    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnbw2\" (UniqueName: \"kubernetes.io/projected/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-kube-api-access-fnbw2\") pod \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") "
Sep 10 21:50:51.571217 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.571088    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-metrics-certs\") pod \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") "
Sep 10 21:50:51.571217 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.571144    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-webhook-cert\") pod \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\" (UID: \"451d6659-8a65-4b2b-82d2-6cf63c14ecdd\") "
Sep 10 21:50:51.573312 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.573280    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "451d6659-8a65-4b2b-82d2-6cf63c14ecdd" (UID: "451d6659-8a65-4b2b-82d2-6cf63c14ecdd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:50:51.573666 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.573637    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "451d6659-8a65-4b2b-82d2-6cf63c14ecdd" (UID: "451d6659-8a65-4b2b-82d2-6cf63c14ecdd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:50:51.573762 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.573664    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-kube-api-access-fnbw2" (OuterVolumeSpecName: "kube-api-access-fnbw2") pod "451d6659-8a65-4b2b-82d2-6cf63c14ecdd" (UID: "451d6659-8a65-4b2b-82d2-6cf63c14ecdd"). InnerVolumeSpecName "kube-api-access-fnbw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:50:51.672409 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.672369    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:50:51.672409 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.672409    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-webhook-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:50:51.672594 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:51.672423    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnbw2\" (UniqueName: \"kubernetes.io/projected/451d6659-8a65-4b2b-82d2-6cf63c14ecdd-kube-api-access-fnbw2\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:50:52.076636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.076591    2568 generic.go:356] "Generic (PLEG): container finished" podID="451d6659-8a65-4b2b-82d2-6cf63c14ecdd" containerID="f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091" exitCode=0
Sep 10 21:50:52.076636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.076632    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk"
Sep 10 21:50:52.076926 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.076642    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk" event={"ID":"451d6659-8a65-4b2b-82d2-6cf63c14ecdd","Type":"ContainerDied","Data":"f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091"}
Sep 10 21:50:52.076926 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.076704    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b484dfdf9-xm4dk" event={"ID":"451d6659-8a65-4b2b-82d2-6cf63c14ecdd","Type":"ContainerDied","Data":"a1e01ba56a3fbbf77fc96e2aa8cd5d556329c310c8145cb42b66410dcb6aa462"}
Sep 10 21:50:52.076926 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.076738    2568 scope.go:117] "RemoveContainer" containerID="f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091"
Sep 10 21:50:52.089959 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.089933    2568 scope.go:117] "RemoveContainer" containerID="f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091"
Sep 10 21:50:52.090308 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:50:52.090282    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091\": container with ID starting with f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091 not found: ID does not exist" containerID="f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091"
Sep 10 21:50:52.090378 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.090316    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091"} err="failed to get container status \"f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091\": rpc error: code = NotFound desc = could not find container \"f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091\": container with ID starting with f69873405b957a033fe70742fe026da3461b22def249a1856fcf95d7116f0091 not found: ID does not exist"
Sep 10 21:50:52.103291 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.103264    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xm4dk"]
Sep 10 21:50:52.105774 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.105755    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-xm4dk"]
Sep 10 21:50:52.197062 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.197033    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="451d6659-8a65-4b2b-82d2-6cf63c14ecdd" path="/var/lib/kubelet/pods/451d6659-8a65-4b2b-82d2-6cf63c14ecdd/volumes"
Sep 10 21:50:52.875249 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.875208    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-9r2x7"]
Sep 10 21:50:52.875839 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.875818    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="451d6659-8a65-4b2b-82d2-6cf63c14ecdd" containerName="manager"
Sep 10 21:50:52.875931 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.875841    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="451d6659-8a65-4b2b-82d2-6cf63c14ecdd" containerName="manager"
Sep 10 21:50:52.876013 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.876001    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="451d6659-8a65-4b2b-82d2-6cf63c14ecdd" containerName="manager"
Sep 10 21:50:52.879346 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.879323    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:52.882695 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.882668    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 21:50:52.882836 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.882669    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wqmn5\""
Sep 10 21:50:52.882836 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.882669    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 21:50:52.882836 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.882707    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 21:50:52.889917 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.889894    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-9r2x7"]
Sep 10 21:50:52.983903 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.983860    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11f016ea-06ca-43ac-a7c5-ba17ff10a99e-webhook-cert\") pod \"maas-controller-6b484dfdf9-9r2x7\" (UID: \"11f016ea-06ca-43ac-a7c5-ba17ff10a99e\") " pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:52.984104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.984006    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdhbv\" (UniqueName: \"kubernetes.io/projected/11f016ea-06ca-43ac-a7c5-ba17ff10a99e-kube-api-access-wdhbv\") pod \"maas-controller-6b484dfdf9-9r2x7\" (UID: \"11f016ea-06ca-43ac-a7c5-ba17ff10a99e\") " pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:52.984104 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:52.984088    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f016ea-06ca-43ac-a7c5-ba17ff10a99e-metrics-certs\") pod \"maas-controller-6b484dfdf9-9r2x7\" (UID: \"11f016ea-06ca-43ac-a7c5-ba17ff10a99e\") " pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:53.085397 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:53.085363    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdhbv\" (UniqueName: \"kubernetes.io/projected/11f016ea-06ca-43ac-a7c5-ba17ff10a99e-kube-api-access-wdhbv\") pod \"maas-controller-6b484dfdf9-9r2x7\" (UID: \"11f016ea-06ca-43ac-a7c5-ba17ff10a99e\") " pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:53.085567 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:53.085426    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f016ea-06ca-43ac-a7c5-ba17ff10a99e-metrics-certs\") pod \"maas-controller-6b484dfdf9-9r2x7\" (UID: \"11f016ea-06ca-43ac-a7c5-ba17ff10a99e\") " pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:53.085567 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:53.085464    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11f016ea-06ca-43ac-a7c5-ba17ff10a99e-webhook-cert\") pod \"maas-controller-6b484dfdf9-9r2x7\" (UID: \"11f016ea-06ca-43ac-a7c5-ba17ff10a99e\") " pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:53.087933 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:53.087909    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f016ea-06ca-43ac-a7c5-ba17ff10a99e-metrics-certs\") pod \"maas-controller-6b484dfdf9-9r2x7\" (UID: \"11f016ea-06ca-43ac-a7c5-ba17ff10a99e\") " pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:53.088055 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:53.087938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11f016ea-06ca-43ac-a7c5-ba17ff10a99e-webhook-cert\") pod \"maas-controller-6b484dfdf9-9r2x7\" (UID: \"11f016ea-06ca-43ac-a7c5-ba17ff10a99e\") " pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:53.092859 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:53.092835    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdhbv\" (UniqueName: \"kubernetes.io/projected/11f016ea-06ca-43ac-a7c5-ba17ff10a99e-kube-api-access-wdhbv\") pod \"maas-controller-6b484dfdf9-9r2x7\" (UID: \"11f016ea-06ca-43ac-a7c5-ba17ff10a99e\") " pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:53.192032 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:53.191957    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:53.467821 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:53.467797    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b484dfdf9-9r2x7"]
Sep 10 21:50:53.469644 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:50:53.469613    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f016ea_06ca_43ac_a7c5_ba17ff10a99e.slice/crio-7fd7670dabc570351d93a910292ae4ce890fe3e4249a6a86046603c034046aa9 WatchSource:0}: Error finding container 7fd7670dabc570351d93a910292ae4ce890fe3e4249a6a86046603c034046aa9: Status 404 returned error can't find the container with id 7fd7670dabc570351d93a910292ae4ce890fe3e4249a6a86046603c034046aa9
Sep 10 21:50:54.092298 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:54.092219    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b484dfdf9-9r2x7" event={"ID":"11f016ea-06ca-43ac-a7c5-ba17ff10a99e","Type":"ContainerStarted","Data":"7a1c25d22342d893e7e85debbf60155c07b27f3f10f7dc0e4e7940664de56178"}
Sep 10 21:50:54.092298 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:54.092267    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b484dfdf9-9r2x7" event={"ID":"11f016ea-06ca-43ac-a7c5-ba17ff10a99e","Type":"ContainerStarted","Data":"7fd7670dabc570351d93a910292ae4ce890fe3e4249a6a86046603c034046aa9"}
Sep 10 21:50:54.092298 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:54.092290    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:50:54.111110 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:50:54.111061    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b484dfdf9-9r2x7" podStartSLOduration=1.743193414 podStartE2EDuration="2.111046395s" totalImagesPullingTime="367.852981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:50:54.108984961 +0000 UTC m=+1904.311315532" watchObservedRunningTime="2026-09-10 21:50:54.111046395 +0000 UTC m=+1904.313376991"
Sep 10 21:51:05.100547 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:05.100514    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b484dfdf9-9r2x7"
Sep 10 21:51:58.057418 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:58.057379    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"]
Sep 10 21:51:58.057880 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:58.057680    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw" podUID="dc890ab7-b699-46d5-b6c2-f52108484609" containerName="manager" containerID="cri-o://6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a" gracePeriod=10
Sep 10 21:51:59.108885 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.108861    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:51:59.287010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.286927    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hppbf\" (UniqueName: \"kubernetes.io/projected/dc890ab7-b699-46d5-b6c2-f52108484609-kube-api-access-hppbf\") pod \"dc890ab7-b699-46d5-b6c2-f52108484609\" (UID: \"dc890ab7-b699-46d5-b6c2-f52108484609\") "
Sep 10 21:51:59.287010 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.286967    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc890ab7-b699-46d5-b6c2-f52108484609-extensions-socket-volume\") pod \"dc890ab7-b699-46d5-b6c2-f52108484609\" (UID: \"dc890ab7-b699-46d5-b6c2-f52108484609\") "
Sep 10 21:51:59.287371 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.287350    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc890ab7-b699-46d5-b6c2-f52108484609-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dc890ab7-b699-46d5-b6c2-f52108484609" (UID: "dc890ab7-b699-46d5-b6c2-f52108484609"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:51:59.288912 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.288892    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc890ab7-b699-46d5-b6c2-f52108484609-kube-api-access-hppbf" (OuterVolumeSpecName: "kube-api-access-hppbf") pod "dc890ab7-b699-46d5-b6c2-f52108484609" (UID: "dc890ab7-b699-46d5-b6c2-f52108484609"). InnerVolumeSpecName "kube-api-access-hppbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:51:59.388442 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.388416    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc890ab7-b699-46d5-b6c2-f52108484609-extensions-socket-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:51:59.388442 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.388439    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hppbf\" (UniqueName: \"kubernetes.io/projected/dc890ab7-b699-46d5-b6c2-f52108484609-kube-api-access-hppbf\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:51:59.487940 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.487911    2568 generic.go:356] "Generic (PLEG): container finished" podID="dc890ab7-b699-46d5-b6c2-f52108484609" containerID="6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a" exitCode=0
Sep 10 21:51:59.488057 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.487945    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw" event={"ID":"dc890ab7-b699-46d5-b6c2-f52108484609","Type":"ContainerDied","Data":"6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a"}
Sep 10 21:51:59.488057 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.487997    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw" event={"ID":"dc890ab7-b699-46d5-b6c2-f52108484609","Type":"ContainerDied","Data":"126cc77740c1c3c3bbd53f350cbb1c1174f0209d0dfa6d13a513cd4146f4e54c"}
Sep 10 21:51:59.488057 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.487953    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"
Sep 10 21:51:59.488057 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.488018    2568 scope.go:117] "RemoveContainer" containerID="6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a"
Sep 10 21:51:59.497920 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.497902    2568 scope.go:117] "RemoveContainer" containerID="6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a"
Sep 10 21:51:59.498154 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:51:59.498135    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a\": container with ID starting with 6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a not found: ID does not exist" containerID="6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a"
Sep 10 21:51:59.498232 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.498166    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a"} err="failed to get container status \"6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a\": rpc error: code = NotFound desc = could not find container \"6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a\": container with ID starting with 6dd0d9fc30e951b24faa8a3611f372c73d1e37e2f047fbddcb88d8a63d08009a not found: ID does not exist"
Sep 10 21:51:59.510723 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.510697    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"]
Sep 10 21:51:59.514883 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:51:59.514862    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n7vxw"]
Sep 10 21:52:00.197443 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:00.197414    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc890ab7-b699-46d5-b6c2-f52108484609" path="/var/lib/kubelet/pods/dc890ab7-b699-46d5-b6c2-f52108484609/volumes"
Sep 10 21:52:58.753081 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.753046    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"]
Sep 10 21:52:58.753553 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.753538    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc890ab7-b699-46d5-b6c2-f52108484609" containerName="manager"
Sep 10 21:52:58.753600 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.753557    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc890ab7-b699-46d5-b6c2-f52108484609" containerName="manager"
Sep 10 21:52:58.753636 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.753621    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc890ab7-b699-46d5-b6c2-f52108484609" containerName="manager"
Sep 10 21:52:58.756844 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.756826    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"
Sep 10 21:52:58.759784 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.759761    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-99snq\""
Sep 10 21:52:58.767139 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.767111    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"]
Sep 10 21:52:58.778367 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.778343    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s9d4\" (UniqueName: \"kubernetes.io/projected/0011c497-ab9b-433f-9928-51b30f989ac1-kube-api-access-6s9d4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x2ckd\" (UID: \"0011c497-ab9b-433f-9928-51b30f989ac1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"
Sep 10 21:52:58.778501 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.778463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0011c497-ab9b-433f-9928-51b30f989ac1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x2ckd\" (UID: \"0011c497-ab9b-433f-9928-51b30f989ac1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"
Sep 10 21:52:58.879809 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.879779    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0011c497-ab9b-433f-9928-51b30f989ac1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x2ckd\" (UID: \"0011c497-ab9b-433f-9928-51b30f989ac1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"
Sep 10 21:52:58.879966 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.879846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s9d4\" (UniqueName: \"kubernetes.io/projected/0011c497-ab9b-433f-9928-51b30f989ac1-kube-api-access-6s9d4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x2ckd\" (UID: \"0011c497-ab9b-433f-9928-51b30f989ac1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"
Sep 10 21:52:58.880226 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.880176    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0011c497-ab9b-433f-9928-51b30f989ac1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x2ckd\" (UID: \"0011c497-ab9b-433f-9928-51b30f989ac1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"
Sep 10 21:52:58.888315 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:58.888295    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s9d4\" (UniqueName: \"kubernetes.io/projected/0011c497-ab9b-433f-9928-51b30f989ac1-kube-api-access-6s9d4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x2ckd\" (UID: \"0011c497-ab9b-433f-9928-51b30f989ac1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"
Sep 10 21:52:59.068165 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:59.068146    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"
Sep 10 21:52:59.347312 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:59.347289    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"]
Sep 10 21:52:59.348966 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:52:59.348939    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0011c497_ab9b_433f_9928_51b30f989ac1.slice/crio-cef9975e14213793015805acce667608587259268e852f6651ad59a49e207827 WatchSource:0}: Error finding container cef9975e14213793015805acce667608587259268e852f6651ad59a49e207827: Status 404 returned error can't find the container with id cef9975e14213793015805acce667608587259268e852f6651ad59a49e207827
Sep 10 21:52:59.863326 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:59.863293    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd" event={"ID":"0011c497-ab9b-433f-9928-51b30f989ac1","Type":"ContainerStarted","Data":"e0a3b1bb0d9f9b9a9115d2ce867595bce289f6b32245f35c32aa5937dc01a602"}
Sep 10 21:52:59.863735 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:59.863340    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd" event={"ID":"0011c497-ab9b-433f-9928-51b30f989ac1","Type":"ContainerStarted","Data":"cef9975e14213793015805acce667608587259268e852f6651ad59a49e207827"}
Sep 10 21:52:59.863735 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:59.863430    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"
Sep 10 21:52:59.887635 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:52:59.887587    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd" podStartSLOduration=1.8875724649999999 podStartE2EDuration="1.887572465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:52:59.884926625 +0000 UTC m=+2030.087257197" watchObservedRunningTime="2026-09-10 21:52:59.887572465 +0000 UTC m=+2030.089903037"
Sep 10 21:53:10.871471 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:53:10.871439    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x2ckd"
Sep 10 21:54:10.411926 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:10.411814    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:54:10.418120 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:10.418101    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:54:54.457273 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.457234    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"]
Sep 10 21:54:54.460844 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.460826    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.480473 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.480437    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"]
Sep 10 21:54:54.604070 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.604034    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06548ac-4466-413d-8c13-487959ec4d59-metrics-certs\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.604070 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.604069    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06548ac-4466-413d-8c13-487959ec4d59-openshift-service-ca\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.604397 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.604106    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06548ac-4466-413d-8c13-487959ec4d59-maas-api-tls\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.604397 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.604257    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz7pz\" (UniqueName: \"kubernetes.io/projected/e06548ac-4466-413d-8c13-487959ec4d59-kube-api-access-jz7pz\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.705657 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.705614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz7pz\" (UniqueName: \"kubernetes.io/projected/e06548ac-4466-413d-8c13-487959ec4d59-kube-api-access-jz7pz\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.705854 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.705687    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06548ac-4466-413d-8c13-487959ec4d59-metrics-certs\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.705854 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.705714    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06548ac-4466-413d-8c13-487959ec4d59-openshift-service-ca\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.705854 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.705766    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06548ac-4466-413d-8c13-487959ec4d59-maas-api-tls\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.706783 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.706748    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e06548ac-4466-413d-8c13-487959ec4d59-openshift-service-ca\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.708491 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.708415    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e06548ac-4466-413d-8c13-487959ec4d59-maas-api-tls\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.708927 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.708899    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e06548ac-4466-413d-8c13-487959ec4d59-metrics-certs\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.715121 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.715088    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz7pz\" (UniqueName: \"kubernetes.io/projected/e06548ac-4466-413d-8c13-487959ec4d59-kube-api-access-jz7pz\") pod \"maas-api-7f95b84469-gxmv7\" (UID: \"e06548ac-4466-413d-8c13-487959ec4d59\") " pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:54.774721 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:54.774684    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:55.060310 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:55.058814    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"]
Sep 10 21:54:55.062397 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:54:55.062363    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06548ac_4466_413d_8c13_487959ec4d59.slice/crio-724ae4a45a2174abd82f63e6ebfaead0ec59a65d973ad9d4e9a5a9c5e57cde92 WatchSource:0}: Error finding container 724ae4a45a2174abd82f63e6ebfaead0ec59a65d973ad9d4e9a5a9c5e57cde92: Status 404 returned error can't find the container with id 724ae4a45a2174abd82f63e6ebfaead0ec59a65d973ad9d4e9a5a9c5e57cde92
Sep 10 21:54:55.583110 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:55.583079    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7" event={"ID":"e06548ac-4466-413d-8c13-487959ec4d59","Type":"ContainerStarted","Data":"77b6ecaee2fe9b3c27cf7ff7cae8097be05c5810418ed463af9599a2f9679107"}
Sep 10 21:54:55.583489 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:55.583140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7" event={"ID":"e06548ac-4466-413d-8c13-487959ec4d59","Type":"ContainerStarted","Data":"724ae4a45a2174abd82f63e6ebfaead0ec59a65d973ad9d4e9a5a9c5e57cde92"}
Sep 10 21:54:55.583489 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:55.583240    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:54:55.603118 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:54:55.603073    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7" podStartSLOduration=1.206983119 podStartE2EDuration="1.6030591s" totalImagesPullingTime="396.075981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:54:55.601060562 +0000 UTC m=+2145.803391136" watchObservedRunningTime="2026-09-10 21:54:55.6030591 +0000 UTC m=+2145.805389711"
Sep 10 21:55:01.595691 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:01.595662    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f95b84469-gxmv7"
Sep 10 21:55:01.648641 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:01.648609    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-586c445589-k4p28"]
Sep 10 21:55:01.648827 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:01.648802    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28" podUID="0596231a-9700-4156-afe4-86ba4376986d" containerName="maas-api" containerID="cri-o://b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603" gracePeriod=30
Sep 10 21:55:02.900395 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:02.900371    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:55:02.979114 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:02.979010    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-maas-api-tls\") pod \"0596231a-9700-4156-afe4-86ba4376986d\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") "
Sep 10 21:55:02.979280 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:02.979172    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0596231a-9700-4156-afe4-86ba4376986d-openshift-service-ca\") pod \"0596231a-9700-4156-afe4-86ba4376986d\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") "
Sep 10 21:55:02.979280 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:02.979240    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-metrics-certs\") pod \"0596231a-9700-4156-afe4-86ba4376986d\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") "
Sep 10 21:55:02.979418 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:02.979284    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbmnx\" (UniqueName: \"kubernetes.io/projected/0596231a-9700-4156-afe4-86ba4376986d-kube-api-access-vbmnx\") pod \"0596231a-9700-4156-afe4-86ba4376986d\" (UID: \"0596231a-9700-4156-afe4-86ba4376986d\") "
Sep 10 21:55:02.979560 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:02.979533    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0596231a-9700-4156-afe4-86ba4376986d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0596231a-9700-4156-afe4-86ba4376986d" (UID: "0596231a-9700-4156-afe4-86ba4376986d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:55:02.979720 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:02.979698    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0596231a-9700-4156-afe4-86ba4376986d-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:55:02.981367 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:02.981348    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0596231a-9700-4156-afe4-86ba4376986d" (UID: "0596231a-9700-4156-afe4-86ba4376986d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:55:02.981623 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:02.981602    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0596231a-9700-4156-afe4-86ba4376986d" (UID: "0596231a-9700-4156-afe4-86ba4376986d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:55:02.981701 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:02.981621    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0596231a-9700-4156-afe4-86ba4376986d-kube-api-access-vbmnx" (OuterVolumeSpecName: "kube-api-access-vbmnx") pod "0596231a-9700-4156-afe4-86ba4376986d" (UID: "0596231a-9700-4156-afe4-86ba4376986d"). InnerVolumeSpecName "kube-api-access-vbmnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:55:03.080714 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.080684    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-metrics-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:55:03.080714 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.080710    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbmnx\" (UniqueName: \"kubernetes.io/projected/0596231a-9700-4156-afe4-86ba4376986d-kube-api-access-vbmnx\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:55:03.080869 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.080729    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0596231a-9700-4156-afe4-86ba4376986d-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Sep 10 21:55:03.634606 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.634561    2568 generic.go:356] "Generic (PLEG): container finished" podID="0596231a-9700-4156-afe4-86ba4376986d" containerID="b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603" exitCode=0
Sep 10 21:55:03.634779 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.634625    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28"
Sep 10 21:55:03.634779 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.634646    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28" event={"ID":"0596231a-9700-4156-afe4-86ba4376986d","Type":"ContainerDied","Data":"b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603"}
Sep 10 21:55:03.634779 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.634710    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-586c445589-k4p28" event={"ID":"0596231a-9700-4156-afe4-86ba4376986d","Type":"ContainerDied","Data":"383dffad9a9a7d33a15525fa93cf99f889c8fd0c8a79238c64f06b19d66bc6f9"}
Sep 10 21:55:03.634779 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.634734    2568 scope.go:117] "RemoveContainer" containerID="b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603"
Sep 10 21:55:03.645181 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.645163    2568 scope.go:117] "RemoveContainer" containerID="b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603"
Sep 10 21:55:03.645456 ip-10-0-137-146 kubenswrapper[2568]: E0910 21:55:03.645437    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603\": container with ID starting with b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603 not found: ID does not exist" containerID="b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603"
Sep 10 21:55:03.645504 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.645464    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603"} err="failed to get container status \"b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603\": rpc error: code = NotFound desc = could not find container \"b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603\": container with ID starting with b959c9e453ae80ddff9da12470bca98d1ddf1d963fa0c794aa84e08d5905e603 not found: ID does not exist"
Sep 10 21:55:03.659280 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.659257    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-586c445589-k4p28"]
Sep 10 21:55:03.662967 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:03.662949    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-586c445589-k4p28"]
Sep 10 21:55:04.197106 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:04.197075    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0596231a-9700-4156-afe4-86ba4376986d" path="/var/lib/kubelet/pods/0596231a-9700-4156-afe4-86ba4376986d/volumes"
Sep 10 21:55:21.239851 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:21.239821    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2c2gr_65ee96ae-2b1b-4538-828a-7498b50fe26d/manager/0.log"
Sep 10 21:55:21.354969 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:21.354942    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hpfhj_8a061114-c7aa-4b66-a83e-61a2d16fba8b/manager/0.log"
Sep 10 21:55:21.480073 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:21.480048    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b484dfdf9-9r2x7_11f016ea-06ca-43ac-a7c5-ba17ff10a99e/manager/0.log"
Sep 10 21:55:21.841983 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:21.841955    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56fc979fdc-29x7b_f16b6ddc-b350-48c7-a25b-f411445bef34/copy-manifests/0.log"
Sep 10 21:55:21.860471 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:21.860435    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56fc979fdc-29x7b_f16b6ddc-b350-48c7-a25b-f411445bef34/manager/0.log"
Sep 10 21:55:22.505547 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:22.505519    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f95b84469-gxmv7_e06548ac-4466-413d-8c13-487959ec4d59/maas-api/0.log"
Sep 10 21:55:22.948135 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:22.948106    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-hf44c_eecf4422-9c68-4b2e-81d0-afdf40372332/postgres/0.log"
Sep 10 21:55:23.842077 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:23.842041    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-9rkp5_f6201949-8563-464f-98ae-7184ed9419c7/manager/0.log"
Sep 10 21:55:23.960568 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:23.960543    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-rh2z7_c3af005f-f2e1-4a5a-9729-2a7b55288079/manager/0.log"
Sep 10 21:55:24.067382 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:24.067354    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-4p5wb_b9fcd363-7068-46ae-b849-4cea4cbd3900/kuadrant-console-plugin/0.log"
Sep 10 21:55:24.189811 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:24.189742    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-x2ckd_0011c497-ab9b-433f-9928-51b30f989ac1/manager/0.log"
Sep 10 21:55:25.024723 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:25.024700    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-745b97c954-k7w65_343364d4-a6e0-4e3c-ad8b-489929d1bb6a/kube-auth-proxy/0.log"
Sep 10 21:55:25.250546 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:25.250514    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-st2bc_bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e/istio-proxy/1.log"
Sep 10 21:55:25.364117 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:25.364094    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rnbls_d480b1a9-66d6-4634-891e-5d1985983820/payload-pre-processing/0.log"
Sep 10 21:55:25.478800 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:25.478765    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cpf6d_52436fcb-20bc-42ea-9b32-f232cf2ead71/payload-processing/0.log"
Sep 10 21:55:25.592577 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:25.592555    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79cd7487cd-68dhk_ed1605d8-d145-4cc4-8172-d6b03ffa2058/router/0.log"
Sep 10 21:55:25.935251 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:25.935227    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-46bpv_ec922c0c-33a9-4ed4-87b5-9596c9620f91/main/0.log"
Sep 10 21:55:26.391301 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:26.391270    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqg5t2_a4d6e430-b04a-4027-a8d5-9bb84c93a85c/main/0.log"
Sep 10 21:55:35.381253 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:35.381225    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kthqx_32820bf3-c33a-4610-b8ba-4e97526b5bd2/global-pull-secret-syncer/0.log"
Sep 10 21:55:35.490991 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:35.490968    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d9zqc_fbfb8929-d843-40f2-8563-0992d0209310/konnectivity-agent/0.log"
Sep 10 21:55:35.609532 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:35.609506    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-146.ec2.internal_71370ee16b2ace2d8a162fa943dad00b/haproxy/0.log"
Sep 10 21:55:40.276837 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:40.276805    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-9rkp5_f6201949-8563-464f-98ae-7184ed9419c7/manager/0.log"
Sep 10 21:55:40.300991 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:40.300966    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-rh2z7_c3af005f-f2e1-4a5a-9729-2a7b55288079/manager/0.log"
Sep 10 21:55:40.326964 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:40.326947    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-4p5wb_b9fcd363-7068-46ae-b849-4cea4cbd3900/kuadrant-console-plugin/0.log"
Sep 10 21:55:40.365283 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:40.365257    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-x2ckd_0011c497-ab9b-433f-9928-51b30f989ac1/manager/0.log"
Sep 10 21:55:42.125949 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.125918    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_735c823e-db53-49c4-b92c-7bca13a45dee/alertmanager/0.log"
Sep 10 21:55:42.149966 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.149944    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_735c823e-db53-49c4-b92c-7bca13a45dee/config-reloader/0.log"
Sep 10 21:55:42.170021 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.169999    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_735c823e-db53-49c4-b92c-7bca13a45dee/kube-rbac-proxy-web/0.log"
Sep 10 21:55:42.191159 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.191140    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_735c823e-db53-49c4-b92c-7bca13a45dee/kube-rbac-proxy/0.log"
Sep 10 21:55:42.211337 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.211316    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_735c823e-db53-49c4-b92c-7bca13a45dee/kube-rbac-proxy-metric/0.log"
Sep 10 21:55:42.232017 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.231996    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_735c823e-db53-49c4-b92c-7bca13a45dee/prom-label-proxy/0.log"
Sep 10 21:55:42.251978 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.251956    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_735c823e-db53-49c4-b92c-7bca13a45dee/init-config-reloader/0.log"
Sep 10 21:55:42.289571 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.289552    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-wf8wk_81d45025-d223-4c98-8cb7-8862526a046d/cluster-monitoring-operator/0.log"
Sep 10 21:55:42.426250 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.426161    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-rtbgk_b4c61f7c-f7ad-4646-9bf6-5e2010807bd7/monitoring-plugin/0.log"
Sep 10 21:55:42.467589 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.467553    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjvgx_16d4de75-ad29-4906-9e1e-58d23af68145/node-exporter/0.log"
Sep 10 21:55:42.486542 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.486524    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjvgx_16d4de75-ad29-4906-9e1e-58d23af68145/kube-rbac-proxy/0.log"
Sep 10 21:55:42.506343 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.506326    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjvgx_16d4de75-ad29-4906-9e1e-58d23af68145/init-textfile/0.log"
Sep 10 21:55:42.672361 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.672342    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-d5wbp_d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537/kube-rbac-proxy-main/0.log"
Sep 10 21:55:42.695968 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.695921    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-d5wbp_d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537/kube-rbac-proxy-self/0.log"
Sep 10 21:55:42.716584 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:42.716565    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-d5wbp_d487c9f8-2c44-4bdb-aa6d-b3abc2f6d537/openshift-state-metrics/0.log"
Sep 10 21:55:43.080585 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:43.080561    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54bf4879dd-4tt7g_e3e6d994-a696-43dc-957a-f8be6fcfd7c4/telemeter-client/0.log"
Sep 10 21:55:43.113662 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:43.113641    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54bf4879dd-4tt7g_e3e6d994-a696-43dc-957a-f8be6fcfd7c4/reload/0.log"
Sep 10 21:55:43.136728 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:43.136710    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54bf4879dd-4tt7g_e3e6d994-a696-43dc-957a-f8be6fcfd7c4/kube-rbac-proxy/0.log"
Sep 10 21:55:45.007454 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:45.007424    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-vj9kb_c20f577d-54db-4161-be6c-d730b05dfb35/networking-console-plugin/0.log"
Sep 10 21:55:45.677999 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:45.677964    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/1.log"
Sep 10 21:55:45.682888 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:45.682862    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-vcswn_05a25009-e9db-4042-ba43-54abf4fcc40b/console-operator/2.log"
Sep 10 21:55:46.243632 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.243599    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-577756c9bf-t94ds_7f2510b2-06d6-492d-9b81-17d0a0918fd7/console/0.log"
Sep 10 21:55:46.665216 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.665177    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"]
Sep 10 21:55:46.665664 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.665650    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0596231a-9700-4156-afe4-86ba4376986d" containerName="maas-api"
Sep 10 21:55:46.665720 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.665666    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0596231a-9700-4156-afe4-86ba4376986d" containerName="maas-api"
Sep 10 21:55:46.665762 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.665744    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0596231a-9700-4156-afe4-86ba4376986d" containerName="maas-api"
Sep 10 21:55:46.668880 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.668860    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.671157 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.671136    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xhl4t\"/\"openshift-service-ca.crt\""
Sep 10 21:55:46.671318 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.671302    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xhl4t\"/\"default-dockercfg-z8wtj\""
Sep 10 21:55:46.672060 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.672041    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xhl4t\"/\"kube-root-ca.crt\""
Sep 10 21:55:46.677094 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.677075    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"]
Sep 10 21:55:46.748126 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.748099    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-proc\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.748273 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.748142    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-sys\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.748273 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.748175    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6x9l\" (UniqueName: \"kubernetes.io/projected/18667039-5a9e-4a17-8d4a-9ac7560b81f4-kube-api-access-f6x9l\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.748273 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.748254    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-podres\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.748450 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.748293    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-lib-modules\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.848977 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.848954    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-proc\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.849111 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.848989    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-sys\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.849111 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.849012    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6x9l\" (UniqueName: \"kubernetes.io/projected/18667039-5a9e-4a17-8d4a-9ac7560b81f4-kube-api-access-f6x9l\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.849111 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.849046    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-podres\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.849111 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.849080    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-sys\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.849111 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.849085    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-lib-modules\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.849111 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.849082    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-proc\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.849394 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.849178    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-lib-modules\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.849394 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.849186    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18667039-5a9e-4a17-8d4a-9ac7560b81f4-podres\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.856980 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.856958    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6x9l\" (UniqueName: \"kubernetes.io/projected/18667039-5a9e-4a17-8d4a-9ac7560b81f4-kube-api-access-f6x9l\") pod \"perf-node-gather-daemonset-w4sh6\" (UID: \"18667039-5a9e-4a17-8d4a-9ac7560b81f4\") " pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:46.979246 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:46.979170    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:47.026350 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:47.026319    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-xgsm5_71c1b5d7-25bb-4890-ac13-247f2d355006/volume-data-source-validator/0.log"
Sep 10 21:55:47.253942 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:47.253918    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"]
Sep 10 21:55:47.256079 ip-10-0-137-146 kubenswrapper[2568]: W0910 21:55:47.256052    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod18667039_5a9e_4a17_8d4a_9ac7560b81f4.slice/crio-59a5c9631ad2f3d5d0169bdbbfebcb4bc47cc20c08a43996f10f04d445a4230f WatchSource:0}: Error finding container 59a5c9631ad2f3d5d0169bdbbfebcb4bc47cc20c08a43996f10f04d445a4230f: Status 404 returned error can't find the container with id 59a5c9631ad2f3d5d0169bdbbfebcb4bc47cc20c08a43996f10f04d445a4230f
Sep 10 21:55:47.898929 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:47.898890    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6" event={"ID":"18667039-5a9e-4a17-8d4a-9ac7560b81f4","Type":"ContainerStarted","Data":"e428303fbb007053ab24f9b3aaa6930d9e54efde2e93d6af1f93a3d10dd8196d"}
Sep 10 21:55:47.899132 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:47.898944    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6" event={"ID":"18667039-5a9e-4a17-8d4a-9ac7560b81f4","Type":"ContainerStarted","Data":"59a5c9631ad2f3d5d0169bdbbfebcb4bc47cc20c08a43996f10f04d445a4230f"}
Sep 10 21:55:47.899132 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:47.899019    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:47.919817 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:47.919765    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6" podStartSLOduration=1.919754015 podStartE2EDuration="1.919754015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:55:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:55:47.916514626 +0000 UTC m=+2198.118845197" watchObservedRunningTime="2026-09-10 21:55:47.919754015 +0000 UTC m=+2198.122084587"
Sep 10 21:55:48.339024 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:48.338996    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-45m6w_cca846cb-713a-479b-ac8f-47133f900f05/dns/0.log"
Sep 10 21:55:48.362936 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:48.362911    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-45m6w_cca846cb-713a-479b-ac8f-47133f900f05/kube-rbac-proxy/0.log"
Sep 10 21:55:48.483678 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:48.483658    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-glgcs_dd2deb30-60af-4074-b910-bd87cebdf4bb/dns-node-resolver/0.log"
Sep 10 21:55:49.149739 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:49.149702    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zgtsv_5cd516c0-6d5a-40e1-8ec1-5b00366a50ab/node-ca/0.log"
Sep 10 21:55:50.410480 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:50.410449    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-745b97c954-k7w65_343364d4-a6e0-4e3c-ad8b-489929d1bb6a/kube-auth-proxy/0.log"
Sep 10 21:55:50.462774 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:50.462747    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-st2bc_bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e/istio-proxy/0.log"
Sep 10 21:55:50.470440 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:50.470421    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-st2bc_bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e/istio-proxy/1.log"
Sep 10 21:55:50.503136 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:50.503113    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rnbls_d480b1a9-66d6-4634-891e-5d1985983820/payload-pre-processing/0.log"
Sep 10 21:55:50.537331 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:50.537310    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cpf6d_52436fcb-20bc-42ea-9b32-f232cf2ead71/payload-processing/0.log"
Sep 10 21:55:50.559377 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:50.559360    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79cd7487cd-68dhk_ed1605d8-d145-4cc4-8172-d6b03ffa2058/router/0.log"
Sep 10 21:55:51.592722 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:51.592694    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rg85p_8d78005f-ee4e-4f99-9c0f-3250fe9eebd7/serve-healthcheck-canary/0.log"
Sep 10 21:55:52.074450 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:52.074424    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-bdtx2_c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3/insights-operator/0.log"
Sep 10 21:55:52.074617 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:52.074554    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-bdtx2_c0bf26a3-570a-4d3f-a0b4-b61dd92f81f3/insights-operator/1.log"
Sep 10 21:55:52.292082 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:52.292057    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jv9q_86e5182d-a251-4c66-9ecd-21f4a037f376/kube-rbac-proxy/0.log"
Sep 10 21:55:52.320160 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:52.320135    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jv9q_86e5182d-a251-4c66-9ecd-21f4a037f376/exporter/0.log"
Sep 10 21:55:52.347002 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:52.346941    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jv9q_86e5182d-a251-4c66-9ecd-21f4a037f376/extractor/0.log"
Sep 10 21:55:53.915569 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:53.915544    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xhl4t/perf-node-gather-daemonset-w4sh6"
Sep 10 21:55:54.688579 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:54.688548    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2c2gr_65ee96ae-2b1b-4538-828a-7498b50fe26d/manager/0.log"
Sep 10 21:55:54.859576 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:54.859542    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hpfhj_8a061114-c7aa-4b66-a83e-61a2d16fba8b/manager/0.log"
Sep 10 21:55:54.906164 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:54.906138    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b484dfdf9-9r2x7_11f016ea-06ca-43ac-a7c5-ba17ff10a99e/manager/0.log"
Sep 10 21:55:55.066727 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:55.066700    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56fc979fdc-29x7b_f16b6ddc-b350-48c7-a25b-f411445bef34/manager/0.log"
Sep 10 21:55:55.084395 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:55.084372    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56fc979fdc-29x7b_f16b6ddc-b350-48c7-a25b-f411445bef34/copy-manifests/0.log"
Sep 10 21:55:56.783415 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:56.783390    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-v8f5t_64ce1aca-d4df-4bf4-ab90-999520a4efae/openshift-lws-operator/0.log"
Sep 10 21:55:57.776250 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:57.776223    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-745b97c954-k7w65_343364d4-a6e0-4e3c-ad8b-489929d1bb6a/kube-auth-proxy/0.log"
Sep 10 21:55:57.818016 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:57.817992    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-st2bc_bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e/istio-proxy/0.log"
Sep 10 21:55:57.825724 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:57.825703    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-st2bc_bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e/istio-proxy/1.log"
Sep 10 21:55:57.850424 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:57.850399    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rnbls_d480b1a9-66d6-4634-891e-5d1985983820/payload-pre-processing/0.log"
Sep 10 21:55:57.875206 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:57.875186    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cpf6d_52436fcb-20bc-42ea-9b32-f232cf2ead71/payload-processing/0.log"
Sep 10 21:55:57.888211 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:57.888186    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79cd7487cd-68dhk_ed1605d8-d145-4cc4-8172-d6b03ffa2058/router/0.log"
Sep 10 21:55:59.714312 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:59.714285    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-745b97c954-k7w65_343364d4-a6e0-4e3c-ad8b-489929d1bb6a/kube-auth-proxy/0.log"
Sep 10 21:55:59.754553 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:59.754519    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-st2bc_bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e/istio-proxy/0.log"
Sep 10 21:55:59.763671 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:59.763648    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-st2bc_bbd36f04-c9cc-4b3e-8644-1a7ec4f1072e/istio-proxy/1.log"
Sep 10 21:55:59.788813 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:59.788789    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rnbls_d480b1a9-66d6-4634-891e-5d1985983820/payload-pre-processing/0.log"
Sep 10 21:55:59.813263 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:59.813240    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cpf6d_52436fcb-20bc-42ea-9b32-f232cf2ead71/payload-processing/0.log"
Sep 10 21:55:59.833716 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:55:59.833700    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79cd7487cd-68dhk_ed1605d8-d145-4cc4-8172-d6b03ffa2058/router/0.log"
Sep 10 21:56:02.568432 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:02.568404    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-dr2wx_e81cef71-792e-40cd-ae39-887ffd2bf1ea/kube-storage-version-migrator-operator/1.log"
Sep 10 21:56:02.569135 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:02.569120    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-dr2wx_e81cef71-792e-40cd-ae39-887ffd2bf1ea/kube-storage-version-migrator-operator/0.log"
Sep 10 21:56:04.049357 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:04.049330    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dm2sf_c33420a8-f603-42f3-a341-909e91b104e0/kube-multus-additional-cni-plugins/0.log"
Sep 10 21:56:04.088447 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:04.088419    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dm2sf_c33420a8-f603-42f3-a341-909e91b104e0/egress-router-binary-copy/0.log"
Sep 10 21:56:04.125252 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:04.125225    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dm2sf_c33420a8-f603-42f3-a341-909e91b104e0/cni-plugins/0.log"
Sep 10 21:56:04.159355 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:04.159334    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dm2sf_c33420a8-f603-42f3-a341-909e91b104e0/bond-cni-plugin/0.log"
Sep 10 21:56:04.200267 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:04.200247    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dm2sf_c33420a8-f603-42f3-a341-909e91b104e0/routeoverride-cni/0.log"
Sep 10 21:56:04.241033 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:04.241016    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dm2sf_c33420a8-f603-42f3-a341-909e91b104e0/whereabouts-cni-bincopy/0.log"
Sep 10 21:56:04.296091 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:04.296074    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dm2sf_c33420a8-f603-42f3-a341-909e91b104e0/whereabouts-cni/0.log"
Sep 10 21:56:04.548762 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:04.548726    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d2rv4_04f97ba9-e71a-440d-9ea0-9d9a5f88da95/kube-multus/0.log"
Sep 10 21:56:04.637905 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:04.637875    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jx9c8_810abf45-98cd-4b31-99d7-55b358f4183a/network-metrics-daemon/0.log"
Sep 10 21:56:04.658498 ip-10-0-137-146 kubenswrapper[2568]: I0910 21:56:04.658477    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jx9c8_810abf45-98cd-4b31-99d7-55b358f4183a/kube-rbac-proxy/0.log"